Data scattered across spreadsheets and systems: where to start

By Pietro Makhoul

Organizing data starts with understanding its sources, meanings and usage rules. A single dataset alone cannot resolve information that lacks context.

Map the sources

List where each piece of information is recorded: spreadsheets, systems, documents or customer service tools. Note who maintains each source and what it is used for.

This map helps identify duplicates and dependencies. It also allows you to assess which sources can be accessed and which should remain under the responsibility of each team.

Define what needs to be consistent

Similar fields can represent different things. A date may refer to creation, payment or delivery; an amount may or may not include a fee. Document these meanings before combining records.

Also define how to identify the same person or order across sources. A person or an order is an entity: what the record represents. Across two spreadsheets, a unique order number may serve as the key for identifying it. Comparing that number across sources is a matching rule. Without this criterion, similar records may be linked by mistake.

Establish quality criteria

Which fields are required? What counts as a duplicate? How should missing values be handled? Who decides which source takes precedence when there is a discrepancy?

These criteria need to reflect how the information is used. The level of detail needed for an operational query may differ from what is required for an analysis of results.

Define a small deliverable

Choose a question the dataset needs to answer or a workflow it should support. Consolidate only the information needed for this first deliverable.

Record the origin of the data, the transformations applied and the points that need checking. This helps the person using the result understand its scope.

Plan for ongoing use

An organized dataset needs an update process. Define the frequency, responsibilities and how to identify when a source has changed.

The goal is to make information usable and verifiable. The technology depends on the sources, volume, access and the work it needs to support.

Explore Yarih’s data solution →