Skip to main content
GullySystem

How to Prepare Business Data for AI

By Ganesh HS, Strategy and Technology, GullySystem

Preparing data for AI starts with defining the specific task and which data is actually allowed and relevant to it, then checking completeness, structure and provenance, cleaning and separating a held-out sample for evaluation, protecting sensitive fields, and maintaining quality afterwards — the same discipline good reporting needs, with added care around access and evaluation.

Define the Task Before Touching the Data

Consider a multi-branch accounting and bookkeeping firm exploring an AI assistant to answer staff questions from its own internal process documents and past client correspondence. "Preparing data for AI" means something different depending on the task — an AI assistant answering questions from company documents needs well-organised, accurate text; a model categorising incoming customer enquiries needs a labelled set of past examples; a forecasting use case needs clean, consistent historical numbers over time. Preparing data without first fixing the specific task risks preparing the wrong data entirely.

Equally important early on is scoping which data is actually allowed into the process — not every field a business holds should be available to an AI tool by default, particularly personal or commercially sensitive information. That scoping decision belongs with whoever owns the data and understands its sensitivity, not with whoever is building the AI use case.

Assess Completeness, Labels, Provenance and Permissions

Completeness matters more for AI use cases than for most reporting, because a model trained or grounded on data with large, unexplained gaps tends to produce confident-sounding answers that quietly reflect those gaps rather than flagging them. Checking what proportion of relevant records have the fields a use case depends on is a necessary early step, not an afterthought.

Labels — where a task needs them, such as a categorisation model trained on examples of correctly tagged enquiries — need to be accurate and consistently applied, since a model learns the labelling inconsistencies as readily as it learns the intended pattern. Provenance (where each piece of data came from) and permissions (who is actually allowed to use it for this purpose) both need documenting before the data moves anywhere, particularly for information originally collected for a different purpose than the AI use case now intends.

Clean, Structure and Hold Out an Evaluation Sample

The same cleaning discipline that applies to reporting data — standardised formats, resolved duplicates, validated fields — applies here too, and skipping it has the same consequence: an AI system trained or grounded on messy data reflects that mess in its outputs. Structuring matters as well; unstructured text works differently from a structured labelled dataset, and the preparation approach needs to match which one the task actually requires.

Before deployment, a portion of the prepared data should be set aside purely for evaluation — checking how the AI system performs against known, correct answers it hasn't been trained or grounded on — rather than evaluating against the same data it was built from, which tends to overstate how well it will perform on new, unseen cases.

Protect Sensitive Fields and Document Known Limitations

Personal information, financial details and anything commercially sensitive need explicit handling decisions before an AI use case goes live — masked, excluded, or accessible only under specific conditions — rather than included by default because it happened to be present in the source export. This is a data-governance decision with real consequences, and it deserves the same seriousness as any other access-control decision in the business.

Documenting known limitations of the prepared dataset — gaps in coverage, time periods with poor data quality, categories underrepresented in the examples used — gives whoever reviews the AI system's outputs a realistic sense of where it's likely to be less reliable, rather than treating every output with equal confidence.

Maintain Quality, Freshness and Access Over Time

Data preparation for AI isn't a one-time step before launch — the same data-quality and access questions that applied at the start need periodic revisiting as source systems change, new categories of data appear, and the business itself evolves. A dataset that was well-prepared a year ago can quietly drift out of date in ways that degrade an AI system's outputs without an obvious trigger.

Building a routine review — checking completeness and label accuracy on a schedule, confirming access permissions are still correct, updating documentation on known limitations — keeps the AI use case performing the way it did at launch, rather than assuming the original preparation work holds indefinitely.

AI data-readiness worksheet

A worksheet covering the specific AI task, the data sources and fields involved, a completeness and label-accuracy check, a sensitive-field handling decision per field, and a held-out evaluation sample plan — meant to be completed before, not after, an AI use case is built.

Frequently asked questions

Do we need labelled data for every AI use case?

No. Labelled examples matter for tasks like classification, where a model needs to learn from correctly tagged past cases. Other use cases, such as an assistant answering questions from existing company documents, rely more on the documents being accurate and well-organised than on labelled training examples.

Can poor data produce misleading AI outputs?

Yes, and often without an obvious signal that anything is wrong — an AI system built on incomplete, inconsistent or stale data tends to produce fluent, confident-sounding answers regardless of the underlying data's quality, which makes the resulting errors harder to catch than a visibly broken report.

Next step

Have a specific situation to work through?

This article covers the general case. Tell us what you're actually dealing with and we'll respond directly.

Discuss Your Requirement