Skip to main content
GullySystem

How to Protect Business Data While Implementing AI

By Ganesh HS, Strategy and Technology, GullySystem

Protecting business data with AI means minimising what you share, verifying the provider's actual written terms on retention and training rather than assuming a default, restricting access with clear boundaries, and testing for leakage before going live. Major providers publish specific commitments on this, but they vary by product tier, so check the terms for the exact one you use.

Classify Your Data Before You Share Any of It

Before connecting any AI tool to business information, sort what that tool would actually need to see into rough sensitivity tiers — public (marketing copy, published pricing), internal (operational data, supplier terms), and sensitive (customer personal data, financial records, health information, anything under a client confidentiality agreement). This classification, done once, drives every decision that follows.

Consider a multi-city diagnostics and pathology lab chain evaluating an AI assistant to help staff search lab protocols and equipment manuals. The protocols and manuals are internal, not sensitive — a reasonable AI tool can index them. Patient test results are a different tier entirely, and the design decision that matters most is keeping that data out of the assistant's reach unless there's a specific, verified reason and control in place for it to be there.

Read the Provider's Actual Terms, Not the Marketing Page

"We take your privacy seriously" on a landing page is not a policy — the specific, written terms for the product tier you're actually using are. The two things to check explicitly are whether your inputs and outputs are used to train the provider's models, and how long your data is retained on their servers before deletion.

As of September 2026, the major frontier-model providers publish specific, checkable commitments here, and they're worth reading directly rather than assuming. Anthropic states that commercial customers on the API and Claude for Work are not used for model training by default, with API inputs and outputs automatically deleted from its backend within 30 days of receipt unless a longer period is required for legal or safety reasons, or unless the customer has a separate zero-data-retention agreement (Anthropic Privacy Center, checked 8 September 2026). OpenAI states that by default it does not use data from ChatGPT Enterprise, ChatGPT Business, or its API platform to train or improve its models, and offers a zero-data-retention option for eligible API customers under which prompts and responses are not stored after a request is processed (OpenAI, "Enterprise privacy at OpenAI" and "Offering Zero Data Retention for frontier models," checked 8 September 2026).

The detail that trips businesses up is that these defaults are usually tier-specific — a free or personal-tier product from the same company often runs different, more permissive defaults than its business or enterprise tier. Confirm which tier your team is actually using before assuming the enterprise terms apply.

Build in Access Boundaries, Redaction and Secret Handling

Provider-level terms handle what happens to data once it reaches the AI provider; they don't handle what your own team sends in the first place. Build access boundaries so only the data a given AI tool actually needs is reachable by it — not a blanket connection to every database or file store the business has, for convenience.

Where full record content isn't needed, redact or mask sensitive fields before they reach the AI step — a customer's order history without their full payment details, a support ticket without an account password pasted into it by mistake. And treat credentials, API keys and access tokens as things that must never appear in a prompt or a document an AI tool can read, the same discipline you'd apply to a new employee's system access.

Test for Leakage and Unsafe Tool Access Before Going Live

Before a pilot goes live, deliberately test it for two failure modes: whether it can be prompted or tricked into revealing information it shouldn't (a form of "prompt injection" where a crafted input gets the system to ignore its own restrictions), and whether any tool or system access it's been given lets it take an action beyond what was intended — reading a file outside its scope, or querying a database table nobody meant to expose.

For the diagnostics lab, that means specifically trying to get the assistant to return patient information it should have no access to, and confirming its actual database or file permissions match what was intended on paper — not just trusting the configuration screen.

Define Who Owns Review, Incidents and Deletion

Data protection doesn't end at go-live. Name who periodically reviews what the AI tool is actually being asked and what it's returning, who is responsible if something is leaked or misused, and what the process is if a customer or regulator asks for their data to be deleted from a system that includes an AI provider in its chain.

This is also where the limits of general advice matter: data-protection and compliance obligations vary by industry (health data carries different requirements from retail data) and by jurisdiction, so treat this article as a starting checklist, not a substitute for a compliance or legal review specific to your business and the data you actually handle.

AI data-flow and control map

A one-page map showing each data tier (public, internal, sensitive) down the side, and across the top: which AI tools can access it, what retention and training terms apply for that provider tier, what redaction is applied before it's sent, and who owns review for that tier — filled in once per AI tool the business connects.

Frequently asked questions

Can private data be used for training?

It depends entirely on the specific product tier and its written terms — commercial and enterprise tiers from major providers generally state that customer data is not used for training by default, while some consumer or free tiers of the same products default to using it unless you opt out. Always confirm the terms for the exact tier you're using rather than assuming.

How do we verify provider settings?

Check the provider's current data-processing or privacy documentation for your specific plan (not a general marketing page), confirm any retention or zero-data-retention settings are actually enabled in your account configuration rather than just available, and re-verify after any plan change, since defaults can differ between tiers of the same product.

Next step

Have a specific situation to work through?

This article covers the general case. Tell us what you're actually dealing with and we'll respond directly.

Discuss Your Requirement