In this guide 7 sections
Protecting business data with AI means sharing as little as possible and checking the provider’s written terms on retention and training instead of assuming a default. Restrict each tool to the folders it needs, mask sensitive fields and test for leakage before go-live, because defaults differ by product tier.
Classifying data before sharing it
Start with a list, not a tool. Write down every kind of data the assistant would need to read, then sort each kind into public, internal or sensitive before anyone connects anything to anything. Public covers pricing and marketing copy, internal covers supplier terms and procedures, and sensitive covers customer personal data, financial records, health information and client confidentiality agreements. One sort drives every later decision.
Take a diagnostics lab chain that wants an assistant to search lab protocols and equipment manuals, which are internal documents a reasonably vetted tool can index without much worry. Patient results belong to another tier. Keep them out of the assistant’s reach, and allow an exception only when someone names a verified reason and the control that makes it safe.
Record the owner beside every tier. List the source system, the person who owns it and the date the tier was last reviewed, so a spreadsheet nobody opens does not become the only record.
Reading the provider’s actual terms
A landing page line like “we take your privacy seriously” is not a policy, but the written terms for your exact product tier are. Check two things in those terms. One is whether your inputs and outputs train the provider’s models, and the other is how long the provider keeps your data on its servers before deleting it.
As of September 2026, Anthropic states that commercial customers on its API and Claude for Work are not used for model training by default. API inputs and outputs are deleted from its backend within 30 days of receipt, unless legal or safety reasons require longer or the customer has a zero-data-retention agreement. Anthropic Privacy Center, checked 8 September 2026. OpenAI states that by default it does not use data from ChatGPT Enterprise, ChatGPT Business or its API platform to train its models. Eligible API customers can also choose zero data retention, under which prompts and responses are not stored once a request has been processed. OpenAI privacy pages, checked 8 September 2026.
Defaults depend on tier. A free or personal plan often runs more permissive settings than the business plan, so confirm which one your team uses before assuming enterprise terms apply. Ask the vendor for the data-processing agreement in writing, and have it name the subprocessors that touch your data and the regions where it is stored.
Access boundaries, redaction and secret handling
Provider terms only cover what happens after data reaches the provider, and they say nothing about what your own staff paste into it in the first place. So build the boundary yourself. Give each AI tool access only to the folders, tables and mailboxes it needs, instead of a blanket connection to every database and file store the business owns.
Where full records are not needed, mask sensitive fields before the AI step, such as card details in an order history or a password pasted into a support ticket. Secrets need their own rule. Passwords, API keys and access tokens must stay out of every prompt and every document the tool can read, exactly as you would restrict a new employee’s first-week access.
Logs deserve the same care. Prompts, uploaded files and model replies are often stored in the tool’s history, so decide who can read that history and how long it is kept inside your account.
Testing for leakage and unsafe tool access
Test two failure modes before go-live. The first is whether a crafted input, known as prompt injection, can talk the system into ignoring its own restrictions and revealing information it should not. The second is whether its tool access lets it act beyond its brief, such as reading a file outside its scope or querying a table nobody meant to expose.
For the diagnostics lab, that means trying to coax patient results out of the assistant and then opening the database to see which tables its account can really read. Paper permissions prove nothing.
Write the results down. Record each attempt, the response it produced and the permission or setting that was changed afterwards, so the same test can be repeated after every model update or connection.
Ownership of review, incidents and deletion
Protection does not end at go-live. Review means reading a sample of real prompts and replies every month, looking for pasted secrets and answers that reveal more than the asker should see. Name one person who does that reading, another who answers for a leak, and a written process for deletion requests that reach the AI provider in your chain.
General advice has limits here. Health records carry different obligations from retail records, so treat this article as a starting checklist, not a substitute for a compliance review of your own data.
Deletion is the hard part. When a customer asks for erasure, you must know which copies sit with the provider, in exported logs and in staff mailboxes, and who can remove each.
AI data-flow and control map
A one-page map lists the public, internal and sensitive tiers down the side, with columns for the AI tools allowed to read each tier and the provider’s retention terms. Further columns record the redaction applied before sending and the named reviewer, and you fill in one copy for every AI tool the business connects.
Open a blank worksheet to printQuestions owners ask
Can private data be used for training?
It depends on the tier. Commercial and enterprise tiers generally state that customer data is not used for training by default, while some free tiers default to using it unless you opt out. Read the terms for your exact tier.
How do we verify provider settings?
Open the provider’s current data-processing documentation for your plan, not a marketing page, and confirm that retention settings are switched on in your account, not merely offered. Repeat the check after any plan change.
Who should own AI data protection?
Give it to one named person, usually whoever already answers for IT or compliance, with a quarterly slot to review the data map and the tools connected to it. Shared ownership usually means none.
Sources
- Anthropic Privacy Center — how commercial customer data is used in model training — verified 8 Sept 2026
- Anthropic Privacy Center — data retention for API and commercial products — verified 8 Sept 2026
- OpenAI — Enterprise privacy at OpenAI — verified 8 Sept 2026
- OpenAI — Offering Zero Data Retention for frontier models — verified 8 Sept 2026
