Privacy

Your prompts can become training data

Jul 15, 20265 min read

You open a chatbot, paste in a contract, and ask it to summarize the risky clauses. The reply comes back in seconds. The window feels like a private notebook, just you and the machine. It is not. The text you pasted left your computer, traveled to a company's servers, and may now sit in a log. It might be read by a person. It might help train the next version of the model.

Most people never think about this. The interface looks calm and personal, so we treat it like one. But a chatbot is a service run by a company, and what happens to your words after you hit send depends on that company's choices, not yours.

What "private" usually does not mean

When you type into a consumer AI tool, your message is sent to a provider that processes it and stores some record of it. Two things tend to happen that surprise people.

First, your content may be used to improve the model. For years, the common pattern across consumer AI products has been that user content can feed model training unless you turn that off or use a business plan. The setting to opt out often exists, but it is off by default in some products and buried in others. Many people never find it.

Second, your content may be kept for a while even if it is never used for training. Providers commonly retain logs for a period to monitor for abuse, fraud, and safety problems. That retention is separate from training. So even a tool that promises not to train on your data may still store it for some time.

The exact rules differ by provider, by plan, and by region. They also change. A policy you read last year may not describe what happens today.

Humans may read what you write

There is a second assumption worth dropping: the idea that only a machine ever sees your words.

To keep these systems safe, providers run review processes. Automated systems flag content, and in some cases human reviewers look at flagged conversations to check for abuse or to improve quality. That is a normal part of running a large service. It also means a stranger could, in principle, read the text you thought was just between you and a model.

For a casual question, that may not matter. For a client's financial records, a patient's history, an unreleased product plan, or anything covered by a confidentiality agreement, it matters a great deal. "A human probably will not see this" is not a standard you would accept anywhere else in your professional life.

For confidential or privileged material, "probably not used" and "probably not seen" are not good enough. Treat anything you send as something that could be stored and read.

Why the defaults are the real problem

You might think the answer is simple: just turn on the privacy setting, or pay for the business tier. Those help, and if you handle sensitive material you should do both where you can.

But defaults and policies are a moving target. Settings get reorganized. New features ship with their own data handling. Free tiers and paid tiers follow different rules. A teammate on a personal account does not have the protections your enterprise account does. The moment you depend on a setting being correct on every account, on every product, on every day, you have built a system that will eventually fail quietly.

And the failure is quiet. You will not get an alert that says your draft contract was retained or that a clause from it was reviewed. The data simply leaves and does not come back. There is no undo.

This is why "the provider says it does not train on my data" is a weak control for anything that truly must stay private. It depends on a promise, a configuration, and a policy that can all change without your knowledge.

The rule that does not depend on trust

There is one assumption that is always safe: anything you send to an outside AI service could be stored.

If you accept that, the path forward gets simple. The dependable control is not a setting on someone else's server. It is what you remove before your words ever leave your machine.

Take out the names, account numbers, addresses, case identifiers, and other sensitive details first. Replace them with stand-ins. Then send the cleaned-up text. If the provider keeps it, reviews it, or trains on it, there is nothing sensitive there to keep. You get the help of a powerful model without handing over the parts that needed protecting.

This is the difference between hoping and knowing. Tuning a privacy toggle is hoping the company behaves the way you expect. Masking the sensitive parts before they leave is knowing, because the protection happens on your side, under your control, before anything is sent.

A simple habit to adopt

You do not need to stop using AI tools. You need a habit:

  • Assume every prompt could be stored and read.
  • Never paste raw confidential or personal data into a consumer chatbot.
  • Strip or mask the sensitive parts on your own machine first.
  • Treat enterprise settings as a useful extra layer, not as your only line of defense.

The tools are genuinely useful, and refusing to use them is not realistic for most professionals. The realistic move is to change what you feed them. Keep the question, remove the secret.

Masking before sending is exactly what Velum is built to do. It removes sensitive details on your machine, so it no longer matters what a provider keeps or reviews. To see how this works for contracts, support tickets, medical notes, and more, see the use cases.

Share this article
XLinkedIn