Most organizations fear what happens to data typed into AI tools. Close to half of their people type it in regardless. What that costs, what has already happened, what is coming, and what an organization can do about it.
The fear is widespread and the behavior has not changed. In a 2025 study of 2,600 privacy and security professionals, 64% worried about sensitive information leaking, and nearly half admitted entering personal or non-public data into generative AI tools.1 Only two in five people whose organizations use these tools say a policy guides their use.2
The cost is now measured. A 2025 study of 600 breached organizations found that high use of unapproved AI tools added $670,000 to the average breach, and that one in five organizations had a breach due to it.5
Most of the exposure runs through which tool, and which tier of it, people actually use. That is something an organization can decide.
Four independent studies, run on different populations, describe the same gap between what people fear and what they do.
"64% of respondents worry about inadvertently sharing sensitive information publicly or with competitors, yet nearly half admit to inputting personal employee or non-public data into GenAI tools."Cisco 2025 Data Privacy Benchmark Study, 2,600 privacy and security professionals, 12 countries1
"…almost half admit to using AI in ways that contravene organizational policies and uploading sensitive company information, such as financial, sales, or customer information, to public AI tools."KPMG and the University of Melbourne, 48,000+ people in 47 countries2
The same global study found that only two in five say a policy guides their use of these tools, and that two in three rely on AI output without evaluating it.2 Its US page reports that 72% of workers received no AI training or education.3
The 2026 Verizon Data Breach Investigations Report names the habit directly: "Shadow AI, referring to employees using unapproved AI tools at work, is now the third most common non-malicious data leakage related activity," while frequent use of AI tools "surged from 15% to 45% of employees in a single year."4
Small professional firms say the same about themselves. In the 2026 study of 1,376 US independent insurance agencies, the two biggest barriers to adopting AI were "Lack of knowledge about capability (60%) and security and privacy (48%)", both up ten points since 2024.10 Among independent agents asked for their single biggest concern, data privacy or compliance risk came first (24%) and inaccurate outputs second (22%).11 The public shares the worry: 71% of US adults expect the increased use of AI to make their personal information less secure.12
| Measure | Figure | Source |
|---|---|---|
| Average cost of a data breach, global (2025 study) | $4.44M | IBM / Ponemon, 600 organizations5 |
| Average cost of a data breach, United States (2025 study) | $10.22M | same5 |
| Added cost where use of unapproved AI tools was high | $670,000 | same5 |
| Organizations reporting a breach due to unapproved AI use | 1 in 5 | same5 |
| Organizations reporting breaches of AI models or applications | 13% | same5 |
| …of which reported no AI access controls in place | 97% | same5 |
| Breached organizations with no AI governance policy, or still developing one | 63% | same5 |
| Average cost of a data breach, global (2026 study) | $4.99M | IBM / Ponemon, 602 organizations6 |
| Malicious breaches that were AI-enabled, and their average cost (2026 study) | 1 in 4 · $6M | same; up 56% on the year6 |
Penalties stack on top of breach costs. In California, the privacy regulator's adjusted fines are up to $2,663 for each violation, and up to $7,988 for each intentional violation or one involving consumers known to be under 16.13
Read these as averages, not forecasts. The breach studies sample a few hundred organizations, most of them larger than a small firm. We found no published figure for organizations under 500 employees. What carries over to any size is the direction: unapproved tools, missing access controls and missing policy each push costs up.
On 13 May 2025, a federal magistrate judge in New York directed an AI provider to "preserve and segregate all output log data that would otherwise be deleted on a going forward basis … whether such data might be deleted at a user's request" or for other reasons.7 Lesson: where conversations are stored, and on whose terms, decides who can be compelled to keep them. A user pressing "delete" is not the last word.
In the 2025 breach study, 13% of organizations reported breaches of AI models or applications, and 97% of those had no AI access controls in place.5 A year later, one in four malicious breaches was AI-enabled.6 Lesson: an AI tool is a system to secure, not just an app to approve.
Researchers documented "a zero-click prompt injection vulnerability" in a widely used business assistant "that enabled remote, unauthenticated data exfiltration via a single crafted email."8 Lesson: an assistant that reads your mail and files can be steered by content someone else wrote. Ask what it can read, and what it can send out.
In September 2024 the US Federal Trade Commission announced five cases against deceptive AI claims and schemes, under the line "Using AI tools to trick, mislead, or defraud people is illegal."9 Lesson: what a vendor says about privacy and accuracy is a claim. Ask for the evidence behind it.
In Cisco's 2024 study, 27% of organizations had banned generative AI at least temporarily over privacy and data-security risks.14 Lesson: a ban without an alternative tends to move the use somewhere less visible, which is what the 2026 leakage figures in section 01 describe.
Most large AI providers run a consumer tier and a business tier under different terms. The difference is where most of the privacy risk sits. Three examples from providers' own pages, read in October 2026:
None of these terms is hidden. They are simply different, and the tier a person reaches for on a busy afternoon is usually the free one. The 2025 global study found most employees using free, public tools rather than ones their employer provides.2
The security community's list of top risks for AI applications puts it first, and notes that "prompt injections do not need to be human-visible/readable, as long as the content is parsed by the model."18
"Excessive agency": systems given "the ability to call functions or interface with other systems" that act on a prompt without anyone approving the action.19
The US National Institute of Standards and Technology warns that "Models may leak, generate, or correctly infer sensitive information about individuals," and that generative AI "expands the available attack surface."20
AI-enabled breaches rose 56% in a year.6
The European Commission's enforcement powers over general-purpose AI model providers apply from 2 August 2026, and models placed on the market before August 2025 must comply by 2 August 2027.21 In the US, the SEC's examiners will "assess whether firms have implemented adequate policies and procedures to monitor and/or supervise their use of AI technologies."22 State technology chiefs now rank artificial intelligence as their number one priority, overtaking cybersecurity for the first time.23
"…reading the contract terms and the terms of service to determine if any confidential information could be shared or used for training purposes."State Bar of Michigan, AI workgroup report, June 2025, on lawyers' duty of confidentiality24
The same report says the use of AI tools "may require informed consent from the client prior to inputting data into any AI tool," and is candid that on disclosure, "At this time in Michigan, the answer to this question is not clear."24
For investment advisers, the SEC's 2026 examination priorities look at AI supervision (section 05). For federal agencies, the White House's 2025 acquisition memorandum tells agencies to ensure contracts "permanently prohibit the use of non-public inputted agency data and outputted results to further train publicly or commercially available AI algorithms" without explicit agency consent.25 Across professions the instruction converges: know where the data goes, and write it into the contract.
A ban or a policy without a usable alternative pushes use out of sight. Only two in five people say a policy guides them today.2
NIST's generative-AI profile: "Update and integrate due diligence processes for GAI acquisition and procurement vendor assessments to include intellectual property, data privacy, security, and other risks."20
97% of organizations with AI breaches had none.5
Limit what an assistant can reach and do, and require a person to approve anything with consequences.19
Decide what may be stored, where and for how long, and keep the record of how it was configured.
Two in three people rely on AI output without evaluating it.2 Train them, and make review part of the job.
Know what happens when something leaks, and what is deleted, and how you would know, when you stop using a tool.20
Method. Every figure and quotation here was read on the publisher's own page or document on 7 October 2026. Figures are reported as published, not recomputed. Corrections are welcome.