English
Shadow AI: The Data Leaks Your Security Team Can't See

Shadow AI: The Data Leaks Your Security Team Can't See

39.7% of all AI interactions at work contain sensitive data. Most happen through personal accounts your IT team doesn't even know about. Here's what the 2023–2025 incident record reveals, and what to do about it.

Your employees are already using AI. The question is whether you know about it.

The term \"Shadow AI\" describes a simple reality: employees use AI tools, ChatGPT, Gemini, Copilot, and dozens of smaller apps, without formal approval, oversight, or security review. They do it to be productive, not malicious. But the consequences are the same.

Cyberhaven's Q2 2025 analysis of 7 million workers found that 39.7% of all AI interactions contain sensitive data, a 270% increase since March 2023. Generative AI tools now cause 32% of all unauthorized data movements in enterprises. And 71.6% of that access happens through personal, unmanaged accounts that your security team has zero visibility into.

This isn't a future risk. It's happening right now, in your organization.

The Samsung wake-up call

The most widely cited Shadow AI incident happened at Samsung Semiconductor in March 2023. Less than 20 days after engineers were given access to ChatGPT, three separate data breaches occurred. One employee pasted proprietary chip measurement source code. A second submitted yield optimization code. A third transcribed a confidential meeting and asked ChatGPT to generate minutes from it.

Samsung's response was blunt: the data was no longer deletable from OpenAI's servers. They initially limited prompts to 1,024 bytes, then banned all generative AI tools on company devices entirely.

But Samsung wasn't unique, they were just the first to be public about it.

The incident record: 2023–2025

The public record of AI-related data exposures has grown significantly in just two years:

2023, Shadow AI becomes visible. In March, a Redis bug at OpenAI exposed conversation titles and payment metadata of ChatGPT Plus subscribers for nine hours, potentially affecting 1.2% of active Plus users. That same month, the Samsung incidents demonstrated how quickly employees will feed proprietary data into public AI tools when no governed alternative exists.

2024, Attack surfaces shift to AI assistants. Researchers demonstrated prompt injection chains against Slack AI and Microsoft 365 Copilot. The Slack AI vulnerability showed that an attacker in the same workspace could manipulate AI outputs through injected content. The Copilot research revealed \"ASCII Smuggling\", invisible Unicode characters that could exfiltrate data through clickable links. Both were patched before exploitation, but they proved that enterprise AI assistants introduce a fundamentally new class of risk.

2025, Third-party AI tools and zero-click exfiltration become strategic threats. The Struct Chat incident was the worst-case scenario: an unvetted Slack AI add-on streamed data through an unprotected Kafka broker, exposing tokens, emails, Slack conversations, and CI/CD pipeline URLs from over 1,000 users across 200 companies in a single hour.

EchoLeak (CVE-2025-32711) demonstrated a zero-click exfiltration chain against Microsoft 365 Copilot, no user interaction required. GeminiJack showed the same pattern against Google Gemini Enterprise through hidden instructions in Google Docs and Calendar invites.

Meanwhile, the US cybersecurity agency CISA experienced its own Shadow AI breach: \"For Official Use Only\" documents were uploaded to a public ChatGPT instance despite internal warning systems, proving that technical controls without governance enforcement are insufficient.

Why this keeps happening: the pattern behind the incidents

The research reveals a consistent pattern across all incidents. Organizations lose data control not through sophisticated exploits, but through unmanaged data flows:

Copy-paste into public AI. This is the Samsung and CISA pattern. Employees have a legitimate productivity need, no approved AI tool to meet it, and a public ChatGPT tab open. The data leaves the organization in seconds.

Unvetted third-party integrations. This is the Struct Chat pattern. An AI-powered Slack app promises productivity gains, bypasses the official marketplace, and streams data through misconfigured infrastructure.

Overprivileged AI connectors. This is the EchoLeak and GeminiJack pattern. Enterprise AI assistants are given broad access to email, documents, and calendars, then attackers exploit prompt injection to extract data from that context.

The common thread: every one of these incidents could have been prevented by a governance layer that controls which data flows into which AI systems.

What your organization should do, today

1. Give employees a governed AI alternative. The single most important lesson from Samsung and CISA: if you don't provide a secure, approved AI tool, employees will use public ones. Shadow AI is a supply problem, not just a compliance problem. Deploy an enterprise AI workspace with data protection guards, audit trails, and policy enforcement built in.

2. Enforce data boundaries technically. Acceptable Use Policies alone don't work, Samsung had policies too. Deploy DLP and CASB controls that detect, classify, and block sensitive data flowing to unapproved AI services. But don't just block, redirect to the sanctioned tool.

3. Lock down AI connector scopes. If you're deploying Microsoft 365 Copilot, Slack AI, or Google Gemini Enterprise, restrict connector access to the minimum necessary. Don't give AI assistants access to all of SharePoint or all email. Exclude sensitive repositories (legal, HR, finance, secrets) from RAG by default.

4. Treat AI apps like any third-party vendor. The Struct Chat incident shows what happens when AI tools bypass normal vendor review. Require SOC 2 / ISO certification, enforce marketplace-only installation, review OAuth scopes quarterly, and maintain the ability to revoke access instantly.

5. Extend incident response to AI and vendor chains. Your breach notification process needs to account for AI-specific scenarios: data submitted to public models (irrecoverable), vendor breaches in analytics pipelines (Mixpanel), and prompt injection leading to data exfiltration. Define clear escalation paths and GDPR Article 33/34 decision matrices.

The organizations that will avoid the next Samsung-scale incident aren't the ones with the most restrictive AI policies. They're the ones that channel AI usage through a governed, secure, auditable layer, so employees get the productivity gains while the security team maintains full visibility.

hegyon.ai is the governance layer between your people, your data, and AI models. Every query passes through data protection guards. Every interaction is logged and auditable. Every data flow is controlled by your policies, not left to chance. Because the best way to eliminate Shadow AI is to make the governed path the easiest path.

← Back to all posts