On July 14, 2026, the cybersecurity community received a harsh lesson on blind trust in generative AI tools. Independent research revealed that xAI’s Grok Build coding CLI (version 0.2.93) was uploading entire Git repositories, including full commit histories, to a company-owned Google Cloud Storage bucket. Telemetry showed a 27,800x gap between what the model needed to read (192 KB) and what it actually exfiltrated (5.10 GiB).

1. The "Opt-Out" Trap

The most alarming finding was not just the exfiltration, but the user interface deception. Developers who toggled off "Improve the model" assumed their code was safe. However, that switch only governed model training, not data retention or transmission. Server telemetry confirmed that trace uploading (trace_upload_enabled) remained active regardless of the user's privacy preference. In the AI era, a training opt-out is not a confidentiality guarantee.

2. Git History as a Silent Liability

AI tools that request access to a project's root directory do not just read the current working tree; they read the .git folder. This means any secret, API credential, or customer data that was committed and later deleted in the past remains present in the history. Exfiltrating commit history turns past secret management mistakes into active, large-scale data breaches.

3. The Unread Canary Test: Researchers planted a file named never_read_canary.txt with explicit instructions for the AI not to open it. The model obeyed and did not read it for its context, but the background agent packaged and sent it to remote storage anyway. This proves the exfiltration is a systemic, automated process, not a byproduct of model prompts.

4. Mitigation Strategies: Zero Trust for AI Agents

To cope with this new reality, organizations must implement proactive defense strategies against their own productivity tools:

5. Speculation: The Hidden Harvesting Business Model

Although xAI disabled the feature server-side after public exposure, the upload code remained in the client binary. This suggests a "harvest by default" strategy where exfiltration friction is only applied when caught. We will likely see other LLM providers adopt similar tactics, disguising training data collection as "session telemetry" or "state archives" to bypass privacy regulations and enterprise NDAs.

If an AI tool can exfiltrate 5 GB of intellectual property while the user believes they have opted into privacy, the question is no longer whether your code is being read by an AI, but which cloud storage server it is being archived on.