Data as of Sep 17, 2026 · Based on 50 AI responses from ChatGPT Search and Google AI Mode · See how Parse measures this
Your brand can be here too.
For a 30-person engineering team, I’d treat **“won’t leak source code” as a security architecture requirement, not a vendor feature checkbox**. No cloud coding agent can honestly promise zero risk; the goal is to minimize exposure and make the remaining paths auditable. ## What to evaluate I’d score vendors internally…
For a 30-person engineering team, I’d treat “won’t leak source code” as a security architecture requirement, not a vendor feature checkbox. No cloud coding agent can honestly promise zero risk; the goal is to minimize exposure and make the remaining paths auditable.
I’d score vendors internally against these six gates:
| Gate | What you want |
|---|---|
| Training | Contractual commitment that your prompts, code, outputs, and repo context are not used to train models |
| Retention | Zero/near-zero retention, or a retention period you explicitly accept |
| Data path | Know exactly where source code goes: vendor, subprocessors, model provider, region |
| Agent permissions | Least-privilege repo/tool access; approval before destructive or external actions |
| Auditability | Per-user/session logs, admin controls, SSO/SCIM, ability to revoke access |
| Isolation | Sandbox/network restrictions so an agent can't casually exfiltrate code through tools, MCP servers, package managers, etc. |
The last point is particularly important: “the model provider doesn't train on our code” doesn't mean the agent can't leak it. An agent with shell, network, GitHub, Slack, cloud credentials, and MCP access can potentially move data through those channels.
For an enterprise rollout, I'd put GitHub Copilot Enterprise/Business, Claude Code under an enterprise/ZDR arrangement, and Codex under a business/enterprise setup into the bake-off rather than evaluating consumer subscriptions.
There are meaningful differences in their current controls:
Those policies can change, so I'd make the contract/DPA and technical configuration—not a salesperson's statement—the acceptance criteria.
Give each candidate the same sanitized-but-realistic repository and run a two-week pilot with perhaps 5–8 developers.
Have the agent perform:
Then inspect:
The fake-secret test is especially useful. Put a canary credential/string in the repo and monitor your egress, logging, and vendor-side telemetry. Don't use a real credential.
For 30 developers, I'd start with:
Developer → managed enterprise agent → isolated/sandboxed execution → approved repositories/tools → PR → human review
rather than:
Developer → unrestricted agent with GitHub + shell + network + cloud credentials.
I'd also initially prohibit:
GitHub, for example, now provides enterprise controls for MCP servers and can restrict agents to selected organizations/repositories. GitHub Docs Its third-party coding agents also undergo security validation including CodeQL, secret scanning, and dependency checks when generating/modifying code.
I'd separate "source-code confidentiality" from "IP/license risk."
Even if a provider doesn't retain or train on your code, generated code can still create licensing/IP questions. For example, GitHub documents public-code matching controls, and there are ongoing legal disputes around AI-generated code and open-source licensing.
So your security review should have two independent sign-offs:
Security: Can our proprietary code escape?
Legal/IP: What obligations arise from the code the agent generates?
For a 30-dev team, I'd make training exclusion + contractual retention terms + least-privilege agent permissions + auditable activity + network isolation hard gates. Everything else can be part of the comparative evaluation.
If you tell me whether you're primarily on GitHub/GitLab/Bitbucket and AWS/Azure/GCP, I can turn this into a concrete vendor scorecard and 2-week pilot plan for your team.
Rolling out an AI coding agent to a 30-developer team without compromising your intellectual property requires looking past marketing claims and auditing the vendor’s data boundary. For a team of this size, you want a tool that enforces enterprise-grade security by default without requiring a mountain of custom…
Rolling out an AI coding agent to a 30-developer team without compromising your intellectual property requires looking past marketing claims and auditing the vendor’s data boundary. For a team of this size, you want a tool that enforces enterprise-grade security by default without requiring a mountain of custom plumbing.
Here is a practical, step-by-step framework to evaluate and pick a coding agent that keeps your source code locked down.
Never allow your team to sign up for individual pro tiers using corporate credit cards. Consumer and standard developer tiers often have default settings that opt your code snippets and telemetry into future model training.
Before signing anything, ask your vendor (or look at their trust portal) for explicit proof of these four controls:
Different agent architectures introduce different data-leakage surfaces. Pick the category that fits your InfoSec team's appetite:
Technical controls fail if developer habits are sloppy. Establish these ground rules on day one:
.gitignore or tool-specific ignore files (like .cursorignore ) to explicitly block environment files, .env , private keys, and proprietary core algorithms from ever being bundled into the AI context window.To help narrow down the right platform for your group, tell me:
Aider
If the requirement is **“our proprietary source code must not become training data or sit indefinitely in a vendor’s systems,”** I’d treat this as a security/vendor-risk decision, not primarily a developer-productivity comparison. For a 30-person engineering org, I’d use this framework: ## 1. Define your…
If the requirement is “our proprietary source code must not become training data or sit indefinitely in a vendor’s systems,” I’d treat this as a security/vendor-risk decision, not primarily a developer-productivity comparison.
For a 30-person engineering org, I’d use this framework:
Put these in the procurement/security questionnaire:
That last point is increasingly important. Recent research found security defects in 16% of examined coding-agent setups, particularly around MCP servers, shell permissions, and agent extensions.
These are different threats.
Threat A — vendor learns your code
Your developers send:
Here are 14 files from our proprietary payment engine...The provider receives that context. You need to know what happens to it afterward.
Threat B — the agent leaks your code
An agent with filesystem/network access could potentially send information somewhere it shouldn't. Prompt injection is particularly relevant when agents read untrusted files, issues, webpages, documentation, or repositories.
So don't accept:
“We don't train on customer code.” as equivalent to:
“Your code cannot leave the authorized environment.” It isn't.
There are credible options, but the specific plan/configuration matters enormously.
A strong candidate if you're already standardized on GitHub. GitHub says Business and Enterprise customer data is protected under its Data Protection Agreement, and its model-hosting documentation describes zero-data-retention arrangements with some model providers.
I'd still make your security team verify the exact models, features, retention policies, BYOK behavior, and subprocessors you'll actually enable. GitHub explicitly notes that BYOK prompts/responses are subject to the selected provider's policies.
Very attractive if you want a powerful terminal-based agent. Anthropic documents enterprise deployment and offers privacy/retention controls; its API documentation also describes Zero Data Retention arrangements.
But pay attention to which account/product you're buying. Anthropic's Claude Code documentation says retention depends on account type and settings.
Worth serious consideration if you're an AWS-heavy organization. AWS states that Q Developer Pro code content isn't used for service improvement or model training; the Free tier has different data-use provisions.
AWS also documents where Q stores/processes questions, responses, context and code, which is exactly the level of detail your security review should demand.
I'd put it through a more rigorous security review rather than automatically rejecting it. The agent itself can be useful, but you're introducing another layer between developers and your source code, models, extensions/MCP servers, etc.
And there is a broader lesson here: recent reporting described attackers abusing Cursor's agent capabilities during real-world intrusions. That doesn't establish that Cursor leaked customers' source code, but it demonstrates why agent privilege and execution controls deserve as much scrutiny as provider data retention.
I'd literally send them this questionnaire:
| Question | Acceptable answer |
|---|---|
| Is customer code used to train models? | No, contractually prohibited |
| Are prompts/context/outputs retained? | No, or explicitly defined short retention |
| Can vendor staff see customer code? | No by default; exceptional audited access only |
| Are inputs sent to third-party model providers? | Explicit list + contractual protections |
| Can subprocessors change without notice? | Defined notification/approval mechanism |
| Can we force data residency? | Explicit regions |
| Can administrators disable features that transmit data? | Yes |
| Can we audit usage? | Yes |
| Can we delete stored data? | Defined deletion mechanism/SLA |
| Does the agent have network access? | Configurable/restrictable |
| Can it execute arbitrary shell commands? | Configurable/restrictable |
| Can it access credentials? | Scoped, preferably ephemeral |
| Can MCP/plugins/extensions access source code? | Explicit allowlisting |
| What happens if the vendor is breached? | Contractual notification + incident obligations |
If the answer to “Is this guaranteed contractually?” is vague, treat the feature as unapproved.
Don't give 30 developers your entire monorepo on day one.
Start with 5–8 engineers, using a representative but non-critical repository.
Measure:
Then deliberately test:
curl arbitrary external endpoints.The goal isn't merely:
“Can the agent write good code?” It's:
“Can this agent be safely given access to our code by 30 developers?”
For a 30-dev team, I'd use a tiered trust model:
Tier 1 — ordinary repositories
Agent can read/write repository files and create branches/PRs.
Tier 2 — sensitive repositories
Restricted agent, no arbitrary network access, no production credentials, tighter logging.
Tier 3 — crown-jewel code
Either no external agent at all, or a self-hosted/private inference architecture where your security team controls the complete data path.
And I'd make agent permissions narrower than developer permissions. An agent doesn't need your developer's AWS credentials simply because the developer has them.
If I were running the evaluation, I'd probably start with:
I would not choose based on “doesn't train on our code” alone. That's only one row in the security matrix.
The strongest selection criterion is:
Can I prove, contractually and technically, exactly where our source code goes, who can access it, how long it persists, and what autonomous actions the agent can take? If you can't answer those four questions, it's not ready for your proprietary repositories.
as equivalent to:
“Your code cannot leave the authorized environment.” It isn't.
There are credible options, but the specific plan/configuration matters enormously.
A strong candidate if you're already standardized on GitHub. GitHub says Business and Enterprise customer data is protected under its Data Protection Agreement, and its model-hosting documentation describes zero-data-retention arrangements with some model providers.
I'd still make your security team verify the exact models, features, retention policies, BYOK behavior, and subprocessors you'll actually enable. GitHub explicitly notes that BYOK prompts/responses are subject to the selected provider's policies.
Very attractive if you want a powerful terminal-based agent. Anthropic documents enterprise deployment and offers privacy/retention controls; its API documentation also describes Zero Data Retention arrangements.
But pay attention to which account/product you're buying. Anthropic's Claude Code documentation says retention depends on account type and settings.
Worth serious consideration if you're an AWS-heavy organization. AWS states that Q Developer Pro code content isn't used for service improvement or model training; the Free tier has different data-use provisions.
AWS also documents where Q stores/processes questions, responses, context and code, which is exactly the level of detail your security review should demand.
I'd put it through a more rigorous security review rather than automatically rejecting it. The agent itself can be useful, but you're introducing another layer between developers and your source code, models, extensions/MCP servers, etc.
And there is a broader lesson here: recent reporting described attackers abusing Cursor's agent capabilities during real-world intrusions. That doesn't establish that Cursor leaked customers' source code, but it demonstrates why agent privilege and execution controls deserve as much scrutiny as provider data retention.
I'd literally send them this questionnaire:
| Question | Acceptable answer |
|---|---|
| Is customer code used to train models? | No, contractually prohibited |
| Are prompts/context/outputs retained? | No, or explicitly defined short retention |
| Can vendor staff see customer code? | No by default; exceptional audited access only |
| Are inputs sent to third-party model providers? | Explicit list + contractual protections |
| Can subprocessors change without notice? | Defined notification/approval mechanism |
| Can we force data residency? | Explicit regions |
| Can administrators disable features that transmit data? | Yes |
| Can we audit usage? | Yes |
| Can we delete stored data? | Defined deletion mechanism/SLA |
| Does the agent have network access? | Configurable/restrictable |
| Can it execute arbitrary shell commands? | Configurable/restrictable |
| Can it access credentials? | Scoped, preferably ephemeral |
| Can MCP/plugins/extensions access source code? | Explicit allowlisting |
| What happens if the vendor is breached? | Contractual notification + incident obligations |
If the answer to “Is this guaranteed contractually?” is vague, treat the feature as unapproved.
Don't give 30 developers your entire monorepo on day one.
Start with 5–8 engineers, using a representative but non-critical repository.
Measure:
Then deliberately test:
curl arbitrary external endpoints.The goal isn't merely:
“Can the agent write good code?” It's:
“Can this agent be safely given access to our code by 30 developers?”
For a 30-dev team, I'd use a tiered trust model:
Tier 1 — ordinary repositories
Agent can read/write repository files and create branches/PRs.
Tier 2 — sensitive repositories
Restricted agent, no arbitrary network access, no production credentials, tighter logging.
Tier 3 — crown-jewel code
Either no external agent at all, or a self-hosted/private inference architecture where your security team controls the complete data path.
And I'd make agent permissions narrower than developer permissions. An agent doesn't need your developer's AWS credentials simply because the developer has them.
If I were running the evaluation, I'd probably start with:
I would not choose based on “doesn't train on our code” alone. That's only one row in the security matrix.
The strongest selection criterion is:
Can I prove, contractually and technically, exactly where our source code goes, who can access it, how long it persists, and what autonomous actions the agent can take? If you can't answer those four questions, it's not ready for your proprietary repositories.
Rolling out a coding agent to a 30-developer team means shifting from individual productivity hacks to organizational risk management. When evaluating an AI coding assistant (like GitHub Copilot, Cursor, Windsurf, or specialized CLI agents), "not leaking your source code" boils down to verifying data governance,…
Rolling out a coding agent to a 30-developer team means shifting from individual productivity hacks to organizational risk management. When evaluating an AI coding assistant (like GitHub Copilot, Cursor, Windsurf, or specialized CLI agents), "not leaking your source code" boils down to verifying data governance, zero-retention policies, and strict tenancy boundaries.
Here is a practical, step-by-step framework for picking a secure coding agent:
If you want to narrow this down, tell me:
Aider
No sources cited
Rolling out a coding agent to a 30-developer team means balancing developer velocity with absolute paranoia about your intellectual property. When evaluating tools (whether it's GitHub Copilot, Cursor, Codeium, or self-hosted alternatives), you need to look past the marketing fluff and audit the vendor's data…
Rolling out a coding agent to a 30-developer team means balancing developer velocity with absolute paranoia about your intellectual property. When evaluating tools (whether it's GitHub Copilot, Cursor, Codeium, or self-hosted alternatives), you need to look past the marketing fluff and audit the vendor's data lifecycle.
An evaluation framework designed to keep your source code out of public training sets and unauthorized hands includes the following steps:
To help narrow down the right choice for your team, let me know:
For a 30-developer team, I would not pick a coding agent based on “best model” first. I would treat it like granting a new contractor access to your repositories: **prove the data boundary, then optimize for developer velocity.** Here is the evaluation framework I’d use. ## 1. Start with a hard security gate
For a 30-developer team, I would not pick a coding agent based on “best model” first. I would treat it like granting a new contractor access to your repositories: prove the data boundary, then optimize for developer velocity.
Here is the evaluation framework I’d use.
Reject any tool that cannot clearly answer these questions in writing (contract + documentation):
| Question | Acceptable answer |
|---|---|
| Is our source code used to train your models? | “No” by default for business/enterprise use, with contract language |
| Where is code processed? | Documented regions/infrastructure |
| How long are prompts, code, logs, and embeddings retained? | Explicit retention period or zero-retention option |
| Can we delete our data? | Documented deletion process |
| Do employees or contractors access customer code? | Defined access controls and auditability |
| Do you have a DPA/security agreement? | Available before rollout |
| Can admins enforce policies? | SSO, SCIM, RBAC, audit logs, model controls |
Enterprise plans often have materially different data terms than individual plans. For example, OpenAI states that business/API customer data is not used for training by default, and Anthropic states that commercial Claude Code usage is not used to train models unless customers opt in.
Do not let developers individually expense personal AI coding subscriptions and connect company repositories. That is where many accidental leaks happen.
For a 30-person engineering org, I would require:
A good agent should behave like GitHub access: when someone leaves the company, their access disappears automatically.
Rank options from most controlled to least:
Best for highly sensitive IP.
Examples:
Tradeoff: more operational burden and often weaker models.
Usually the sweet spot.
You get:
Avoid for company code.
Even when a vendor offers privacy controls, individual tiers can have different data-use defaults. For example, GitHub has documented different Copilot data policies between individual and business/enterprise offerings.
Before rollout, create a pilot repo containing:
Test:
Ask:
Try:
Measure:
Human approval gates matter. Security guidance increasingly emphasizes least privilege and review before irreversible actions because agents can amplify mistakes or follow malicious instructions hidden in files.
A lightweight internal policy works well:
Allowed
Requires review
Never provide
I would use something like:
| Category | Weight |
|---|---|
| Data protection / contract terms | 35% |
| Admin/security controls | 20% |
| Developer productivity | 20% |
| Code quality | 15% |
| Cost | 10% |
Do not let “it writes code 15% better” outweigh “we cannot prove where our source went.”
For a 30-dev team, I would typically evaluate:
Then run a 2–4 week pilot with 5–8 developers:
The winner is the tool that your security team can approve and developers voluntarily keep using.
A useful final procurement question:
“If an engineer accidentally points this agent at our largest private repository tomorrow, can we prove exactly what data left our environment, where it went, who accessed it, and whether it was retained?” If the vendor cannot answer that clearly, it is not ready for a 30-person engineering rollout.
If the vendor cannot answer that clearly, it is not ready for a 30-person engineering rollout.
Yes. For a 30-person engineering org, I’d treat this as a **security/vendor-risk decision first and a coding-quality decision second**. The key distinction is: **“the vendor doesn't train on our code” is necessary, but not sufficient.** An agent can avoid training while still transmitting source code to a provider,…
Yes. For a 30-person engineering org, I’d treat this as a security/vendor-risk decision first and a coding-quality decision second.
The key distinction is: “the vendor doesn't train on our code” is necessary, but not sufficient. An agent can avoid training while still transmitting source code to a provider, retaining it temporarily, indexing your repo, or allowing an autonomous agent to exfiltrate data through tools.
I’d score candidates on these dimensions:
| Criterion | What I’d require |
|---|---|
| Training | Contractual guarantee that your prompts, code, outputs and repo context aren't used for model training |
| Retention | Ideally zero retention of prompts/code; otherwise explicit, configurable limits |
| Data path | Know exactly which companies receive source code and which models process it |
| Agent execution | Prefer local execution or tightly sandboxed cloud execution |
| Repo access | Least-privilege access; agent shouldn't automatically get every repository |
| Secrets | Ability to block .env, credentials, production configs, keys, etc. |
| Network | Ability to restrict outbound network access |
| Auditability | SSO/SCIM, audit logs, admin controls, usage visibility |
| Contract | DPA, security commitments, subprocessors, breach notification, deletion terms |
| Isolation | Enterprise tenants/data separated appropriately from other customers |
| Prompt injection resistance | Controls against malicious instructions embedded in issues, README files, dependencies, webpages, etc. |
That last one becomes particularly important with coding agents, because you're not merely sending snippets to autocomplete. You're giving software an ability to read files, execute commands, and potentially access the network.
As of September 2026, three particularly defensible options are GitHub Copilot Enterprise, Claude Code under commercial/Enterprise terms, and Cursor Enterprise—but I'd configure them differently.
If your company already lives in GitHub, this would probably be my first pilot.
GitHub explicitly says Copilot Business and Enterprise customer data isn't used to train its models. Its documented defaults also say IDE chat/completion prompts and suggestions aren't retained, although other Copilot surfaces can retain prompts for 28 days.
GitHub also provides enterprise controls and auditing for agent activity. Its cloud-agent ecosystem can now include third-party agents such as Claude and Codex, with security scanning of generated changes.
Why I'd like it for 30 developers: centralized identity, GitHub permissions, policy management, auditability, and relatively straightforward rollout.
Caveat: don't equate "Copilot Enterprise" with "nothing leaves our environment." Your code still goes through the relevant AI infrastructure/model providers. GitHub documents the hosting/data path for individual models, so your security review should examine the specific models you enable.
Claude Code has an attractive security architecture because the agent runs on the developer's machine and reads only the portions of the repository it needs, rather than uploading the entire repository for indexing. Anthropic says commercial customers' inputs/outputs aren't used to train models by default.
It also supports explicit file-deny rules—for example, preventing an agent from reading .env files.
I'd choose this if: your senior developers are comfortable with terminal-based workflows and you want a genuinely agentic coding experience.
Important: configure permissions aggressively. A local agent is not automatically a safe agent. If it can execute shell commands and make network requests, a malicious repository or prompt injection could potentially persuade it to send information somewhere it shouldn't.
Anthropic's current policies also have some model-specific retention considerations, so I'd verify the exact Enterprise/ZDR configuration and models you're purchasing rather than relying on a blanket "zero retention" assumption.
Cursor's Enterprise documentation says Privacy Mode prevents code from being used for training and that Privacy Mode is enabled by default for Enterprise teams; admins can enforce it organization-wide.
But pay particular attention to Cloud Agents. Cursor explicitly says those agents need to store code and environment data in the cloud while they run. It also warns about prompt injection and the possibility of an autonomous agent being induced to exfiltrate code.
So I'd be comfortable piloting Cursor Enterprise, but I'd initially disable cloud-agent functionality for sensitive repositories.
For your 30 developers, I'd establish four tiers:
And I'd require:
Don't ask vendors, "Do you leak our code?"
Give them a controlled repository containing canary secrets—fake credentials and uniquely identifiable strings—and run the agent through realistic tasks.
Then test:
.env/credentials?That exercise will tell you considerably more than a vendor's marketing page.
For 30 developers, I'd run a 2–3 week bake-off between Copilot Enterprise + Claude Code Enterprise, with Cursor Enterprise as the third candidate if your developers strongly prefer an IDE-centric experience.
I'd weight the evaluation roughly:
Security/privacy 40% → developer productivity 30% → code quality 20% → administration/cost 10%.
And I would make "no contractual training on customer code + documented data flows + enforceable admin controls" a hard gate, not something a vendor can compensate for with a better coding benchmark.
One particularly useful rule for your procurement team: never accept “we don't train on your data” as the complete answer. Ask “Who receives the data, what exactly is sent, where is it stored, how long, who can access it, what tools can the agent invoke, and can we enforce all of this centrally?”
Claude Code has an attractive security architecture because the agent runs on the developer's machine and reads only the portions of the repository it needs, rather than uploading the entire repository for indexing. Anthropic says commercial customers' inputs/outputs aren't used to train models by default.
It also supports explicit file-deny rules—for example, preventing an agent from reading .env files.
I'd choose this if: your senior developers are comfortable with terminal-based workflows and you want a genuinely agentic coding experience.
Important: configure permissions aggressively. A local agent is not automatically a safe agent. If it can execute shell commands and make network requests, a malicious repository or prompt injection could potentially persuade it to send information somewhere it shouldn't.
Anthropic's current policies also have some model-specific retention considerations, so I'd verify the exact Enterprise/ZDR configuration and models you're purchasing rather than relying on a blanket "zero retention" assumption.
Cursor's Enterprise documentation says Privacy Mode prevents code from being used for training and that Privacy Mode is enabled by default for Enterprise teams; admins can enforce it organization-wide.
But pay particular attention to Cloud Agents. Cursor explicitly says those agents need to store code and environment data in the cloud while they run. It also warns about prompt injection and the possibility of an autonomous agent being induced to exfiltrate code.
Rolling out autonomous coding agents to a 30-developer team means giving an external system deep read/write access to your intellectual property. To prevent source code leaks, model contamination, and compliance nightmares, you need a hard-nosed evaluation framework based on zero-trust principles. The evaluation…
Rolling out autonomous coding agents to a 30-developer team means giving an external system deep read/write access to your intellectual property. To prevent source code leaks, model contamination, and compliance nightmares, you need a hard-nosed evaluation framework based on zero-trust principles.
The evaluation framework breaks down into critical screening steps, architecture checks, and contractual must-haves:
If you'd like, let me know:
I can help tailor a shortlist of specific vendors that match your security posture.
Rolling out an AI coding agent to a 30-developer team means moving past individual "freemium" developer tools and evaluating platforms through a strict enterprise risk lens. Unlike passive code completers, autonomous or semi-autonomous *coding agents* require deep repo context, access to local files, terminal…
Rolling out an AI coding agent to a 30-developer team means moving past individual "freemium" developer tools and evaluating platforms through a strict enterprise risk lens. Unlike passive code completers, autonomous or semi-autonomous coding agents require deep repo context, access to local files, terminal execution, and sometimes external API calls—making data governance non-negotiable.
To pick an agent that won’t leak your source code, use this pragmatic evaluation and verification framework.
Never rely on marketing copy or terms of service on a public pricing page. You need contractual guarantees.
At a 30-dev scale, you shouldn't be doing custom security audits for every tool. Look for third-party validation:
How the agent reads your codebase matters just as much as where it sends the data.
.env, secrets.yaml , private keys, proprietary core algorithms) so developers don't accidentally leak secrets into an agent context window.Depending on how sensitive your IP is (e.g., if you're in fintech, healthtech, or defense), cloud-hosted SaaS might be a non-starter.
Red Flags: When to Walk Away
If you'd like, let me know:
I can narrow down specific tool recommendations that fit your security posture.
For a 30-dev team, I would **not pick a coding agent based primarily on model quality**. Pick it like you would pick a production dependency: define the data boundary, prove the controls, then optimize for developer productivity. The core question is: > “Can this agent see our source code, where does that code go,…
For a 30-dev team, I would not pick a coding agent based primarily on model quality. Pick it like you would pick a production dependency: define the data boundary, prove the controls, then optimize for developer productivity.
The core question is:
“Can this agent see our source code, where does that code go, how long is it retained, and what contractual guarantees do we have?” A useful evaluation framework:
Create a hard security checklist. A vendor should be able to answer these clearly:
| Question | Minimum acceptable answer |
|---|---|
| Is our code used for model training? | No, by default, contractually |
| Can we disable retention? | Yes |
| Where is data processed? | Documented regions/providers |
| Do we get a DPA? | Yes |
| Can admins enforce settings centrally? | Yes |
| Can we audit usage? | Yes |
| Can access be revoked through SSO? | Yes |
| Can the agent be restricted to specific repos? | Yes |
Be careful with “privacy mode” language. Some products distinguish between not retaining data and not sending data at all; those are different security properties.
Many AI coding tools have materially different policies between consumer and enterprise offerings. For example, GitHub has stated that Copilot Business and Enterprise are not affected by certain consumer-plan interaction-data policies. The GitHub Blog Anthropic similarly states that commercial products such as Claude Enterprise and API usage do not train models on customer data by default.
For a company rollout, avoid:
That creates an invisible data exfiltration path.
Pick 5–8 engineers from different areas.
Give them:
Test:
Try:
Ask:
Modern agents can run commands and interact with external systems, so the permission model matters as much as the model itself.
For a 30-person engineering org, I would usually stage it:
Allowed:
Required:
Allowed:
Required:
Only for:
Avoid giving an agent:
I would weight it roughly:
| Category | Weight |
|---|---|
| Data protection/legal terms | 35% |
| Admin/security controls | 25% |
| Developer experience | 20% |
| Model quality | 15% |
| Cost | 5% |
A brilliant model with unclear data handling should lose.
A one-page policy prevents most problems:
Allowed
Not allowed
Security guidance commonly emphasizes keeping secrets, tokens, and sensitive files out of coding-agent context because agents may access whatever is exposed in their workspace.
For a 30-dev team, I would evaluate:
But I would not declare a winner until each vendor passes your own security review. Vendor policies and defaults change frequently, so treat current documentation and contracts—not reputation—as the source of truth.
A practical next step: create a one-page “AI coding agent security questionnaire” and send it to 3 vendors before any pilot. That will usually eliminate the risky options quickly.