Penetration Testing

Red Team Versus Penetration Test: You're Probably Buying the Wrong One

Jun 11, 20265 min read

Every few months a CISO reads something compelling about adversary simulation, gets excited about a realistic, objective-driven attack against their environment, and signs a statement of work for a red team engagement. The testing runs for eight weeks. The final report contains sixty-three vulnerability findings across network, application, and identity attack surfaces.

That report is a penetration test. A long one. With different branding.

This happens constantly, and the confusion is not entirely the buyer's fault. Vendors use both terms loosely. The industry has no formal standard for what either engagement must include. And the difference matters a great deal for getting value out of either one.

What a Penetration Test Actually Is

A penetration test is a technical assessment scoped to specific systems, applications, or network segments. The job is to find as many exploitable vulnerabilities as possible within those boundaries, demonstrate their impact, and produce findings the organization can remediate.

The deliverable is coverage. You want to know whether externally exposed services have known CVEs running against them. Whether the web application accepts SQL injection. Whether a compromised workstation can reach the domain controller without anything stopping it. The tester catalogs everything within scope, prioritizes by severity, and hands over a report with remediation steps.

Penetration tests are time-boxed, usually days to a few weeks. They are not stealthy. The tester is not trying to evade your security operations center. That is not the goal. The goal is finding vulnerabilities, comprehensively, within the agreed scope. The scope is the constraint, not the attacker's tradecraft.

What a Red Team Engagement Actually Is

A red team engagement starts from a completely different premise. The question is not "what vulnerabilities exist" but "can a motivated adversary reach this objective, and would we know it."

The objective comes first, and it should be something specific and meaningful to the business: successfully accessing customer financial records, achieving domain administrator privileges, exfiltrating a defined sensitive dataset. The red team's job is to reach that objective by any path that works, without being detected by the defenders.

That last part is critical. Red team engagements are deliberately stealthy. The testing is designed to determine whether your detection and response capabilities would stop a real attacker. The red team is not cataloging every vulnerability in scope. They are moving through your environment the way a threat actor would, choosing the path of least resistance, and specifically trying to avoid triggering the alerts that would expose them.

The deliverable is not a vulnerability list. It is a narrative: here is how an attacker would approach your organization, here are the paths that succeeded without detection, and here is where your defensive team noticed and responded correctly. Or did not.

Why the Distinction Matters

These two things answer different questions, and the right sequencing matters.

An organization that has never had a penetration test on its external attack surface should not be running a red team engagement. You need to know what vulnerabilities exist before testing whether your defenders can catch someone exploiting them. Running a red team against an environment with unpatched externally-facing services is a good way to spend eight weeks and a significant budget discovering that your perimeter has basic problems a two-week penetration test would have found for considerably less money.

The sequence goes: penetration tests first, remediation, then red team exercises to stress-test detection and response. Most organizations that think they are ready for red team are not. The ones that run one anyway usually end up with an expensive penetration test and some amount of confusion about the difference.

Who Should Buy Which

If your organization has never had a formal external network assessment, start there. If your cloud environment has never been reviewed for misconfiguration, do that. If your web applications have not had a dedicated assessment recently, schedule one. These are all penetration tests, and they are the appropriate first step for most organizations that are not operating a mature security program.

Red team engagements become genuinely valuable when the basic hygiene is solid, when detection and response capabilities actually exist and are being actively monitored, and when leadership wants to know whether those capabilities would hold up against a sophisticated, persistent attacker. That is a meaningful question. It is also not the first question to ask.

The other case for red team is threat-specific simulation. A financial institution wanting to test its exposure to a known adversary group's specific techniques and tooling has a genuine use case that a standard penetration test cannot fulfill. Again, this makes sense after the foundational work is done, not instead of it.

What to Ask Before You Sign Anything

The scoping conversation will tell you what you are actually buying. If the engagement has pre-agreed target systems and the objective is to find vulnerabilities across them, you are buying a penetration test regardless of what the proposal calls it. If the engagement is built around a specific business objective and is explicitly designed to test detection and response, you may be looking at a genuine red team engagement.

Ask your prospective firm: what is this engagement designed to answer? If the answer is "we'll identify your vulnerabilities," that is a penetration test. If the answer is "we'll attempt to reach objective X using realistic attacker techniques while avoiding your blue team," that is closer to a red team. The terminology in the sales deck should match the actual structure of the work, and it often does not.

Buy the engagement that answers the question your organization actually needs to answer. For most organizations, that question is whether they have significant, exploitable vulnerabilities in the systems that matter most. That is what a penetration test is for. The red team engagement is the question you ask after you have fixed enough that the answer starts to get interesting.