The Work That Vibe Coding Skips
A developer ships twelve features in a month instead of four. Then, at three in the morning, $18,000 in stuck transactions exposes a problem he can't solve: he doesn't understand his own codebase.
---
Last February, Andrej Karpathy did something unusual. He retired a term he himself had invented.
A year earlier, Karpathy — the AI researcher best known for his work at OpenAI and his tenure as Director of AI at Tesla — had given the world "vibe coding": the practice of pointing an AI assistant at a problem, accepting whatever it generates, and iterating until the app mostly works. The name stuck. It captured something real about how a lot of people had started building software.
Then, in early 2026, he called it passé.
His replacement term was "agentic engineering." The distinction he drew wasn't just semantic. It cuts to the heart of a debate that's been running through developer communities all year: is AI making us worse at building software, or is it creating a new kind of expertise that raises the ceiling for what's possible?
---
The number nobody wants to talk about
There's a study that doesn't appear in many think-pieces about AI productivity. Published by METR in 2025, it followed experienced developers who were given access to AI coding tools. The result: they completed tasks 19% more slowly than when working without AI.
Those same developers, when asked afterward, estimated that AI had sped them up by 20%.
A 39-percentage-point gap between perception and reality. The developers felt faster. They were slower.
Anthropic's own 2026 Agentic Coding Trends Report offers a related number: developers now use AI in roughly 60% of their work. But they can fully delegate only 0 to 20% of tasks. The gap has a name — the delegation gap — and it's not shrinking as models improve. The bottleneck isn't the model's capability. It's the developer's ability to give the model the context it needs.
This is the delegation gap in quantitative form. AI handles the bulk of the work, and does it fluently. But the remaining fraction — architecture decisions, debugging cascading failures, security edge cases, systems that have to survive production — requires something the model doesn't have: understanding of why the code exists, what it's part of, and what it can never get wrong.
Vibe coders hand that fraction over too.
---
What Karpathy actually means
His new term is precise. "Agentic," he explains, because in this mode you are not writing code directly 99% of the time — you are orchestrating agents who do, and acting as oversight. "Engineering," to emphasize that there is an art and science to it. Expertise, not just prompting.
The practical test he proposes is blunt: Can you defend the output?
Not explain every line. Not have written it yourself. But defend it — understand it well enough to verify it, take responsibility for it, catch what the agent got wrong. He is explicit: "You're still responsible for your software just as before."
Agents are powerful interns. Interns make mistakes. The engineer's job is to know when they're wrong.
The uncomfortable corollary, noted by multiple observers, is that most people who describe themselves as agentic engineers are actually vibe coding at scale. The orchestration complexity is irrelevant. The number of agents is irrelevant. What matters is whether you maintain accountability through systematic verification — and most pipelines don't.
---
What actually breaks
The failure modes are consistent enough to be instructive.
A developer on Hacker News documented what happened when his vibe-coded SaaS product was attacked. The user list was visible in frontend code. His Stripe keys were exposed, allowing a hacker to issue refunds to every customer. His Supabase row-level security was misconfigured — the database was accessible to anyone who looked. He had built something real, something customers valued, something that generated revenue. He had not built something secure.

A developer on Medium wrote about six months of AI-assisted development. He had shipped twelve features in month one — triple his previous pace. He felt productive. When a senior engineer reviewed his codebase, they found forty-seven N+1 database queries in a single endpoint, eight duplicated payment systems, race conditions in payment processing, and silent failures throughout. The 3 AM production incident — $18,000 in stuck transactions — was the moment he realized he couldn't debug his own code, because he hadn't written it.
These aren't cherry-picked cautionary tales. A 2026 analysis of apps built on Lovable, a popular AI-assisted development platform, found that 170 of 1,645 applications had exposed sensitive user data.
The pattern is the same across all of them: AI completes the visible task. The invisible requirements — structured logging for when things break, rate limiting for when the app gets popular, authentication that doesn't accidentally skip a step — go unspecified, and so go unimplemented.
---
The case for vibe coding
There's a genuinely good argument on the other side, and it deserves a fair hearing.
Last year, a quarter of Y Combinator's startup cohort had codebases that were 95% AI-generated. These were companies that got to market, found customers, and generated revenue without traditional engineering teams. At Harvard, professor Karen Brennan ran a six-week vibe coding course with 92 students who had no programming background. Her observation: this is "changing the economics of experimentation." Ideas that would have required a six-month hiring process could be validated in a weekend.
The Hacker News developer whose Stripe keys were stolen had also proved something real. His product was functionally better than the incumbent competition, and customers stayed loyal through the security incident because the product worked. He had built something that mattered. Just not safely.
Simon Willison, a developer with two decades of experience and the creator of widely-used open-source tools, published an honest reflection in May 2026. He noticed that as AI tools became more reliable, he'd stopped reviewing every line — even for production work. The distinction between vibe coding and agentic engineering was blurring in his own practice. "AI tools are so reliable now," he wrote, that even experienced developers are finding themselves ceding more verification than they should.
This is a different kind of warning. The delegation gap isn't just a beginner problem. As models improve, the threshold at which it feels safe to stop checking rises — for everyone.
---
What this means for developers starting in 2026
The honest answer is nuanced in a way that's hard to act on.

AI tools will make you more productive before you've developed the underlying understanding you need to use them safely. The early feedback loop is misleading: things work, you ship fast, it feels like competence. The feedback that reveals the gaps — the 3 AM production failure, the security incident, the codebase you can't maintain — comes later, when the cost is higher.
Karpathy's observation about expertise as a multiplier cuts both ways. At the top, technical mastery makes you exponentially more productive with AI agents. You can direct a team of agents toward a complex system because you understand the system. The agents produce the output; you know whether it's right.
Without that foundation, you're fast at producing the wrong thing. And you're slow to find out.
The democratization argument has real force for the right contexts: personal projects, internal tools, prototypes, market validation. It breaks down for anything where strangers will trust you with their data, their money, or their time. The line isn't always obvious. That's the problem.
---
The question underneath the question
What Karpathy's shift from vibe coding to agentic engineering points toward isn't really about terminology. It's about whether the word "engineer" means anything when AI writes the code.
His answer is yes — but only if you maintain the part of engineering that AI can't replicate: judgment. The ability to define what correct looks like before you see the output. The ability to catch what's missing. The ability to take responsibility for what ships.
Addy Osmani, who leads engineering teams at Google, put it plainly: "AI promised us 10x developers and is making juniors prompt engineers." The difference between those two outcomes is whether the human in the loop understands what they're looking at.
That understanding doesn't come from vibe coding. It comes from the work that vibe coding skips.
Sources
Karpathy and the conceptual shift
- Vibe Coding Is Passé — The New Stack — Reports Karpathy's retirement of "vibe coding" and the case for agentic engineering as its successor
- Vibe Coding vs. Agentic Engineering: Karpathy's Framework — MindStudio — Breaks down the practical distinction: orchestration with accountability versus iteration without understanding
Research and data
- 2026 Agentic Coding Trends Report — Anthropic — Source for the delegation gap: AI used in 60% of work, but fully delegatable for only 0–20% of tasks
- METR Study 2025 — via Hivetrail analysis — The 39-percentage-point gap: developers worked 19% slower with AI tools, yet estimated a 20% speedup
- Vibe Coding and App Security: 1,645 Apps Analyzed — Frontend Mentor — Found 170 apps with exposed sensitive user data; grounds the security failure pattern in numbers
Developer experiences
- Vibe Code Is Legacy Code — Hacker News — First-person account of a vibe-coded SaaS product: exposed Stripe keys, misconfigured row-level security
- After 6 Months of Vibe Coding, My Codebase Is a Mess — Medium — The 3 AM production incident: 47 N+1 queries, eight duplicated payment systems, $18,000 in stuck transactions
Expert voices
- Vibe Coding Is Not the Same as AI-Assisted Engineering — Addy Osmani — Google engineering lead draws the line between prompting and engineering; source for the "10x vs. prompt engineer" quote
- Vibe Coding and Agentic Engineering — Simon Willison — Experienced developer reflects on his own creeping tendency to skip review; makes the delegation gap a universal problem
Broader context
- Vibe Coding May Offer Insight Into Our AI Future — Harvard Gazette — Professor Karen Brennan's six-week course with 92 non-programmers; the "economics of experimentation" argument
- The Supervisor Class — Fortune — Frames the emerging split between developers who oversee AI agents and those who are replaced by them