A coding-agent guide says bad context and weak checks cause most failures
A dev.to guide says AI coding agents mostly fail from guessing and from unchecked 'done' claims. Its fixes are simple enough for any team to try.
The short version
- The guide names two dominant failures: under-context (the agent guesses) and over-trust (it declares 'done' too early).
- It prefers connecting agents to an API's contract through an MCP server over pasting docs or curl commands.
- 'Done' should mean a runnable command that passes in CI, not a confident summary from the agent.
- It lists recurring anti-patterns, such as fixing type errors with as any and broad try-catch blocks that hide failures.
- The guide also promotes Powerduck, its own OpenAPI-first workspace, so read it as advice with a product attached.
Why it matters
If you use an AI assistant to write code, or manage people who do, the two checks here cost little: ask what the agent was actually told, and ask what proves the work. A confident 'finished' message is not evidence. Treating it as a claim to test heads off the most common embarrassing mistakes.
The two failures that keep recurring
As dev.to reported, a new practical guide on AI coding agents boils the subject down to one idea: an agent is only as good as the context it receives and the verification it is held to. It then names two failures that show up again and again in real work.
The first is under-context. When an agent does not know what an interface really looks like, it does not stop and ask. It guesses, and it may invent fields that do not exist. The second is over-trust. The agent reports it is finished after a clean run on the developer's own machine, even though nobody exercised the real flow a customer would use.
Our editors see this as useful framing rather than news. It is a guide, not a release or an announcement. But the framing is clear enough to take away.
Give the agent the contract, not a pile of docs
The guide is blunt about a common habit: pasting a command or a dump of documentation into the chat. It calls this a lossy way to inform an agent. Details get dropped, and the agent fills the gaps with plausible-sounding inventions.
The better design, it says, is to connect the agent to the real contract through tools. The contract here is the written description of what an API accepts and returns, often kept in a format called OpenAPI. The tool link is an MCP server. MCP, the Model Context Protocol, is a standard way to give an AI assistant access to tools and data. With that link in place, the agent calls documented operations instead of working from memory.
The guide adds two related points. If the contract is unknown, it is better for the agent to say so than to make one up. And when you need structured data back from a model, enforce its shape with a schema rather than parsing free-form text.
Designing for machines as well as people
One short section makes a point that is easy to miss. An interface that is pleasant for a human developer is not automatically easy for an agent. According to the guide, agents need operations they can discover, errors that are clearly typed, and identifiers that stay stable.
That is a request to the people who build services, not only to those who use agents. If your team exposes an API internally, the guide suggests that agent-friendliness is now a design goal worth planning for.
What 'done' should actually mean
The most quotable idea is that an agent's 'done' is a claim, not evidence. The guide wants it replaced by something checkable: a command anyone can run that passes in CI. CI, short for continuous integration, is the automated check that runs on shared infrastructure rather than on one person's laptop.
It also warns against shallow proof. A response code that says the request worked is not enough, and the guide argues the agent should run the actual business scenario. A green build after an AI-driven refactor, meaning a cleanup of existing code, can also miss things.
In its FAQ, the guide sets a minimum bar. Run the relevant tests and the real business flow in CI, and confirm the change fails without the fix. A test that cannot fail proves nothing.
A checklist of agent mistakes
The guide lists habits that autonomous agents repeat, and says each comes from a real case. Reviewers can scan for them:
- Unit tests pass, but the app is never actually run.
- Everything is green locally but red in CI.
- A type error is silenced with as any, or new types are mostly any.
- A broad try-catch block hides failures.
- A handoff keeps the decision but loses the reason for it.
- A rename misses a place where the name appears as plain text.
- Development servers are left running after the work is called finished.
Another item covers changing tools without reintroducing the API. Teams move between coding agents and editors as the market shifts, and the guide says to keep the contract stable across moves rather than rebuilding the connection each time.
Read it with the sales pitch in mind
The guide closes by pointing to Powerduck, which it describes as a local-first, OpenAPI-first workspace covering debugging, testing, mocking and agent tools. That is the guide's own product, so the advice and the pitch are intertwined.
The core ideas do not depend on that product. Autonomy should scale with how fast you can verify results. A person should stay on decisions that change the contract or touch money and sign-in security. Those are habits, not purchases.
What to watch
- Will more teams give agents live contracts through MCP servers instead of pasted documentation?
- Can 'done means a passing command in CI' become a normal rule for reviewing AI-written changes?
Try it
Next time an AI assistant says a task is done, ask for one command that proves it, run it yourself, and check that it would fail without the change.
Sources and links
- Reportingdev.to: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by dev.to · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
