SI Agent News
DevelopingOpen modelsAgentsResearch

A new agent method, DPDM, reports higher decision accuracy across 50 benchmarks

A paper says a frozen language model plus a separate prediction module helps AI agents choose better, but the coverage is thin and untested by outsiders.

6.12%reported mean accuracy gain across 50 benchmarks

The short version

Why it matters

Agents that pick the wrong tool or step waste time and money, so cheap ways to improve their judgment are valuable. A method that needs no retraining would be easy to adopt if the results hold. For now, it is a claim from the authors, not a verified result.

What the researchers say they built

A research team led by Lang Mo has proposed a design called Decoupled Predictive Decision Making, or DPDM. As Blockchain News reported, the paper is on arXiv, the open site where researchers post studies before formal peer review. The article also notes that it drew 81 upvotes on HuggingFace Daily Papers, a community list of popular AI papers.

The goal is to help an AI agent make better calls, such as judging whether a tool was used correctly, picking between candidate answers, or deciding if a reasoning step holds up. The twist is that the method does this without changing the underlying model's internal settings, which engineers call parameters.

How the two-part design works

The name says what is going on: the job is decoupled, or split, into two pieces. The first piece is a language model whose settings are frozen, meaning they are locked and never retrained. It reads the current situation and the history of past events and turns them into a numerical summary of their meaning. In the paper's tests, one such model was Qwen3.5-27B.

The second piece is a conditional predictor: a general-purpose model that, given that evidence, predicts an answer for the task at hand. "Conditional" simply means the prediction depends on the evidence shown to it. This predictor was pretrained on structured data, such as tables, so it brings a different kind of skill than a language model does.

The authors' argument is that language pretraining supplies knowledge about meaning, while structured-data pretraining supplies habits of drawing conclusions from examples. DPDM tries to use both. New evidence from deployment, the real-world record of what happened, can be fed in without retraining anything.

The reported results

Across 50 benchmarks, the setup with Qwen3.5-27B reached a mean accuracy of 84.92% under the history budgets the authors evaluated. The comparison point was few-shot prompting, where a model is shown a handful of worked examples in its prompt. That approach scored 78.80%, which accounts for the headline 6.12% gain. With identical histories and queries given to the methods, DPDM reached 82.33%.

The larger jumps came on tool-use tests. On ToolPRMBench, a set of tests for judging tool-using steps, the authors report absolute gains of 34.26% on the BFCL tasks and 28.87% on ToolSandbox. Separately, they report a 14.51% improvement in mean balanced accuracy on five tasks that assess reasoning steps. Balanced accuracy averages performance across categories, so a model cannot look good just by favoring the most common answer. That result covers four different encoders and histories that were lopsided between categories.

Why to hold off on excitement

Several cautions apply. The coverage comes from a single, low-reliability outlet that largely restates the paper's own claims. Our earlier briefing flagged it as a claim to file, not act on, and nothing here changes that.

The article also leaves out details that matter. It does not explain which tasks make up the 50 benchmarks, how large the histories were, or whether the baselines were tuned as carefully as the new method. The gap between 84.92% and 82.33% shows that how the comparison is set up changes the headline figure. And the article does not mention any outside group repeating the experiments.

Even so, the idea is worth tracking. Keeping the language model frozen and improving decisions by supplying evidence is a cheap route if it holds up. It could let teams adjust agent behavior as they gather real usage data, without the cost of retraining.

What to watch

Try it

When you see an accuracy claim, ask three things: what was the baseline, which tasks were tested, and has anyone outside the authors repeated it? Try that on this paper's arXiv page.

Sources and links

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

Listen to the AI Wire headlines

Listen to the AI Wire

Listen to our daily AI shows every morning: on your commute, in the shower, wherever you are

Listen to the daily shows

First reported by Blockchain News · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

More AI news