A two-step method helps AI agents turn spoken requests into goals a planner can run
A new arXiv paper has an AI model draft several candidate goals, then pick the best, to cut errors early in robot-style task planning.
The short version
- The task is turning a plain-English instruction into a formal goal a planner can execute.
- Step one fine-tunes a language model to write goals in the benchmark's required format.
- Step two, called CORE, learns to prefer good outputs by studying the model's own alternative answers.
- Tested on household scenes of the Embodied Agent Interface Benchmark with DeepSeek and Qwen models.
- The abstract claims wins over three baselines but gives no numbers, so the size of the gain is unknown.
Why it matters
Any agent that acts on your behalf, in a house or on a screen, can fail if it misreads the request at the very first step. This paper treats that first step as its own problem and shows a way to reduce misreads. The habit of drafting options before choosing is one you can use with everyday AI tools.
The step before the robot moves
An embodied agent is an AI system that acts in a physical or simulated space, such as a household robot or a virtual helper in a simulated home. Before it can act, it has to understand what you want. A new paper on arxiv.org, titled "Generate-then-Rank," focuses on that moment of understanding.
The researchers call it goal interpretation: converting a natural-language instruction into a formal, symbolic goal. "Symbolic" here means a precise, structured statement a computer can check, rather than loose human wording. A planner, the software that works out the steps to reach a goal, can then execute it.
The authors argue this step is critical because a mistake here carries into every later planning and action step. If the goal is wrong, a perfect plan still produces the wrong result.
Draft several answers, then choose
The method has two stages. First, the team uses supervised fine-tuning, which means further training a language model on worked examples. Here it teaches the model to write goals in the exact output format used by the Embodied Agent Interface (EAI), the framework the paper builds on.
Second comes a technique the authors call Candidate-Output Ranking from Errors, or CORE. The model produces several alternative outputs of its own. CORE then learns preferences over complete outputs, meaning it learns which whole answers are better than others, using the model's own mistakes and near-misses as teaching material.
The authors frame this as two jobs that both matter: producing good candidates, and reliably selecting among them. A model that writes one answer has no second chance. A model that writes several and has a trained judge can catch some of its own slips.
As an illustration of the idea, not an example from the paper: a request like "put the cup in the sink" might yield several slightly different formal statements, and only one captures exactly what you meant.
What was tested, and what was claimed
The experiments used the household scenes of the Embodied Agent Interface Benchmark, a standard test set for this kind of task. A benchmark is a shared set of problems that lets different methods be compared fairly.
The paper evaluated several open-source language models: DeepSeek-V3 chat, DeepSeek-Reasoner, Qwen2.5-7B and Qwen2.5-72B. The 7B and 72B labels refer to model size, so the test spans a smaller and a much larger model.
According to the abstract, the proposed method outperformed three kinds of baseline. These were language models given simple prompting, models told to reason step by step (called chain-of-thought), and approaches built on a knowledge graph, a structured map of facts and relationships.
One caution. Our source is the abstract alone, and it states the win without any figures. We cannot say how large the improvement was, how consistent it was across models, or how it holds up outside household scenes. It is also a preprint, meaning it has not been through formal peer review.
Why a narrow result can still be useful
This is niche work, and most readers will never run this system. The reason to care is the pattern. Many AI failures start with a quiet misreading of the request, and the damage shows up later, when it is harder to trace.
Generating options and then judging them is a general idea that works beyond robots. It also gives students a clear example of a research question defined narrowly enough to test: not "make agents smarter" but "make the first translation step more reliable."
It also fits a wider trend in the open-model world. The paper tests freely available models such as DeepSeek and Qwen rather than a single closed system, which suggests the technique is meant to be applied to models that others can download and adapt.
What to look for next
The key questions are practical. Do the gains hold on tasks outside household scenes? How much extra computing does generating and ranking several candidates cost compared with answering once? And does the ranking stage keep working when instructions are vague or contradictory?
Until the full paper's tables are checked, the fair reading is that this is a promising approach with a stated advantage over common baselines, not a proven fix for agent misunderstanding.
What to watch
- How large the gains over the baselines are in the full paper's results tables.
- Whether the approach works beyond household scenes and costs little extra compute.
- Whether the authors release code or models so others can test it.
Try it
Before an AI assistant does something with real consequences, ask it to list two or three possible readings of your request and pick one for you to confirm.
Sources and links
- Reportingarxiv.org: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by arxiv.org · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
