Function-Level Execution Feedback for Code Preference Optimization
Source: ArXiv AI ↗
Process supervision has been shown to boost mathematical reasoning by naturally expressing intermediate steps as chains of thought, yet its application to code generation remains largely unexplored due to the absence of a standard definition of a “step.” To address this gap, researchers introduced STEP‑KTODER, a framework that treats each module‑level function within a decomposed multi‑function program as a distinct step and assigns binary correctness labels using automatically generated unit tests. By combining function‑level process supervision with outcome‑level feedback on the full program, STEP‑KTODER provides a code‑specific implementation of stepwise knowledge‑targeted optimization (KTO), enabling more precise preference learning for large language models (LLMs) tasked with coding.
Evaluations across several benchmark suites—including HumanEval(+), MBPP(+), BigCodeBench, and LiveCodeBench—demonstrate that STEP‑KTODER consistently outperforms both outcome‑only KTO and direct preference optimization (DPO). A key finding from the analysis is that execution‑based labels are crucial: when LLMs act as judges to annotate step correctness, they tend to over‑predict function failures, corrupt positive step labels, and ultimately degrade the effectiveness of downstream preference optimization. By contrast, the automatically generated unit tests used in STEP‑KTODER yield reliable binary signals that guide the model toward generating correct functional components.
The release of the STEP‑KTODER code on GitHub invites the research community to build upon this approach, potentially extending process supervision to other programming contexts and refining step definitions. The work also underscores the broader importance of accurate execution‑based feedback in training LLMs for code generation, suggesting that future systems should prioritize concrete test‑driven supervision over heuristic judgments. As the framework integrates with existing arXivLabs infrastructure, it aligns with the platform’s commitment to openness, community collaboration, and data privacy, offering a tangible avenue for further advancements in automated code synthesis.
⚡ Effects Interpreter
🌍World Economymedium impact
What this means for you
- ▶Global commerce often shrugs off small shocks, but keeps one eye open.
- ▶Cross-border money flows can subtly change direction after events like this.
🏙️Local Economylow impact
What this means for you
- ▶Everyday spending habits nearby may shift once the news sinks in.
- ▶High street footfall and spending can shift subtly after news like this.
🏦Rates & Banksmedium impact
What this means for you
- ▶Base rate decisions are usually made on data trends, not single headlines.
- ▶Savings rates can lag behind this kind of news by weeks, not days.
❤️Healthmedium impact
What this means for you
- ▶Sleep and appetite can be the first quiet casualties of unsettling news.
- ▶The strain, if any, tends to show up quietly in everyday life.
💷Wealthlow impact
What this means for you
- ▶Your overall wealth picture is unlikely to be defined by a single story like this.
- ▶Nest eggs can wobble briefly before finding their footing again.
🏠Housinglow impact
What this means for you
- ▶Buyers and renters could notice only a mild drift, if anything at all.
- ▶Anyone mid-purchase might want to keep an eye on how this unfolds.
🌍 Effects for your country
The U.S.'s central bank rate currently stands at 3.75%, so a global rates move like this could feed through to local borrowing costs. The U.S.'s economy is growing at 2.3% with inflation at 3.2%, the backdrop this story's effects play out against locally. Housing-market effects like this are usually felt most where mortgage rates track the U.S.'s own central bank rate closely. With the U.S.'s unemployment at 4.4%, personal-finance effects like this land on a labour market that is currently fairly stable. Health-system effects are harder to localise from economic indicators alone — the real impact in the U.S. depends more on local healthcare capacity than the figures above.
The UK's central bank rate currently stands at 3.75%, so a global rates move like this could feed through to local borrowing costs. The UK's economy is growing at 0.8% with inflation at 3.2%, the backdrop this story's effects play out against locally. Housing-market effects like this are usually felt most where mortgage rates track the UK's own central bank rate closely. With the UK's unemployment at 5.6%, personal-finance effects like this land on a labour market that is currently fairly stable. Health-system effects are harder to localise from economic indicators alone — the real impact in the UK depends more on local healthcare capacity than the figures above.
France's central bank rate currently stands at 2%, so a global rates move like this could feed through to local borrowing costs. France's economy is growing at 0.9% with inflation at 1.8%, the backdrop this story's effects play out against locally. Housing-market effects like this are usually felt most where mortgage rates track France's own central bank rate closely. With France's unemployment at 7.9%, personal-finance effects like this land on a labour market that is already under strain. Health-system effects are harder to localise from economic indicators alone — the real impact in France depends more on local healthcare capacity than the figures above.
Romania's central bank rate currently stands at 6.5%, so a global rates move like this could feed through to local borrowing costs. Romania's economy is growing at 0.7% with inflation at 7.8%, the backdrop this story's effects play out against locally. Housing-market effects like this are usually felt most where mortgage rates track Romania's own central bank rate closely. With Romania's unemployment at 6%, personal-finance effects like this land on a labour market that is currently fairly stable. Health-system effects are harder to localise from economic indicators alone — the real impact in Romania depends more on local healthcare capacity than the figures above.
The UAE's central bank rate currently stands at 3.65%, so a global rates move like this could feed through to local borrowing costs. The UAE's economy is growing at 3.1% with inflation at 2.5%, the backdrop this story's effects play out against locally. Housing-market effects like this are usually felt most where mortgage rates track the UAE's own central bank rate closely. Health-system effects are harder to localise from economic indicators alone — the real impact in the UAE depends more on local healthcare capacity than the figures above.