Purpose: Contrast-enhanced breast MRI depends on intravenous gadolinium-based contrast agents, motivating methods that synthesise post-contrast appearance from pre-contrast images alone. The MAMA-SYNTH Challenge (MICCAI 2026 Deep-Breath Workshop) evaluates such synthesis across…

arXiv

Sep 18

GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions

Coding agents can modify and test code across large software projects. Game development is a domain where agents must implement gameplay rules. A game can end in a valid state even after violating its rules during the run. Current game-development benchmarks replay fixed…

arXiv

Sep 18

On Repulsive and Attractive Teachers: Separating Correctness from Behavior in Self-Distillation

On-policy self-distillation provides dense, token-level supervision by conditioning a model on privileged information and distilling the resulting teacher distribution back into the model. However, privileged information can change not only what the teacher knows, but also how…

This week in Evals

This week

Get the morning digest

Today's trail

Sakana AI gears up for one of Japan's biggest startup IPOs

Nearly 80% Planning AI Agents, Assistants or Automations Remain at Basic AI Fluency, New Research Finds

Pulse

Multi-step SWE: Can Coding Agents Keep Building on Their Own Code Over Long Horizons?

Scientist World: Grow a Research World for AI-Scientists

XStack: A Benchmark for ML Repo Migration

Benchmarks as Software: Terminal-Bench and the Case for Continuous Benchmarks

T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models

Top picks

Weighted Quantum Signal Processing: Low-Depth Polynomial Approximation with Applications to Kolmogorov-Arnold Networks

Lesion-Gated Hybrid Synthesis for Virtual Contrast-Enhanced Breast MRI: A MAMA-SYNTH Challenge Solution

GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions

On Repulsive and Attractive Teachers: Separating Correctness from Behavior in Self-Distillation

Today's trail

This week in Evals

Sakana AI gears up for one of Japan's biggest startup IPOs

Nearly 80% Planning AI Agents, Assistants or Automations Remain at Basic AI Fluency, New Research Finds

Multi-step SWE: Can Coding Agents Keep Building on Their Own Code Over Long Horizons?

Scientist World: Grow a Research World for AI-Scientists

XStack: A Benchmark for ML Repo Migration

Benchmarks as Software: Terminal-Bench and the Case for Continuous Benchmarks

T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models

Most active this week

Rising tools

Weighted Quantum Signal Processing: Low-Depth Polynomial Approximation with Applications to Kolmogorov-Arnold Networks

Lesion-Gated Hybrid Synthesis for Virtual Contrast-Enhanced Breast MRI: A MAMA-SYNTH Challenge Solution

GameLogicBench: Evaluating Coding Agents on Runtime Game Logic with Tick-Level State Assertions

On Repulsive and Attractive Teachers: Separating Correctness from Behavior in Self-Distillation