Papers

Field

Top tools here

All tools

Agno5 releases this week
FastMCP6 releases this week
Pydantic AI+17% downloads · 1.5M/wk+17.0%
n8n+25% downloads · 148.3k/wk+25.0%
smolagents+19% downloads · 125.9k/wk+18.7%

Top tools here

Open problems in Agents

Long-horizon task execution and memory3 papers raise it · 3 address it
Agents fail to retain, retrieve, and use past information over long interactions, limiting real-world deployment.
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversationsraises
- Scaling Agentic Data for Long-Horizon Terminal Intelligenceraises · addresses
- Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?raises · addresses
- Agent-Reflex: Teaching Language Agents to Act Reflectivelyaddresses
Real-world task ambiguity and unstated constraints3 papers raise it · 2 address it
Agents struggle with ambiguous, incomplete, or evolving requirements in live systems, unlike controlled benchmarks.
- OR-License: Evaluating LLM Agents as Real-World Operations Research Practitionersraises · addresses
- FDE-Gym: The Last Mile of AI Deliveryraises · addresses
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?raises
Faithful agent development from requirements1 paper raises it · 1 addresses it
Coding agents often produce systems that appear correct but fail to meet the actual requirements.
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?raises · addresses
Sequential distraction in multimodal GUI agents1 paper raises it · 1 addresses it
Omni-modal inputs cause agents to focus on irrelevant signals, leading to compounding errors.
- Focused Omni-Modal GUI Agentsraises · addresses
Open, reproducible agent stacks and evaluation1 paper raises it · 1 addresses it
Closed systems and lack of open benchmarks hinder systematic study and improvement of agent designs.
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer Useraises · addresses

Named by an AI from these papers' abstracts.

Open problems

Recently funded

Market

FirstWorkSeries A · Oct 21$15M
Asymptote LabsSeed · Oct 20$5.5M
LumilabPre-seed · Oct 20undisclosed
GreptileSeries B+ · Oct 19$50M
VesslaPre-seed · Oct 19$3.3M

Recently funded

Topics in this field

coding agents · code generation · coding agent303 papers89 this week
skills · tasks · ai315 papers60 this week
recursive self improvement · harness evolution · adaptive271 papers50 this week
tool using agents · agent systems · multi agent216 papers45 this week
ai agents · indirect prompt injection · adversarial319 papers42 this week
agent · agentic · llm agents172 papers42 this week

Topics in this field

Active contributors · 90 days

Active contributors

Activity · 12 weeks

Activity

Recent papers

All papers in Research

arXiv cs.AIOct 14
SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills
Enze Ma, Chunyu Miao, Yankai Chen, Jie Yang, Liancheng Fang +12
Agent skills turn procedural knowledge into reusable artifacts, allowing LLM agents to accumulate and refine expertise through experience. Building on this, skill evolution iteratively improves skills using execution feedback. However, improvement may require several interdependent edits, so low-reward versions can still be worth developing. Requiring immediate reward gains can discard useful partial repairs before their benefits emerge. Non-elitist evolution allows new versions to receive further edits despite scoring below earlier ones. For agent skills, this calls for evidence of what to preserve and repair next. We introduce SkillNEO (Non-Elitist Evolutionary Optimization for Agent Skills), which separately selects a version to use and versions to keep improving. Comparing how related versions perform the same task reveals working steps to preserve and remaining failures to fix. It can also revisit and revise earlier versions using later evidence. Across 86 SkillsBench tasks in eight domains, including software engineering and office work, SkillNEO raises GPT-5.4 Mini's average reward from 49.1% to 66.4%, within GPT-5.5 and GPT-5.6 Luna's original-skill range. Mini executes…
PDF arXiv
arXiv cs.AIOct 14
A Multi-Tiered AI Accessibility Model (MAIAM): Proportionate Access and Capability Limits for Comprehensive Frontier AI Safety
Chai K. Toh, Vasu Raj Jain
Most debate about releasing capable AI systems treats the choice as binary: keep the model behind an API, or publish the weights. That framing runs together two separate decisions. One is how capable a system may become. The other is who may obtain a given capability, and on what terms. This paper is about the second decision. We propose a Multi-Tiered AI Accessibility Model (MAIAM) that sorts access by purpose, safety, and capability instead of by release artifact. Tier 1, AI for Learning, is broadly accessible and deliberately capability-bounded. Tier 2, AI for Exploration, serves research and development under registration, identity, and usage controls that tighten as capability rises. Tier 3, Full-Scale Frontier AI, is available only through structured, recorded, and accountable access. The principle behind the tiers is that accessibility should be proportional to capability, safety, and risk. We show why publishing frontier-class weights forfeits every safety lever a developer has after release, and, using evidence that safety fine-tuning can be stripped from open weights for a few hundred dollars, why an evaluation of the base model says little about its derivatives. We…
PDF arXiv
arXiv cs.AIOct 14
Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents
Yujie Feng, Xiaobin Wang, Jinluan Yang, Xiaonan Shi, Pengjun Xie +3
Skill-policy co-evolution, in which an agent's policy model and its skill bank improve each other during training, is a promising paradigm for self-improving agents. Current evaluations score the co-evolved policy on the final bank it trained with (the delivered bank). After deployment, however, skills may be rewritten, added or removed more frequently than the policy model is retrained, leaving the policy to operate on a drifted skill bank that neither the training objective nor existing evaluation protocols address. In this paper, we first establish, through theoretical and empirical analysis, that the fragility hidden by this blind spot is not incidental. The acceptance rule these methods share (cooperative acceptance) ties a policy's competence to the bank it co-evolved with, leaving it fragile once skills drift, regardless of the implementation; empirically, sensitivity to skill drift grows as co-evolution training proceeds. We therefore introduce the CO-evolution Drift Audit (CODA), a deployment-oriented evaluation protocol that simulates skill drift and, alongside success rate under worst-case drift, introduces two new metrics: a consistency rate under meaning-preserving…
PDF arXiv
arXiv cs.AIOct 14
A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering
Yun-Shiuan Chuang, Yirou Ge, Yixi Li, Yiming Bian, Zijie Pan +4
A self-improving agent has to decide which new skills to keep, and in practice it keeps whatever earns a high reward, convinces a judge model, or compresses its library, even when the skill is wrong. That is fine until the answers have to be exactly right: over a table of transactions, a total is either right or wrong. We ask a harder question: can an agent grow what it can compute with no reward, no judge, and no answer key, and still be exactly right? A single frozen model runs two nested loops over a small, exact domain-specific language (DSL). The inner loop answers new questions only when two independently written expressions agree on every record. The outer loop discovers its own missing capability and authors an operator for it, admitted only when an independent second implementation agrees and the result obeys a conservation law, all without ground truth. The inner loop roughly triples the answerable-question set, and the outer loop self-extends on disjoint starting sets, inventing operators outside the starting closure; a no-induction control answers none of the new questions. The admission rule is empirically sound: it rejects 138 of 138 buggy operator variants under an…
PDF arXiv
arXiv cs.CLOct 14
PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models
Giovana Kerche Bonás, Thales Sales Almeida, Marcelo da Silva Reis, Rodrigo Nogueira, Marcos Meideiros Raimundo
Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation interventions across precision, languages, and scales. Our findings demonstrate that leveraging lower-resource settings (specifically quantized NF4 labels and cross-lingual transfer) offers a robust pathway to expose and improve model alignment. Notably, using behavioral labels from an NF4 copy enables stable intervention estimation even with very few scenarios. Furthermore, these alignment improvements transfer effectively across languages: five-language NF4-supervised directions successfully transfer to held-out Arabic, reducing unsafe violations in Llama-3.1-8B by 21.95 percentage points without target-language tuning. By mapping paired benign activations, we also successfully transfer these safety interventions to much larger models (up to 70B parameters). Ultimately, PRISM highlights how auxiliary supervision from compressed models and multilingual data can uncover and mitigate hazardous tool-calling behaviors across different model families. We release all…
PDF arXiv
arXiv cs.SEOct 14
Robotic-supported Data Loss Detection in Android Applications
Davi Freitas, Breno Miranda, Juliano Iyoda
Smartphones have become integral to modern life due to their diverse applications. However, the development of applications for these devices faces significant challenges, primarily due to two factors: (i) the diverse hardware and operating system versions that require testing across multiple configurations; and (ii) the imperative activity of testing the smartphone in a non-invasive way (similar to an end-user interaction), which is expensive, tedious and error-prone as it is usually carried out manually. In this context, robotic automation has emerged as an effective solution for addressing the diversity of smartphone systems and versions, and in performing some testing tasks non-invasively. In addition, automated robots facilitate quick, accurate, and repetitive testing, thus enabling developers to validate their applications across various configurations effectively. This results in a less invasive verification and in a significant reduction in time spent on manual testing, thus accelerating the development cycle. Our work proposes R-DLD (Robotic-supported Data Loss Detection), a robot-assisted infrastructure for data loss detection in Android applications, offeringless…
PDF arXiv

Papers

Recently funded

Market

FirstWorkSeries A · Oct 21$15M
Asymptote LabsSeed · Oct 20$5.5M
LumilabPre-seed · Oct 20undisclosed
GreptileSeries B+ · Oct 19$50M
VesslaPre-seed · Oct 19$3.3M

Top tools here

All tools

Agno5 releases this week
FastMCP6 releases this week
Pydantic AI+17% downloads · 1.5M/wk+17.0%
n8n+25% downloads · 148.3k/wk+25.0%
smolagents+19% downloads · 125.9k/wk+18.7%

Topics in this field

coding agents · code generation · coding agent303 papers89 this week
skills · tasks · ai315 papers60 this week
recursive self improvement · harness evolution · adaptive271 papers50 this week
tool using agents · agent systems · multi agent216 papers45 this week
ai agents · indirect prompt injection · adversarial319 papers42 this week
agent · agentic · llm agents172 papers42 this week

Activity · 12 weeks

Active contributors · 90 days

Open problems in Agents

Long-horizon task execution and memory3 papers raise it · 3 address it
Agents fail to retain, retrieve, and use past information over long interactions, limiting real-world deployment.
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversationsraises
- Scaling Agentic Data for Long-Horizon Terminal Intelligenceraises · addresses
- Learn2Play Bench: How Well Do LLM Agents Learn from Experience in Unfamiliar Environments?raises · addresses
- Agent-Reflex: Teaching Language Agents to Act Reflectivelyaddresses
Real-world task ambiguity and unstated constraints3 papers raise it · 2 address it
Agents struggle with ambiguous, incomplete, or evolving requirements in live systems, unlike controlled benchmarks.
- OR-License: Evaluating LLM Agents as Real-World Operations Research Practitionersraises · addresses
- FDE-Gym: The Last Mile of AI Deliveryraises · addresses
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?raises
Faithful agent development from requirements1 paper raises it · 1 addresses it
Coding agents often produce systems that appear correct but fail to meet the actual requirements.
- AgentSWE: Can Coding Agents Build the Agent You Actually Want?raises · addresses
Sequential distraction in multimodal GUI agents1 paper raises it · 1 addresses it
Omni-modal inputs cause agents to focus on irrelevant signals, leading to compounding errors.
- Focused Omni-Modal GUI Agentsraises · addresses
Open, reproducible agent stacks and evaluation1 paper raises it · 1 addresses it
Closed systems and lack of open benchmarks hinder systematic study and improvement of agent designs.
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer Useraises · addresses

Named by an AI from these papers' abstracts.

Recent papers

All papers in Research

arXiv cs.AIOct 14
SkillNEO: Non-Elitist Evolutionary Optimization of Agent Skills
Enze Ma, Chunyu Miao, Yankai Chen, Jie Yang, Liancheng Fang +12
Agent skills turn procedural knowledge into reusable artifacts, allowing LLM agents to accumulate and refine expertise through experience. Building on this, skill evolution iteratively improves skills using execution feedback. However, improvement may require several interdependent edits, so low-reward versions can still be worth developing. Requiring immediate reward gains can discard useful partial repairs before their benefits emerge. Non-elitist evolution allows new versions to receive further edits despite scoring below earlier ones. For agent skills, this calls for evidence of what to preserve and repair next. We introduce SkillNEO (Non-Elitist Evolutionary Optimization for Agent Skills), which separately selects a version to use and versions to keep improving. Comparing how related versions perform the same task reveals working steps to preserve and remaining failures to fix. It can also revisit and revise earlier versions using later evidence. Across 86 SkillsBench tasks in eight domains, including software engineering and office work, SkillNEO raises GPT-5.4 Mini's average reward from 49.1% to 66.4%, within GPT-5.5 and GPT-5.6 Luna's original-skill range. Mini executes…
PDF arXiv
arXiv cs.AIOct 14
A Multi-Tiered AI Accessibility Model (MAIAM): Proportionate Access and Capability Limits for Comprehensive Frontier AI Safety
Chai K. Toh, Vasu Raj Jain
Most debate about releasing capable AI systems treats the choice as binary: keep the model behind an API, or publish the weights. That framing runs together two separate decisions. One is how capable a system may become. The other is who may obtain a given capability, and on what terms. This paper is about the second decision. We propose a Multi-Tiered AI Accessibility Model (MAIAM) that sorts access by purpose, safety, and capability instead of by release artifact. Tier 1, AI for Learning, is broadly accessible and deliberately capability-bounded. Tier 2, AI for Exploration, serves research and development under registration, identity, and usage controls that tighten as capability rises. Tier 3, Full-Scale Frontier AI, is available only through structured, recorded, and accountable access. The principle behind the tiers is that accessibility should be proportional to capability, safety, and risk. We show why publishing frontier-class weights forfeits every safety lever a developer has after release, and, using evidence that safety fine-tuning can be stripped from open weights for a few hundred dollars, why an evaluation of the base model says little about its derivatives. We…
PDF arXiv
arXiv cs.AIOct 14
Evolving Together, Failing Apart: The Skill-Policy Co-evolution Trap in Self-Improving Agents
Yujie Feng, Xiaobin Wang, Jinluan Yang, Xiaonan Shi, Pengjun Xie +3
Skill-policy co-evolution, in which an agent's policy model and its skill bank improve each other during training, is a promising paradigm for self-improving agents. Current evaluations score the co-evolved policy on the final bank it trained with (the delivered bank). After deployment, however, skills may be rewritten, added or removed more frequently than the policy model is retrained, leaving the policy to operate on a drifted skill bank that neither the training objective nor existing evaluation protocols address. In this paper, we first establish, through theoretical and empirical analysis, that the fragility hidden by this blind spot is not incidental. The acceptance rule these methods share (cooperative acceptance) ties a policy's competence to the bank it co-evolved with, leaving it fragile once skills drift, regardless of the implementation; empirically, sensitivity to skill drift grows as co-evolution training proceeds. We therefore introduce the CO-evolution Drift Audit (CODA), a deployment-oriented evaluation protocol that simulates skill drift and, alongside success rate under worst-case drift, introduces two new metrics: a consistency rate under meaning-preserving…
PDF arXiv
arXiv cs.AIOct 14
A Self-Improving Agent that Grows its Own DSL: Oracle-Free Operator Induction for Exact Question Answering
Yun-Shiuan Chuang, Yirou Ge, Yixi Li, Yiming Bian, Zijie Pan +4
A self-improving agent has to decide which new skills to keep, and in practice it keeps whatever earns a high reward, convinces a judge model, or compresses its library, even when the skill is wrong. That is fine until the answers have to be exactly right: over a table of transactions, a total is either right or wrong. We ask a harder question: can an agent grow what it can compute with no reward, no judge, and no answer key, and still be exactly right? A single frozen model runs two nested loops over a small, exact domain-specific language (DSL). The inner loop answers new questions only when two independently written expressions agree on every record. The outer loop discovers its own missing capability and authors an operator for it, admitted only when an independent second implementation agrees and the result obeys a conservation law, all without ground truth. The inner loop roughly triples the answerable-question set, and the outer loop self-extends on disjoint starting sets, inventing operators outside the starting closure; a no-induction control answers none of the new questions. The admission rule is empirically sound: it rejects 138 of 138 buggy operator variants under an…
PDF arXiv
arXiv cs.CLOct 14
PRISM: Transfer and Limits of Activation Interventions in Tool-Calling Language Models
Giovana Kerche Bonás, Thales Sales Almeida, Marcelo da Silva Reis, Rodrigo Nogueira, Marcos Meideiros Raimundo
Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation interventions across precision, languages, and scales. Our findings demonstrate that leveraging lower-resource settings (specifically quantized NF4 labels and cross-lingual transfer) offers a robust pathway to expose and improve model alignment. Notably, using behavioral labels from an NF4 copy enables stable intervention estimation even with very few scenarios. Furthermore, these alignment improvements transfer effectively across languages: five-language NF4-supervised directions successfully transfer to held-out Arabic, reducing unsafe violations in Llama-3.1-8B by 21.95 percentage points without target-language tuning. By mapping paired benign activations, we also successfully transfer these safety interventions to much larger models (up to 70B parameters). Ultimately, PRISM highlights how auxiliary supervision from compressed models and multilingual data can uncover and mitigate hazardous tool-calling behaviors across different model families. We release all…
PDF arXiv
arXiv cs.SEOct 14
Robotic-supported Data Loss Detection in Android Applications
Davi Freitas, Breno Miranda, Juliano Iyoda
Smartphones have become integral to modern life due to their diverse applications. However, the development of applications for these devices faces significant challenges, primarily due to two factors: (i) the diverse hardware and operating system versions that require testing across multiple configurations; and (ii) the imperative activity of testing the smartphone in a non-invasive way (similar to an end-user interaction), which is expensive, tedious and error-prone as it is usually carried out manually. In this context, robotic automation has emerged as an effective solution for addressing the diversity of smartphone systems and versions, and in performing some testing tasks non-invasively. In addition, automated robots facilitate quick, accurate, and repetitive testing, thus enabling developers to validate their applications across various configurations effectively. This results in a less invasive verification and in a significant reduction in time spent on manual testing, thus accelerating the development cycle. Our work proposes R-DLD (Robotic-supported Data Loss Detection), a robot-assisted infrastructure for data loss detection in Android applications, offeringless…
PDF arXiv

Fields · AI · updated 14m ago

Agents

LLM agents: planning, tool use, multi-agent systems, computer/web agents and agent benchmarks.

547papers this week−1.1% vs last week

All papers · 2.6k With code · 122

Newest Most relevant

2.4k papers this month