Do Coding Agents Follow AGENTS.md? The Effect of Policy Wording on Instruction Compliance
Coding agents do not always follow the policies in an Agent Context File (ACF). We inserted one policy, in four styles, into the ACFs of 86 benchmark tasks across four harness-model combinations. Conditional phrasing was followed less often than Prescriptive and Explanatory. The better of those two varied by combination.
Effect of policy wording on coding agent instruction compliance
- arXiv
- 2611.04367
- Authors
- Rikuto Tsuchida, Youmei Fan, Kazumasa Shimari, Raula Gaikovina Kula, Kenichi Matsumoto
- Categories
- cs.SE