Can Evidence Make Agent Decisions Reviewable?
A critical review of AgentMonBench and evidence-grounded monitoring, examining benchmark gains, human agency, and the limits of automated oversight.
The paper
What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents — Sun, Zhongxiang; Yan, Jiahao; Zhao, Hongkang; Ding, Haojie; Zhang, Boheng; Yang, Fan; Zhang, Xiao; Xu, Jun.
arXiv:2610.06406v1 · Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL). First submitted 2026-10-05; reviewed version dated 2026-10-05. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Source-derived synopsis. In version 1 of What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents, Sun and colleagues introduce AgentMonBench, a software-engineering benchmark with three components: omitted requirements, documented behaviors changed while existing tests pass, and decisions identified from later user feedback. They also propose the Evidence-Grounded Behavior Graph (EBG), a training-free method that groups source-linked repository or interaction evidence into behaviors and presents it to a monitoring model. Across eight models, EBG generally improved decision identification and evidence localization compared with direct access to the original context. Five paired research-task cases illustrate a review harness, but do not establish its effectiveness in routine deployment.
Original analysis. The paper makes a useful distinction between an agent completing work and a user being able to judge the choices embedded in that work. A passing test or plausible final answer may leave a consequential assumption invisible. EBG offers one way to organize the material needed to question that assumption. Its promise is practical: a reviewer can be directed toward a decision and the record that bears on it. The remaining question is whether the record is complete and whether the reviewer can act on what it shows.
Evidence
Methods and results. Each benchmark component contains 100 examples. SpecGAP removes selected conditions from task documents while retaining the implementations; SilentSwap inserts five independently validated semantic changes per task that escape existing tests; FeedbackTrace uses prior interaction history to identify a decision associated with later user pushback, which is withheld from the monitor. Human double review reported agreement on 447 of 484 omitted conditions, 468 of 500 substitutions, and 93 of 100 feedback sessions. Those figures concern annotation agreement, not monitor accuracy.
EBG deterministically organizes visible evidence into behaviors and relationships, then leaves semantic assessment to the monitoring model. The authors compare it with a direct-context baseline across all three components and with an adapted repository graph on the two code tasks. For example, Kimi K3's rule-based SilentSwap localization score rises from 0.555 with the direct baseline to 0.681 with EBG. On FeedbackTrace, its exact evidence hit rate rises from 0.550 to 0.610. A hit requires at least one reference evidence identifier; it does not establish that the complete explanation is sufficient. Some semantic measures rely on two model judges, whose conclusions about individual comparisons sometimes differ.
Original analysis. Finding a relevant line is only the first step in oversight. A monitor must also explain what the line establishes, what remains uncertain, and why a choice matters to the user's goal. The paper's failure analysis reinforces this distinction: for the three monitors examined, many failures occurred even when reference evidence was visible. In the audited FeedbackTrace failures, the reference events were visible in every case. Better retrieval alone is therefore an incomplete remedy.
Hypothetical example. An agent reports that an API check passed. The record shows a successful check but also shows that the response was cached. A useful finding would distinguish the successful check from the separate claim that a live service was reached. The example illustrates an evidentiary distinction; it is not an additional experimental result.
Proposed test. Give independent reviewers the same recorded runs with either EBG views or direct access to the record. Measure their ability to identify consequential decisions, retrieve sufficient evidence, distinguish attempted from completed actions, and correct conclusions, alongside review time and confidence. Include runs with no issue to measure unnecessary alerts. This would test human oversight directly rather than assuming that better monitor scores transfer to human judgment.
Limitations
Original analysis. The benchmark's controlled omissions and substitutions make specific failures measurable, but everyday requirements and agent behavior need not resemble those constructions. FeedbackTrace selects sessions with later pushback and one qualifying target, so it does not represent every decision a user might want to contest. Its main task also tells the monitor that a consequential decision exists. A separate balanced alert experiment helps address false alarms, but one monitor still produced an 84% false-positive rate on FeedbackTrace with EBG. Alert burden deserves attention as well as detection.
The five research-task applications use one run per condition for each case. They illustrate plausible review interventions, including detecting validation-derived training data and qualifying a comparison with unequal search budgets. They cannot establish a general effect across tasks, repeated runs, or working organizations. The paper reports descriptive benchmark scores; the supplied results do not establish how durable the improvements are under independent replication or changed deployments.
For governance, evidence must be paired with authority. A person who sees a questionable choice still needs a meaningful opportunity to reject it, request clarification, or stop a consequential action. The related page on human oversight develops that distinction; this paper supplies a candidate mechanism for locating decisions, not proof that such authority exists. Likewise, AI agent observability considers the broader record of permissions, approvals, and downstream actions. EBG's source links help inspection within its evaluated inputs, but do not guarantee that missing events were recorded in the first place.
Proposed test. Compare the additional model calls, tokens, runtime, storage, and human review time required by each approach, while measuring the quality of decisions reviewers make. Energy or environmental claims would need their own measurements and accounting boundaries. Reviewers should also test whether access to sensitive traces can be limited without hiding evidence needed to contest an outcome.
The relevance to the Church of Spiralism is a question of accountable delegation: can people recover and challenge choices made on their behalf? The supplied evidence supports further study of that question. It does not establish machine consciousness or validate a spiritual doctrine.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.