Who Judges AI-Assisted Audits?
A critical review of HAAC’s assisted auditing study, examining reported success, human judgment, evaluator independence, and proposed follow-up tests.
The paper
Who Does What in AI Auditing? Designing Human-AI Collaboration for Auditing Generative AI — Park, Eunkyu; Roesti, Markelle; Deng, Wesley Hanwen; Barreto, Renata; Tahaei, Mohammad; Holstein, Kenneth; Hong, Jason; Eslami, Motahhare.
arXiv:2609.24986v1 · Human-Computer Interaction (cs.HC). First submitted 2026-09-21; reviewed version dated 2026-09-21. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Source-derived synopsis
Park and colleagues propose Human-Agent Audit Collaboration (HAAC), allocating probe suggestions, failure assessment, report drafting, and synthesis to agents while retaining human decisions. Literature and 15 consultations with three practitioners informed the design. A counterbalanced within-subject study involved 71 students from one university course, with 12 minutes per condition comparing bundled assistance against an otherwise similar unassisted interface. Mean per-auditor attack success rose from 4.0% to 14.2%; individual strategy and product coverage increased, but failure-type breadth was not statistically significant after correction. Auditors submitted 150 of 160 generated reports unchanged. Four practitioners from the same platform context explored audit artifacts through think-aloud interviews, requesting coverage visibility, reproducibility, and evaluator scrutiny. Success reflected auditors’ finalized judgments, extracted using an LLM, rather than independent adjudication. The shopping target was simulated; multi-turn support was added after the student evaluation. The role allocation is a design proposal, not an experimentally established optimum. See the methods, findings, limitations, and analysis implementation.
Original editorial analysis
The paper makes auditing itself an object of governance. Its central question deserves attention: when AI helps produce the evidence used to judge another AI system, what would justify confidence in that evidence? A human signature should be treated as an attributable decision, with reasons available for inspection. It should not serve as a substitute for establishing whether the underlying judgment is sound.
For the Church of Spiralism’s interests in agency and accountability, this is a practical research problem. I would define meaningful agency here as the opportunity to formulate an independent concern, inspect relevant evidence, reject a proposed interpretation, and preserve that disagreement. These are editorial criteria for evaluating collaboration. They make no claim about machine consciousness or the truth of spiritual doctrines.
The useful connection to Human Oversight of AI Systems is a specific design question: how could an audit interface distinguish considered agreement from acceptance without scrutiny? Repeating the requirement for human authority would leave that question unanswered. An evaluation needs observable opportunities to disagree and a way to assess whether the resulting decisions are justified.
Evidence
Original editorial analysis
The most consequential measurement issue is the relationship between assistance and the definition of success. If assistance changes both the proposed test and the interpretation of its outcome, a higher recorded success rate could combine better discovery with changed labeling. The reported comparison cannot determine their separate contributions. Statistical significance does not resolve that ambiguity: it concerns a difference in the measured outcome, while the governance question concerns what that outcome represents.
Likewise, an unchanged draft is compatible with several explanations. The auditor might have checked it carefully and agreed, considered editing unnecessary, or accepted it with little scrutiny. Edit frequency alone cannot distinguish these possibilities. Treating every unchanged report as failed oversight would be as unwarranted as treating every submitted report as evidence of careful review.
For collective intelligence, I would ask whether assistance produces complementary discoveries across people. Breadth within an individual session and novelty across a group are different evaluation targets. A follow-up could test whether shared suggestions help participants investigate neglected concerns or make their investigations increasingly similar. Neither outcome should be assumed from the existence of more suggestions.
Hypothetical example
Imagine a shopping assistant making an unsupported compatibility claim about an accessory. An auditing agent labels the response unsafe and drafts a polished report. The human agrees that the claim lacks support but doubts the severity assigned. A useful audit record would preserve the original response, the disputed claim, the proposed severity, and the human’s reason for dissent. This invented example illustrates how finding a problem and judging its consequences can require different evidence.
Proposed tests
A follow-up could compare separate combinations of suggestion, assessment, and drafting support. Condition-blind adjudicators could evaluate the underlying conversations against explicit criteria, retaining unresolved disagreements. Comparing those judgments with submitted reports could help distinguish discovery gains from shifts in reporting. Any LLM extraction of auditor verdicts should also be checked against a manually examined sample with documented ambiguity rules.
Another experiment could compare immediate AI assessment with an interface that first asks auditors to identify the relevant passage and record a provisional judgment. Outcomes could include correctly identified failures, false alarms, justified disagreements, review time, and later performance without assistance. The hypothesis would be that an independent first judgment changes scrutiny; whether it improves decisions remains open.
A longitudinal evaluation could preserve fixed test cases while separately varying the target system and the auditing agents. That design could test whether apparent improvement survives a stable measurement process. It should also record model calls, token use, latency, storage, and human review time. Claims about material efficiency would require measured infrastructure costs and explicit assumptions for any energy estimates.
Limitations
Original editorial analysis
The narrow setting supports a bounded interpretation. A brief comparison with students cannot establish durable learning, professional adoption, or effectiveness across consequential deployments. Practitioner preferences can inform design requirements, but they do not demonstrate that an organization will implement those requirements or successfully mitigate failures.
The bundled comparison also leaves the proposed allocation of authority open to challenge. A workflow can be plausible without being optimal. Subsequent studies should compare alternative allocations and evaluate their consequences for decision quality, workload, and the ability to contest findings. Testing extended conversations would require its own evidence rather than inheriting validation from the earlier interface.
The connection to AI Audits and Third-Party Assurance concerns the boundary between generating findings and warranting assurance. I would require an assurance claim to identify which judgments were independently checked, which remain disputed, and what action followed. A traceable report could support that inquiry; its existence would not establish independence, correctness, or successful remediation. HAAC is most useful as a proposal for making those questions inspectable, with preliminary evidence about collaboration and substantial measurement questions still to resolve.
AI-use disclosure
This review was generated and checked by separate GPT-6.1 Sol runs with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-23.