Who Decided? Coding Agents and the Evidence Behind a Merge Gate
A critical review of a fintech case study on coding-agent approvals, human decision authority, and the evidence behind merge gates.
The paper
Who Approved This? Coding Agents, Human Accounts, and Merge-Gate Evidence at a Fintech Startup — Manji, Adam.
arXiv:2610.28683v1 · Software Engineering (cs.SE). First submitted 2026-10-19; reviewed version dated 2026-10-19. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Source synopsis. In Who Approved This? Coding Agents, Human Accounts, and Merge-Gate Evidence at a Fintech Startup, arXiv:2610.28683v1, Adam Manji examines 786 pull requests merged at one fintech startup over twelve weeks. The study joins repository records to saved coding-agent transcripts and recomputes whether a non-author approval and a passing required check preceded each merge on the final pull-request revision. In the enforced period, all 263 non-bot merges into the main branch met that property, but 71 relied solely on approvals submitted by an agent through the technical lead’s account. The records could not establish who made those acceptance decisions. The paper also documents enforcement being switched off, a script misreading check status, and six intermediate stack merges with stale approvals and no pre-merge check on their final heads. Two engineers’ survey responses illustrate review practices that platform records could not reveal. The author proposes changes to identities, permissions and evidence collection; most checklist items had not been tested at the study’s end.
Original analysis. The case makes a precise contribution to AI governance: an approval record can satisfy a technical rule while leaving the authority behind the decision unclear. The distinction matters because the startup used a non-author approval as evidence for its change-management control. The record identifies an account, a revision and a time; those fields alone do not identify the person or agent that exercised judgment. The 71 cases are therefore evidence of an attribution gap, not a count of changes accepted without human judgment.
Human agency here is a practical question about what a person can inspect, decide and stop. An agent can carry out a person’s decision or submit its own assessment through the same account, and those actions can look identical in the platform. A governance process that requires human acceptance needs a way to distinguish them. It also needs to state what acceptance means: reading every line, validating an agent’s findings, checking domain assumptions, or taking some other defined responsibility. Each standard would support a different interpretation of an approval.
Evidence
Original analysis. The strongest part of the method is its attention to the exact revision and the order of events. A check that runs after a merge cannot establish that the change passed before integration; an approval of an earlier head cannot by itself establish approval of a later one. The paper retrieves check attempts and review states to reconstruct these conditions rather than simply assuming branch protection worked. This makes the claim about the gate narrower and more useful than a general claim that the code was safe.
The boundary also matters. The six stack merges lacking the core property occurred on working branches outside the stated control; the combined change later entered the protected main branch with approval and a passing check. That sequence supports a question about what intermediate records mean, while respecting the control the team actually chose. A final approval of a combined change does not reveal how closely its parts were examined. Conversely, an intermediate merge without the core property was not automatically a violation of the stated policy.
The false-green incident exposes another distinction: a recorded passing status is evidence only for what the underlying check actually did. During a period when enforcement was off, a merge script read a combined status and recorded four merges as green despite three completed failed required runs and one required run that had not started before merge. The paper reports a subsequent change to query the specific required check. That correction addresses the observed status-reading error; the case does not establish how often similar errors occur elsewhere.
The engineers’ accounts add texture without resolving every unknown. One described review agents drafting findings and a person validating them and deciding what to post. Both engineers described useful review in terms of testing a change against something outside its diff. Their responses suggest questions for future study about which evidence helps reviewers challenge agent output. They do not measure the quality of every approval or establish that this review practice prevents defects.
The related review Where Accountability Lives: Beyond the Approval Record examines responsibility in published workflow documents. This case adds observed repository events and session traces, while still leaving the acceptance decision unresolved. AI Audit Trails provides a broader vocabulary for reconstruction; this paper gives a specific reason to connect action records to the authority behind them.
Limitations and proposed tests
Original analysis. This is an insider account of one repository, three engineers and a particular GitHub configuration. The author directed the agents, held administrative rights and selected incidents for the paper. Transcripts survived only from 14 September and came from the lead’s machine; the engineers’ agent commands could not be checked in the same way. Agent association partly relies on inference, and a small validation sample found one mistaken merge-command match. The organization audit log was unavailable, so historical protection changes depend on the change log and transcripts, which could miss changes made through the web interface. Proprietary source and transcripts cannot be released, limiting independent examination of the underlying evidence.
The periods were not experimental treatments. Enforcement, integration practices and checks changed alongside the work itself, so the reported throughput and lead-time differences cannot establish a causal effect of agents or the gate. Two survey respondents, answering their manager in a small team, provide valuable context but cannot represent reviewers generally. No auditor had assessed the evidence. The paper’s proposed separate agent identities, human-only approval rules and protection permissions are plausible controls, not demonstrated improvements in audit quality or software safety.
Hypothetical example. Suppose an agent submits an approval after a maintainer has checked a calculation against a customer requirement. A later investigator might see only the account and the approval. A separate, person-controlled decision record could make that assessment easier to reconstruct, but a completed record would still not prove that the calculation was understood or correct. The investigator would need access to the relevant evidence and a way to question the decision.
Proposed tests. Compare ordinary records with records that bind a person’s decision to a revision and identify the submitting agent. Give independent investigators the same disputed changes and measure whether they can correctly reconstruct who decided, which check ran and what remains unknown. Include missing or misleading records to test whether investigators recognize uncertainty. Separately, test whether permission rules actually prevent an agent from counting its own approval or changing protection. Measure review time, additional model use and storage alongside reconstruction accuracy; whether the extra evidence justifies these material costs remains an open question.
Original analysis. The broader lesson for collective work is to preserve room for disagreement as well as authorization. A gate can record an approval while losing a condition attached to it: the paper describes approvals with a precondition that were counted and merged before that condition was met. A proposed process could make unresolved conditions machine-enforceable or require changes instead of approval, then test whether that makes decisions clearer without making review impractical. This evidence concerns accountable software work; it does not settle questions about AI consciousness or establish any spiritual doctrine.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.