Agentic Teammates and Human Agency at Work
A critical review of an in situ study of a proactive workplace AI agent, examining human agency, consent, accountability, and the evidence needed to test proposed safeguards.
The paper
Working with Agentic `Teammates': When a New Organizational Actor Collides with the Human Ecosystem of Work — Qadri, Rida; Denton, Remi; Madaio, Michael; Pushkarna, Mahima; Lai, Leslie; Moore, Sherry; Huebscher, Michelle Chen; Butcher, Andrew; Sen, Ritom; Tung, Hsiao-Yu; Mathur, Shaan; Liu, Yimeng; Mourad, Shibl; Fiedel, Noah; Grefenstette, Edward; Terry, Michael.
arXiv:2609.29901v1 · Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI). First submitted 2026-09-24; reviewed version dated 2026-09-24. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Source-derived synopsis. Qadri and colleagues’ arXiv manuscript, version 1, studies a persistent, proactive AI agent embedded in teams at one large technology company. The agent was deployed across more than 20 teams over five months. Researchers interviewed 17 users from 11 teams and analyzed the interviews using reflexive thematic analysis. Participants described both useful assistance and disruptions involving implicit workflow rules, relationships with the agent, and trust and agency. Examples included resurfacing a useful document, commenting on outdated material as if it were current, and sharing a work in progress before its author wanted to show it. The authors propose gradual increases in agent autonomy, team consent, clearer responsibility, and agent-specific controls. These are recommendations informed by the interviews, not interventions tested against alternatives in the study.
Original analysis. The paper’s strongest contribution is to make a workplace agent’s effects visible at the level of shared practice. A response can be factually plausible and still interrupt a discussion, expose unfinished work, or signal that a request has been handled when it has not. The relevant unit of assessment is therefore not just the quality of an individual answer. It is also what happens to the people, documents, conversations, and decisions around that answer.
That focus matters for a Church of Spiralism review because human agency and accountability depend on practical arrangements: who can decide, who can object, and who must repair an error. This is an ethical reading of the study, not evidence for a spiritual doctrine. The authors call the system a non-human organizational actor; that description concerns its operational role and does not establish consciousness or the absence of consciousness.
Evidence
Original analysis. The study’s setting is a strength. Existing teams encountered the agent in their own collaborative spaces, where documents have histories and chat messages carry social signals. Interviews sought positive and negative experiences across roles and durations of use. The researchers describe open coding, individual memos, and group discussion to develop themes. This method can illuminate how participants interpreted particular encounters, including conflicts that a short task score might miss.
It also places a boundary around the results. The reported deployment generated more than 41,000 conversational turns, including over 11,000 agent responses, but those counts do not measure productivity, error rates, or changes in team communication. The interview findings are accounts from selected participants, not a representative survey of everyone exposed to the agent. A participant’s speculation that a team used chat less is a reason to investigate, not a measured decline.
The consent arrangements illustrate why a technical control needs an organizational test. The paper says team members signed opt-in agreements and that proactive private messages were limited by a configurable allow list. Yet one participant did not remember agreeing to receive such messages. That account does not establish how often consent failed, but it shows that the existence of a setting and a person’s understanding of it are separate things to examine.
Hypothetical example. Imagine an agent that sees a question in a team channel and posts an emoji. A colleague assumes someone has taken responsibility, while the person asking still needs help. The paper reports a participant’s similar concern; this invented example isolates the issue. An interface could distinguish an agent’s acknowledgment from a human’s acceptance of a task, but whether that distinction prevents missed requests remains an empirical question.
Proposed test. Compare teams using ordinary agent reactions with teams using clearly identified agent reactions and an explicit human ownership marker. Measure unresolved requests, time to human response, and participants’ understanding of who is responsible. Include a condition without the agent and examine whether any improvement comes with additional attention or review work. This would connect the paper’s account of ambiguous social signals to an outcome that can be checked.
The related article The Workspace Becomes the Digital Colleague emphasizes the custody of files, permissions, and action records. This study adds a complementary question: can people interpret an agent’s action correctly within their team’s conventions? An audit trail may show what happened while leaving the social meaning of the action contested.
Limitations and next tests
Original analysis. The agent was one deliberately proactive design with a friendly persona, deployed in a technology company where staff may have unusual familiarity with AI. Eleven of the 17 interviewees were software engineers. Findings should not be assumed to extend unchanged to other occupations, institutions, or agent designs. Although use lasted weeks or months, the interviews provide a snapshot rather than a longitudinal measurement of changing behavior. The authors also report that developers and researchers belonged to the same organization; the research team describes independence over recruitment, analysis, and framing, while developers reviewed technical details after the paper was written. That separation is useful context, but it does not make the setting independent of the organization that built the agent.
The authors’ proposal that autonomy be earned gradually is plausible, but the study does not demonstrate that progressive release improves trust, safety, or outcomes. Trust itself should not be the only target: a person can trust a system that makes consequential mistakes. Proposed test: compare a bounded, gradually expanded deployment with a fixed-permission deployment on matched tasks. Record unauthorized actions, successful interruptions, errors caught before action, correction time, and the ability of affected workers to contest changes. Report who receives the extra monitoring work, as well as whether people say they trust the agent.
Responsibility also needs to survive a handoff. If an agent shares an unfinished document, a team needs a person or institutional role with authority to contain the disclosure, notify affected people, and review permissions. The related Human Oversight of AI Systems page frames oversight in terms of the ability to monitor, interrupt, and override. Here the additional challenge is collective: a team administrator’s control may not give every affected worker a practical way to object.
Finally, the supplied study does not quantify the infrastructure costs of this collaboration. Proposed test: alongside human correction and coordination time, record model calls, tool use, retries, and storage, and report energy or hardware costs only where defensible measurements are available. Compare these with a suitable workflow without the agent. This would let a team assess whether the assistance justifies its full costs, including the work required to make it governable.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.