What Remains After the AI Help Ends?
Why assisted performance and later human capability need separate evaluation, and what a four-case framework can and cannot establish.
The paper
What Human-AI Interaction Leaves Behind: Residual Human States -- A Trajectory-Based Framework and Multi-Study Analysis — Herrera-Poyatos, David; Peláez-González, Carlos; Zuheros, Cristina; Herrera, Francisco.
arXiv:2610.18765v1 · Human-Computer Interaction (cs.HC). First submitted 2026-10-13; reviewed version dated 2026-10-13. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Evaluate what happens after assistance
Herrera-Poyatos and colleagues distinguish performance during AI use from the human state carried into later activity. Their framework compares alternative interaction histories and asks about multiple outcomes and time horizons. Its central contribution is a way to organize evaluation, rather than a single score of whether AI helps or harms people. Framework.
Four cases with different inferential roles
The paper assembles secondary evidence from medical training, diagnostic learning, classroom tutoring, and personalized dialogue. In the classroom case, improved assisted practice did not yield a detectable improvement on a subsequent unaided exam. That exam followed minutes later; it is not evidence about long-term retention. Empirical applications.
No universal verdict on dependence
The cases were selected to illustrate the framework, not to estimate population-wide effects. None was originally designed to validate it. Their measures and designs differ, and several interpretations depend on assumptions inherited from the original studies. The paper does not establish that all AI assistance causes skill loss. Limitations.
Our assessment: specify the capability that must remain
A useful organizational question is not simply whether people can work without a tool. It is which functions they will still be expected to perform when the tool is unavailable, mistaken, or disputed. An assessment should begin with those expectations. A requirement to supervise an assistant is incomplete unless it says what supervision involves and how the relevant ability will be checked.
Consider a hypothetical workplace assistant that drafts routine summaries. A team might reasonably choose not to preserve everyone's speed at producing a first draft from scratch. It might nevertheless require everyone approving a summary to identify unsupported claims, recover the original context, and notice omitted dissent. Those are different capabilities. A test of writing speed would not settle whether the team can still perform them.
This example expresses our evaluation preference, not a result in the paper. We would ask a pilot team to list retained responsibilities before choosing a benchmark. That order matters: otherwise, an easily measured task can become the definition of competence simply because a test already exists.
Choose a fair comparison
A practical evaluation should specify what would have happened during the same period without the proposed tool. A comparison group might receive ordinary training, a different form of assistance, or additional time. Each comparison answers a different question. Removing a tool without replacing the work it supported would not automatically create a fair test of an entire workflow.
We would also separate adaptation from failure. A user who becomes slower on an obsolete procedure may be reallocating effort sensibly. A user who loses the ability to detect a consequential error presents a different concern. The judgment depends on the role and on what alternatives remain available, not on a general ideal of complete independence from tools.
For a small pilot, a team could record three things in advance: the tasks it intends to delegate, the capabilities it needs to retain, and the circumstances in which those capabilities will be tested. This would make a later disagreement about success easier to locate. The disagreement might concern the measured change, the quality of the test, or the original division of responsibility.
A prospective test we would want to see
A stronger evaluation could compare assistance policies on the same task while keeping the underlying model constant. Participants might receive immediate answers, hints before answers, or prompts to reconstruct their own solution. Researchers could measure current task completion separately from later error detection and explanation. The timing of those later tests should be chosen before observing the results.
Such a design would still need to account for prior experience, exposure, and people who stop participating. It should report uncertainty and avoid interpreting an inconclusive comparison as proof of equivalence. If a benefit appears only on a closely repeated task, the conclusion should remain about that task until transfer is tested.
The operational recommendation is modest: stop asking one performance measure to answer every question about a person's relationship with a tool. This paper offers a reason to make the after-use period explicit. Our additional recommendation is to connect that period to the actual responsibilities an organization assigns, so that evaluation informs a decision rather than producing a broad story about human decline or empowerment.
Related reading
Read alongside the analysis of AI-assisted learning and later performance and AI in Education. One underlying educational case overlaps with existing coverage; the new paper contributes a broader comparative framework rather than a wholly new set of experiments.
AI use: AI assisted source discovery, drafting, and source checking. The workplace example and proposed experiment are editorial analysis. This review does not independently reproduce the studies or offer clinical advice. Sources checked October 2026.
Paper sources
Bibliographic metadata checked 2026-10-23.