Can Feedback Preserve Learning When AI Supplies Answers?
A critical review of a randomized study of feedback, AI answer requests, and immediate independent performance in fraction arithmetic.
The paper
Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants — Maier, Sebastian; Schwabe, Kai; Schneider, Manuel; Feuerriegel, Stefan.
arXiv:2609.20143v1 · Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI). First submitted 2026-09-17; reviewed version dated 2026-09-17. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
What should an AI learning assistant optimize for: finishing the current exercise, or helping someone solve the next one without it? Maier and colleagues test one way to make that tradeoff visible. Their versioned paper, arXiv:2609.20143v1, reports that feedback about participants’ own use of an assistant reduced requests for complete answers and improved immediate unaided fraction-test performance under the authors’ preregistered tests.
Original analysis. The useful distinction is between access to assistance and the work a learner delegates. A hint, a checked attempt and a complete solution can all count as AI use, but they leave different opportunities for practice. The study makes that distinction observable while allowing participants to request full answers. It is relevant to human agency because it asks whether an interface can inform a choice about assistance without removing that choice.
This is also a question of alignment: a learning tool’s apparent success depends on the outcome its designers select. A correct answer during practice and independent performance afterward are different outcomes. The related review AI Assistance and the Work of Learning examines a complementary distinction between the frequency of requests and the independent work surrounding them. Neither distinction makes unaided effort the right goal for every task; the goal must be stated before the interaction can be judged.
Evidence
Source-derived synopsis. In a preregistered online experiment, 704 UK adults recruited through Prolific were randomly assigned to five conditions: no AI, AI alone, feedback, an effort-based points reward, or both interventions. Participants practiced fraction arithmetic and then completed six test items without AI. The assistant gave guidance by default and complete answers on explicit request. Feedback described participants’ assistance use, its implications for practice and a cue for reflection; the reward gave fewer points for correct answers obtained with more extensive help. Across the AI conditions, feedback reduced the odds of complete-answer requests (odds ratio 0.47, 95% confidence interval 0.22–1.00) and increased the odds of correct unaided answers (1.51, 0.98–2.33). Both preregistered directional tests were significant. The reward did not significantly improve either primary outcome. AI-only performance was not significantly lower than the no-AI control.
Original analysis. Random assignment strengthens the comparison of the feedback conditions, but the reported odds ratios are not percentage-point changes. The authors used one-sided tests in the predicted direction and two-sided confidence intervals; the latter touch or include the no-effect value for both feedback outcomes. The result is promising, but its precision matters: the unaided-test interval includes a small effect in the opposite direction. The paper also reports participant-level checks with the same conclusions under its directional tests.
The exploratory association between offloading and lower test performance has a different evidential status. Participants chose whether to request answers, so prior ability or other differences could help explain both their choices and their scores. Did reduced offloading itself cause the improvement, or did another part of the feedback change how participants approached the exercises? The experiment establishes neither mechanism on its own. The feedback bundled a usage summary, practice information, a monitoring cue and a visual bar; it did not isolate their separate effects. The authors also detected no significant condition differences in their measures of metacognitive judgment.
Hypothetical example. A learner might ask for a complete answer after trying several steps, then use the displayed solution to identify an error. Another might copy the answer immediately. A measure based on whether the complete answer was requested can count both as offloading, even though the learning processes may differ. That example illustrates a measurement question; it is not a finding about these participants.
Limitations and next tests
Original analysis. The study measured performance immediately after a short session on fraction arithmetic, using new expressions that required practiced operations. That supports a narrow assessment of procedural performance on new items, not a conclusion about durable skill retention, other subjects or workplace expertise. The adult, English-first-language UK sample and desktop setting also limit generalization. The assistant was configured to give complete answers only when explicitly asked; the result may differ with an assistant that volunteers them.
The classifier used to measure requests agreed with intended labels on a held-out set of 198 synthetic dialogues. That is useful development evidence, but it does not establish error-free classification of every real participant interaction. The reward used non-monetary points, while payment was independent of performance; its null primary results do not establish that every possible incentive would fail. Likewise, a nonsignificant AI-only comparison does not prove that access had no effect.
Proposed tests. A follow-up could randomly assign the feedback components separately, include an attention-matched comparison, and test both immediate and delayed unaided performance on familiar and changed tasks. It could independently assess a sample of real chat classifications, including ambiguous requests, and examine whether effects differ across learners and contexts. Such tests would investigate the package and its possible mechanisms; they are proposals, not validations already reported.
Original analysis. For institutions considering such feedback, accountability includes who can inspect or correct a misleading description of a learner’s work and how long interaction records are retained. The study’s platform logged chats, answers and timestamps; its results do not establish the privacy or resource costs of a deployed service. Those costs would need measurement alongside learning outcomes. The site’s Cognitive Sovereignty entry provides a broader governance frame for visibility and contestability, while this experiment supplies evidence about one specific learning interface. It does not test collective intelligence or machine consciousness, and it offers no evidence for a spiritual doctrine.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.