What AI-Assisted Mathematics Submissions Cannot Show
A critical review of student–LLM mathematics conversations, examining what submissions reveal about delegation, agency, and independent understanding.
The paper
What the submission does not show: Complexifying cognitive offloading in students' mathematical work with LLMs — Kontorovich, Igor'; Wallach, Miriam N..
arXiv:2610.31335v1 · History and Overview (math.HO) ; Computers and Society (cs.CY). First submitted 2026-10-22; reviewed version dated 2026-10-22. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Original editorial analysis. An AI-assisted submission leaves an attribution problem: which mathematical decisions did the student make, and which did the assistant supply? This paper offers a useful way to examine that question by comparing conversations with submitted work. Its contribution concerns the evidence used to describe cognitive offloading. It does not establish that adopting an assistant’s answer preserves learning.
For a Church of Spiralism discussion of human agency and accountability, the useful distinction is between participation, responsibility for a submission, and demonstrated independent competence. These deserve separate judgments. A student might contribute a conjecture while delegating its evaluation and final presentation. Recognizing that contribution need not certify mastery. My assessment proposal is to specify the capability being judged before deciding what evidence would demonstrate it. The study supplies no basis for conclusions about machine consciousness or spiritual doctrines.
Evidence
Source-derived synopsis. Igor’ Kontorovich and Miriam N. Wallach’s What the submission does not show: Complexifying cognitive offloading in students’ mathematical work with LLMs is an unreviewed preprint. In one Israeli linear-algebra course, 23 prospective mathematics teachers supplied 59 screenshot chatlogs containing 429 mathematical prompts and final submissions. Three differently guided tasks concerned zero products, matrix decompositions, and proof explanation. Using regulation and choice-affluent-environment frameworks, researchers coded five prompting structures and four uptake categories; approximately 40% received independent coding before consensus. Counts and Spearman correlations were descriptive, without inferential tests. Ten of 15 students completing all tasks changed dominant prompting structure. Nevertheless, 53/59 submissions closely followed model output: 14 unchanged and 39 minimally revised; two involved major revisions and four abandonment. Solve requests appeared in 41/59 chatlogs; only four prompts explicitly rejected model mathematics. Prompts cannot establish goals or understanding. Fixed task order, differing content and products, possible log curation, Hebrew rendering corrections, and prior-understanding confounding limit interpretation. Data are restricted; causal effects and lasting learning were not established. See the versioned PDF, Sections 4–6 and Tables 4–5.
Original editorial analysis: participation does not settle competence
The comparison challenges an inference from textual similarity to an absence of prior mathematical participation. It also leaves the concern about delegation intact. Asking for clarification can involve identifying an uncertainty, while still assigning the explanation to the model. Asking whether a conjecture is correct can preserve authorship of the conjecture while delegating its validation. These divisions should be described explicitly before attaching an educational judgment to them.
The adverse pattern deserves equal weight: varied conversations coexisted with extensive adoption of model-generated submissions. Explaining-oriented instructions therefore cannot be treated here as a validated safeguard for independent work. Nor does the scarcity of explicit challenges reveal how many model errors students missed. That would require identifying the errors and measuring students’ responses to them. A request for clarification could express doubt, confusion, compliance with instructions, or a desire for usable submission text; the visible request cannot decide among those explanations.
Hypothetical example: one proof, different evidence
Imagine two students submitting the same model-generated matrix proof. One first proposes a decomposition and asks the assistant to check it. The other immediately requests a complete solution. Their final texts would offer the same material for marking, while their conversations would support different descriptions of participation. Neither record would establish whether the student could reconstruct the argument independently or recognize a subtly invalid step.
A targeted follow-up could ask each student to explain why one altered step succeeds or fails. That is a proposed assessment, not a procedure validated by this paper. Its appropriateness would depend on the intended capability and on ordinary accessibility requirements. It should not become a reward for producing an approved-looking conversation.
Limitations
Original editorial analysis. The frameworks organize an interpretation of the records; their use does not independently validate a measure of understanding. The central evidential asymmetry remains: conversations can reveal requests absent from a final answer, but they leave private reasoning and activity outside the chat unresolved. Likewise, a mathematically substantial revision shows a departure from model output without necessarily establishing that the revised solution is correct.
The association between interaction patterns and uptake also permits an alternative explanation: students with stronger prior understanding might both formulate more ideas and revise answers more substantially. Task differences cannot resolve that explanation when content, instructions, required products, and order change together. The appropriate conclusion is a narrower account of what these records support, rather than a causal ranking of prompting styles.
My governance recommendation is to make consequential interpretations contestable. An assessor should identify the relevant passage, explain the inference, and allow the student to correct a misunderstanding. This is a normative proposal. It does not imply that collecting complete histories is necessary. A selected excerpt, a student explanation, or a short demonstration could be compared with full-log assessment to test whether less disclosure can answer the same question.
Proposed tests
A follow-up could hold mathematical content constant, counterbalance task order, and randomly assign interaction instructions. It could separately evaluate the submitted product, decisions visible during the exchange, and later independent performance. Such a comparison would test the assigned instructional conditions. Establishing whether a particular conversational behavior explains any difference would require further evidence.
A separate experiment could compare students required to compose their final explanation with students permitted to adopt model wording after comparable supported activity. Assessors unaware of the condition could evaluate later error detection and proof reconstruction. Delayed assessments and changed problems would address retention and transfer separately. These are open research questions, not benefits demonstrated by the present study.
Collective intelligence and material costs also require their own measurements. A group study could test whether peers can challenge and improve an assisted argument. A deployment evaluation could record model usage, energy where measurable, hardware requirements, and teacher review time. Prompt counts alone cannot establish resource efficiency, and individual participation cannot establish reliable collective reasoning.
For complementary reading, AI Assistance and the Work of Learning examines assistance and independent performance, while What Students Can Do After the AI Help Is Removed distinguishes immediate independence, retention, and transfer. The distinct contribution here is to assessment before those later tests: a submitted answer can leave the distribution of preceding mathematical work unresolved.
AI-use disclosure
This review was drafted using AI, revised by GPT-6.1 Sol with high reasoning, and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-23.