Will a Teacher-Configured Chatbot Teach as Intended?
A critical review of a workshop study tracing teachers’ instructional goals through chatbot configurations and test responses, with attention to agency, evaluation, and classroom limits.
The paper
Will It Teach as Intended? How Teachers Configure Educational AI Chatbots — Riahi, Bahare; Ozturk, Deniz; Guth, Alice; Li, Jiayu; Singh, Daksh Pratap; Tian, Xiaoyi; Chiu, Jennifer; Lytle, Nicholas; Barnes, Tiffany; Catete, Veronica.
arXiv:2609.29993v1 · Human-Computer Interaction (cs.HC). First submitted 2026-09-24; reviewed version dated 2026-09-24. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Original analysis. A teacher can specify what an educational chatbot should do and still face a separate question: does it behave that way when someone uses it? Riahi and colleagues’ versioned study makes that question concrete by following instructional intentions into configurations and then into chatbot responses. Its most useful distinction is between a response that addresses a user’s request and one that serves the teacher’s instructional purpose. Fluency and relevance are insufficient evidence of pedagogical alignment.
This matters for human agency because a configuration screen gives teachers a way to express preferences, but the practical value of that control depends on whether they can understand, test, and revise its effects. It also matters for student agency: a teacher may want assistance that helps a learner continue reasoning without completing the learner’s work. The study documents that intention and examines chatbot behavior, but it does not establish whether students learn more or retain more responsibility for their work.
Evidence
Source-derived synopsis. In summer 2026 workshops, 27 middle school teachers at two U.S. sites configured and tested chatbots for science or computational thinking activities, then joined focus groups. Researchers thematically analyzed interviews and configuration fields and evaluated logged responses against four criteria. The tool used teacher-written purpose and rules, persona settings, and other controls. Teachers envisioned differentiated support and boundaries that would preserve student thinking. In the final evaluation of 27 chatbots, 24 passed for responsiveness, 22 for persona, 19 for rules, and 16 for purpose: respectively 88.9%, 81.5%, 70.4%, and 59.3%. An AI evaluator scored responses using a rubric refined with human review; agreement was assessed on 58 interaction records. The authors recommend clearer authoring guidance and support for testing and refinement, and identify the short workshop setting as a limitation.
Original analysis. The mixed evidence gives the paper its practical value. Interviews describe what teachers wanted, configuration logs show what they wrote, and test conversations provide observable outputs to compare with those settings. These sources address different parts of the problem: a well-written rule does not show that the rule was followed, and a response that appears helpful does not show that it reflects the broader goal. The study’s distinctions make those gaps inspectable.
The reported percentages need careful reading. They are bot-level classifications for this sample, based on a four-point rubric whose scores of three or four counted as passes. A pass includes responses judged adequate as well as those judged to meet a criterion more fully. It should therefore not be read as a guarantee that every relevant instruction was obeyed. The categories also ask different questions, so the lower purpose rate cannot by itself establish why purpose was harder to satisfy. Could a broad instructional purpose be harder to judge in a single response than a specific rule? The authors suggest this possibility; the comparison does not establish it as the cause.
The scoring process is consequential. Researchers calibrated the rubric with 16 examples, reviewed an AI evaluator’s ratings on 58 records, refined the procedure, and applied it to the full dataset. Overall quadratic weighted agreement rose from 0.806 to 0.883 on the same calibration sample, while exact agreement rose from 76.7% to 82.8%. Agreement after refinement is useful evidence that the procedure could reproduce judgments on those cases, but reuse of the sample leaves open how well it would agree with independent human judgments on new cases. Agreement also measures consistency with the rubric; it does not prove that the rubric captures every educationally important feature.
Hypothetical example. A teacher asks a bot to guide a student through a science problem without giving the final answer. The bot directly answers the student’s question and sounds encouraging, yet supplies the solution. A responsiveness or persona judgment could look favorable while the rule is violated. This illustrates why separate criteria matter; it is not a reported interaction or a prediction about a particular bot.
Limitations and next steps
Original analysis. Teachers had roughly an hour to explore and test one authoring environment. Their messages are valuable probes, but they are not a representative sample of extended student conversations. Students might ask different questions, misunderstand instructions, or pursue unexpected conversational paths. The study also does not measure learning outcomes, teacher workload savings, or the effect of deployment over a school year. The 27 participants came from two sites, so the results should not be treated as population estimates for teachers or educational chatbots generally.
There is a further accountability question. Teachers wanted visibility into student activity, while also raising privacy concerns. A dashboard could help a teacher investigate a difficulty, but a summary or flag would itself require interpretation: a request for help is not automatically evidence of confusion, misconduct, or lack of understanding. The human oversight discussion provides a useful governance lens: meaningful oversight depends on the ability to inspect and act, as well as on the time and authority to do so. The AI in Education overview places that question within the wider handling of student data and instructional responsibility.
Proposed tests. A follow-up could hold out a fresh set of interactions for independent human scoring after the rubric is finalized, report agreement by criterion, and inspect disagreements near the pass threshold. Researchers could also compare responses to a common set of student-like prompts across configurations and models, including repeated prompts and longer conversations. Those tests would assess behavior under defined conditions, not certify performance in every classroom.
A classroom study could pair teacher-defined goals with observations of actual use and later assessments of what students can do independently. It could compare designs that offer different kinds of hints while recording both learning outcomes and the review work required of teachers. Whether a more faithful configuration improves learning, or merely makes a bot more consistent with an imperfect instruction, remains an empirical question.
The supplied study does not measure computing, energy, or hardware costs. A deployment evaluation could separately record usage and infrastructure costs alongside teacher time, rather than assuming that additional testing or monitoring is free. Nor do these findings provide evidence about machine consciousness or spiritual doctrine. Their grounded contribution is a more limited one: they show why educational AI should be evaluated against the human purposes and boundaries it is intended to serve.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.