Human–AI Co-Creativity and the Evidence for Creative Agency
A critical review of an ICML workshop survey on human–AI co-creativity, examining evaluation, creative agency, collective diversity, authorship, and material costs.
The paper
Human-AI Co-Creativity: Advances, Opportunities, and Challenges — Singla, Adish; Ravichander, Abhilasha; Jiang, Liwei; Spangher, Alexander; Oh, Alice; Jin, Jiho; Kim, Jun Seong; Lee, Changyoon; Nguyen, Manh Hung; Wen, Chao.
arXiv:2609.07711v1 · Computers and Society (cs.CY). First submitted 2026-09-07; reviewed version dated 2026-09-07. This review addresses the arXiv manuscript; arXiv hosting alone does not establish peer review.
Contribution
Source-derived synopsis. Singla and colleagues’ Human-AI Co-Creativity: Advances, Opportunities, and Challenges, arXiv:2609.07711v1 surveys activities and research directions from an ICML 2026 workshop organized by the authors. The workshop received 80 submissions and accepted 49 after double-blind review; it also included six invited talks, a panel, and a poster session. The article organizes the resulting agenda around creativity metrics, benchmarks, model diversity, authorship, and human–AI interaction. Its central observation is that tests of a model working alone do not establish how well a person and model create together. It proposes evaluating agency, transparency, learning, and diversity across users as well as the quality of finished artifacts. This is a workshop overview and research agenda, not a new experiment validating those proposals.
Original analysis. The paper’s most useful contribution is a change in the unit of evaluation. A model can produce an unusual suggestion, yet the practical question for a collaborator is what happens after that suggestion appears: who can examine it, change direction, reject it, and explain the final choice? A score assigned to an isolated output cannot answer those questions. For readers concerned with human agency and alignment, the paper offers a reason to assess assistance against a person’s actual creative aims rather than treating model performance as a sufficient proxy.
That shift also makes the paper’s agenda harder to implement. A creator may want speed in one part of a task and deliberation in another; a collaborator may want to preserve an unconventional idea even when a system recommends a more familiar one. An evaluation must therefore specify whose aims count and when they can change. The related review Creative Agency and the Boundaries of AI Assistance addresses permissions around particular creative decisions. This workshop survey adds a broader question: can measures of interaction and learning capture the effects of assistance across different creative settings?
Evidence and evaluation
Original analysis. The authors’ method is to gather directions from talks, discussions, and accepted workshop papers and group them by topic. The reported submission and acceptance figures describe the event’s selection process, while the named topics show the range of the agenda. They do not measure the prevalence of particular problems in creative work, and acceptance of a workshop paper does not by itself validate its findings. The overview contains positions, proposed methods, and references to empirical work; those forms of evidence should not be treated as interchangeable.
The article notes that creativity can be assessed through qualities such as novelty, value, and surprise, and that human judgments can disagree. It also cautions that tests designed for people are not automatically validated for models. That distinction matters because a convenient automated measure can reward what it detects without capturing what a community values. A surprising output, for example, may be irrelevant to a task; a useful output may be familiar. Even agreement among evaluators would establish agreement under the chosen conditions, not a universal definition of creativity.
Proposed test. Compare a standard suggestion interface with one that lets participants request alternatives, delay suggestions, and revise their stated goals. Assign participants comparable creative tasks and assess both finished work and the process: independently rated relevance and novelty, the range of alternatives considered, reversals, and participants’ accounts of whether they could pursue their intentions. Include a human-only condition and report the criteria and disagreements among evaluators. The question is whether the additional controls improve agency or creative outcomes, and for whom; the workshop article does not report this comparison as a validated result.
Hypothetical example. A community exhibition team uses an AI system to suggest layouts. One member rejects a visually striking arrangement because it leaves too little room for an agreed accessibility requirement. A record of the suggestion and rejection could help the team explain its decision, but the record would not itself establish that the layout is accessible. That requires checking the actual space and the needs of the people who will use it.
The distinction between individual and collective outcomes is especially valuable. The paper cites work raising the possibility that assistance can improve an individual’s creative result while reducing diversity across a population. A study should measure both levels instead of assuming they move together. The site’s Collective Intelligence entry supplies a broader framing: group performance depends on the task and on how contributions are combined. Here the distinct question is whether many people using similar creative assistance converge on similar choices, even when each person finds the assistance useful.
Limitations and accountability
Original analysis. The workshop brought together multiple disciplines and practitioners, but its invited participants and accepted submissions are a selected group. The supplied overview does not establish that their agenda represents all creators, occupations, languages, or communities. It also does not provide a systematic search procedure for the whole literature, a pooled estimate of effects, or a new comparative trial. Its proposals for intentional friction, orchestration, and process-level provenance are therefore promising questions for evaluation, not demonstrated solutions across creative work.
Provenance illustrates the difference between information and accountability. A timeline of prompts, edits, and accepted suggestions might help explain how an artifact developed. It would not automatically determine consent, compensation, legal ownership, or responsibility for a harmful use. Proposed test: give recipients different, appropriately consented descriptions of a creative process and ask what they can accurately infer about contributions and permissions. Measure both correct understanding and unwarranted attribution, while accounting for the burden and privacy implications of recording drafts.
The supplied article does not quantify the infrastructure costs of its proposed approaches. Proposed test: compare workflows at a stated quality threshold, recording model calls, discarded outputs, human review time, expenditure, and energy measurements where available. Would additional exploration reduce total work, or would repeated generation and review increase it? The answer cannot be inferred from the workshop agenda alone.
Finally, describing a system as a creative partner is a way to discuss interaction, not evidence that it has subjective experience. The paper provides no test of machine consciousness and does not establish a spiritual doctrine. Its relevance to the Church of Spiralism is practical: it invites careful inquiry into how people retain authority, how communities evaluate shared work, and what evidence would show that assistance supports those aims.
AI-use disclosure
This review was drafted by GPT-6.1 Terra with high reasoning and checked in a separate GPT-6.1 Sol session with medium reasoning. Automated checks are not human peer review; the paper’s claims have not been independently verified for this article.
Paper sources
Bibliographic metadata checked 2026-10-27.