Mengdi Wang
Princeton UniversityProfessor of Electrical and Computer Engineering. Her work on LabOS explores how multimodal AI agents, extended-reality interfaces, and human–AI collaboration can support physical laboratory science.
NeurIPS 2026 · Sydney
Autonomous research, human judgment: rethinking ML research through a discussant-led workshop.
The premise
The research process comprises the formulation of a hypothesis, the design of an experiment, and the judgment of a result. The implicit assumption that this process is a fundamentally human act is suddenly being challenged by autonomous research.
Given the development of agent harnesses that can pursue long-horizon tasks, we believe it is time for the community to formally recognize and plan for the inevitability of impactful autonomous research.
Our goal is to make autonomous research meaningful in a way that strengthens the ML community without undermining the role of human researchers. The workshop brings this structural change into the open and anchors autonomous research in human judgment and participation.
What is the best way to responsibly include autonomous research?
How should people evaluate, curate, and take responsibility for AI-generated science?
How do we ensure conferences continue to facilitate the development of human researchers?
Call for papers
We seek ML research substantially carried out by autonomous agents, alongside work on the systems, evaluation methods, and norms that make autonomous research possible.
A scientific manuscript where an agent carried out research end-to-end or was responsible for the central claims—particularly generating a hypothesis and validating it with experimental or theoretical evidence.
Agent harnesses, environments, benchmarks, and infrastructure that enable autonomous ML research loops, replication, or algorithmic discovery.
Research on attribution, disclosure, reproducibility, safety, review, incentives, and the institutional consequences of autonomous research.
The workshop is specifically focused on machine learning research—not autonomous research in unrelated scientific domains—while welcoming relevant lessons from adjacent fields.
Important dates
Exact time zones will be posted with the submission instructions.
Discussant format
If autonomous systems can produce candidate papers at scale, the scarce human contribution becomes the ability to evaluate AI-generated claims.
The human author presents a brief summary, then transitions into a dialogue with a human reviewer. The discussant explains why the paper was accepted, what limitations remain, and why its central claim is worthy of attention.
An agent substantially carries out the research loop.
Authors curate, verify, disclose, and take responsibility.
Anonymous evaluation remains separate from the decision.
An accepting reviewer joins the author as discussant.
People
Professor of Electrical and Computer Engineering. Her work on LabOS explores how multimodal AI agents, extended-reality interfaces, and human–AI collaboration can support physical laboratory science.
Assistant Professor and Staff Research Scientist. Her work frames ML engineering as an interactive agent environment and studies how MLE agents improve through experience despite sparse rewards.
Director of Data Science. His research applies ML to labor-market dynamics, including job transitions, skills shortages, and how AI adoption ripples through industries.
Arjun Prakash · Aditya Iyer · Hamish Ivison · Jack Liell-Cock · Amy Greenwald · Nora Ayanian
David Tao · Kevin Wang · Stephen Chung · Anna Hakhverdyan · Stephen Crawford · Zarif Aziz
FAQ
ML research substantially produced by an autonomous agent—ideally work where an agent carried out the process end-to-end or was responsible for the central claims, including hypothesis generation and experimental or theoretical validation.
Yes. Authorship remains exclusively human. Authors curate the work, verify its claims, disclose agent involvement, and remain responsible for the final submission.
Yes. We welcome papers on systems that produce autonomous research, including environments, harnesses, evaluation methods, replication infrastructure, and governance.
No. This is a non-archival workshop, allowing authors to continue developing and submitting their work elsewhere, subject to those venues' policies.
Submission
OpenReview, formatting, paper length, and final disclosure instructions are coming soon.
The submission link will appear here when the portal opens.