Can AI agents do scientific research on their own? Science's Last Exam is a new benchmark measure t...
elvis(@omarsar0) · 人工智能
Can AI agents do scientific research on their own? Science's Last Exam is a new benchmark measure this. It's built from real research tasks across nine scientific fields. It tests whether an agent can form hypotheses, plan protocols, run scientific code and software, and read what happens in experiment videos. Researchers from more than 30 institutions wrote and reviewed the tasks. On the initial leaderboard, the strongest agent configuration (Claude Opus 5 in Claude Code) reaches a composite score of 37.5 out of 100. On the end-to-end research track, every model scores 0. AItonomy Foundation @aitonomyfound I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ sciences-last-exam.org XCB github.com/Gen-Verse/Scie… 2Wq huggingface.co/datasets/Gen-V… DuAgf6 Thread below on how the exam works and where models break. 👇 #AGI 4 #AIforScience S #AIAgents I #SciencesLastExam a #OpenAI # #Anthropic thropic Your browser does not support the video tag. 🔗 View on Twitter 🔗 View Quoted Tweet 💬 16 🔄 5 ❤️ 16 👀 2501 📊 13 ⚡ Powered by xgo.ing