+- MKLab (https://mklab.gr)
+-- Forum: [INDEX] (https://mklab.gr/forumdisplay.php?fid=1)
+--- Forum: ARTFICIAL INTELLIGENCE (AI) (https://mklab.gr/forumdisplay.php?fid=5)
+---- Forum: ARTICLES (https://mklab.gr/forumdisplay.php?fid=33)
+---- Thread: Top mathematicians grade AI’s ability to solve toughest problems (/showthread.php?tid=2335)
Top mathematicians grade AI’s ability to solve toughest problems - mklabgr - 10-22-2026
Summary: Top Mathematicians Grade AI’s Ability to Solve the Toughest Problems
Source: Harvard Faculty of Arts and Sciences · Published October 19, 2026 · Author: Kermit Pattison
1 — The First Proof project and AI’s mathematical progress
The article examines the rapid development of artificial intelligence (AI) in advanced mathematical research, focusing on the First Proof project, an initiative involving leading mathematicians from universities such as Harvard, Stanford, and the University of Texas at Austin. The project aims to evaluate AI systems objectively by challenging them with difficult research problems that human mathematicians had solved but had not yet published. In its third round of testing, AI systems collectively solved all 10 mathematical problems, demonstrating substantial progress in their ability to produce sophisticated mathematical proofs. The problems covered diverse fields, including topology, statistics, logarithmic geometry, and symplectic geometry. The results suggest that AI is becoming increasingly capable of contributing to research-level mathematics rather than merely solving routine calculations or familiar textbook exercises.
2 — Impressive results but persistent limitations
Despite these achievements, the experiment revealed significant weaknesses in the quality of AI-generated mathematical solutions. The best-performing system, ProofCouncil, which combines several advanced AI models, solved nine out of ten problems, while OpenAI’s GPT-6 Astra solved seven. However, the systems often struggled to explain their reasoning clearly, organize proofs effectively, use mathematical notation appropriately, and provide accurate citations to existing research. Some solutions were unnecessarily complicated or difficult for human mathematicians to verify. In certain cases, the systems failed to acknowledge relevant published work, raising concerns about plagiarism and proper attribution. Researchers also identified errors arising from outdated versions of mathematical papers. These findings demonstrate that producing a potentially correct answer is not sufficient: mathematical research requires rigorous verification, transparent reasoning, clear exposition, and appropriate recognition of previous contributions.
3 — Implications for mathematical research and the future of AI
The findings highlight both the opportunities and challenges associated with integrating AI into mathematical research. AI systems could help researchers solve difficult problems more efficiently, explore alternative proofs, and accelerate certain stages of mathematical discovery. Nevertheless, human mathematicians remain essential for checking correctness, assessing originality, identifying errors, and ensuring that results are communicated reliably. Another important concern is the performance gap between advanced commercial AI systems and open-weight models, whose underlying model parameters are publicly available. In the latest experiment, every submission from the tested open-weight model contained major errors, raising questions about access to powerful mathematical AI tools and the concentration of technological capabilities among a small number of companies. The First Proof organizers plan further evaluations to understand these limitations better. Overall, the article argues for a balanced assessment of AI: its mathematical capabilities are advancing rapidly, but reliability, transparency, and human oversight remain crucial.
Key takeaways
- Significant progress: AI systems collectively solved all 10 problems in the third round of the First Proof evaluation.
- Best-performing system: ProofCouncil solved 9 out of 10 problems, while GPT-6 Astra solved 7.
- Research-level mathematics: AI can increasingly tackle challenging problems across several advanced mathematical disciplines.
- Correctness is not enough: A proof must also be logically rigorous, clearly written, and independently verifiable.
- Weak exposition: AI-generated proofs can be excessively long, poorly organized, or difficult to understand.
- Citation and originality concerns: AI systems may fail to acknowledge existing mathematical research adequately.
- Human oversight remains essential: Expert mathematicians are needed to check proofs, detect errors, and evaluate originality.
- Unequal access to AI capabilities: The experiment revealed a substantial performance gap between leading commercial systems and the tested open-weight model.
- Future research: Continued independent testing is necessary to establish the strengths and limitations of mathematical AI.
The article presents AI as an increasingly powerful tool for advanced mathematical problem-solving, while emphasizing that its achievements should not be confused with fully reliable or independent mathematical research. The next major challenge is not simply enabling AI to solve more problems, but ensuring that its solutions are correct, understandable, reproducible, and properly documented.
Original article: Top mathematicians grade AI’s ability to solve toughest problems — Harvard FAS