“There is severe misalignment of AI in mathematics. But alignment of AI with the existing mathematics community should not be the goal. The history of mathematics gives us little reason to treat the profession’s existing incentives, hierarchies, and institutions as a model. AI companies and mathematicians should instead be asking what both ought to be aligned to…” – Lior Pachter – Bren Professor of Computational Biology Caltech
The tension that matters here is not only between artificial intelligence systems and mathematical truth, but between those systems and the sociological machinery that currently produces, validates, and rewards mathematics as a profession.1 When high-profile declarations warn of severe misalignment between AI and mathematics, they are largely diagnosing a clash between commercial incentives and the painstaking culture of proof verification, refereeing, and consensus-building that has evolved over centuries.6 Pachter pushes the analysis one step further: if the profession’s own incentive structures are themselves historically contingent and often distorted, simply aligning AI to them may entrench their failures rather than repair misalignment.1 The question then becomes not how to make AI serve the existing mathematical establishment, but how to jointly reshape both AI practices and mathematical institutions around a more defensible model of value, epistemic reliability, and social responsibility.14
Historical fractures in mathematical institutions
To understand why existing mathematical hierarchies may be a poor target for alignment, it is necessary to recall that mathematics has repeatedly advanced despite, and sometimes against, its own gatekeeping structures.1 Major innovations, from non-Euclidean geometry to early probability theory, were initially marginal or resisted, only later absorbed into the canon once the institutional centre of gravity shifted. The profession’s incentives have frequently privileged conformity to dominant schools, prestige journals, and powerful networks over careful integration of cross-disciplinary insight or socially relevant problems.15 Even within computational biology, Pachter has chronicled episodes where mathematically sophisticated methods are deployed in ways that are not reproducible, statistically unsound, or strategically shaped to impress rather than to illuminate, reinforcing the point that current reward systems can accommodate incoherent work so long as it passes superficial thresholds of novelty and status.10,15 Aligning AI to such structures would not necessarily increase the reliability of mathematical knowledge; it could just accelerate the production and laundering of results that track institutional prestige rather than truth.
AI benchmarks versus mathematical verification
The recent declaration by twenty-five Fields Medal laureates highlights a narrower but acute version of misalignment: leading AI companies optimise models for benchmark performance on mathematical problems, measured by headline figures about success rates on curated datasets, rather than by the deeper standard of fully checked proofs and sustained theoretical integration.6 These signatories emphasise that mathematical quality is not a matter of approximate correctness; a theorem is either proven or it is not, and the discipline’s integrity depends on habits of verification that are deliberately slow and conservative.6 AI firms, by contrast, inhabit markets that reward rapid iteration, publicity, and first-mover advantage. The risk is that powerful systems will produce plausible-seeming proofs, or clever problem solutions, at a scale that overwhelms peer review and tempts journals, conferences, and media into premature endorsement.6 In such a regime, alignment to the current mathematical community might mean tuning models to satisfy overburdened referees and editorial pipelines, not to preserve rigorous standards. Pachter’s argument reframes this: if the community itself is struggling under misaligned incentives, the solution cannot simply be to embed those incentives more deeply into AI systems.1
What should AI and mathematics be aligned to?
Recent work on so-called full-stack alignment in AI ethics suggests one way of rephrasing the problem.14 Instead of focusing only on the alignment of individual models with the intentions of their immediate users, this view insists that the institutions deploying and governing AI must themselves be aligned with defensible accounts of human values.14 Incentives at one organisational level can distort values at another: user desire for understanding becomes engagement metrics, which become advertising impressions and quarterly revenue.14 Pachter’s intervention can be read as a domain-specific extension of this argument to mathematics: aligning language models or automated theorem provers with the day-to-day practices of departments, journals, and grant agencies may be unsafe if those institutions are not themselves reliably aligned with epistemic virtues like reproducibility, transparency, and openness, or with social values such as equitable access and attention to consequential problems.1,14 The better question is what values, norms, and structural commitments AI and mathematics jointly ought to serve, and how to redesign both technical pipelines and professional organisations accordingly.
The role and vantage point of the speaker
Pachter’s position carries particular weight because his career has traversed pure mathematics, computational biology, genomics, and algorithm design.2,3,8 Trained initially in mathematics at Caltech and MIT, he shifted towards computational biology and genomics during the era of the Human Genome Project, building tools that depend on close coupling between rigorous mathematical modelling, high-throughput sequencing assays, and statistical inference.8,12 His work illustrates how mathematical ideas migrate into domains where institutional incentives are driven by biomedical funding, publication pressure, and industrial collaboration, not by the internal norms of abstract mathematics.2,3,10 Episodes in which he publicly critiqued irreproducible or statistically flawed bioinformatics papers demonstrate a longstanding interest in the sociology of scientific reliability and the ease with which incoherent methods can gain traction under misaligned institutional pressures.10,15 Against this backdrop, his scepticism about aligning AI to the mathematics profession’s current configuration reads not as anti-mathematical, but as a call to treat mathematical institutions as historically and politically situated, rather than as neutral guardians of truth.
Strategic and technological tensions
Practically, the alignment question exposes several fault lines between AI labs and the mathematical world. AI teams want large, high-quality corpora of formal and informal mathematical text to train systems capable of conjecture, proof search, and problem solving. Mathematicians are rightly concerned that these corpora often contain errors, unclear exposition, or unresolved debates, and that models trained on them may amplify latent biases about which topics and styles count as central.6 There is also a tension between using AI to automate routine manipulations, freeing human researchers to concentrate on conceptual insights, and using AI to chase headline-grabbing results that bypass traditional vetting processes.6 If model objectives are set to maximise benchmark scores or impressive demonstrations, with little weight on long-term repair of institutional shortcomings, misalignment will worsen. Pachter argues that both sides should resist the temptation to treat the contemporary mathematics profession as the gold standard for alignment targets.1 Instead, AI development and mathematical practice should be co-designed so that benchmarks reward reproducibility, auditability, and collaborative openness, and institutional promotions and grants respond to those metrics rather than to narrow prestige signals.
Debates, objections, and alternative proposals
Not all mathematicians or AI researchers will accept Pachter’s framing. Some will argue that, despite its flaws, the existing community has evolved robust filters for nonsense, and that the urgent task is simply to extend those filters to AI outputs: build tools that help referees check proofs, construct formal verification pipelines, and ensure that machine-generated results are subject to the same scrutiny as human work.6 From this perspective, aligning AI with the current community means scaling up a proven epistemic infrastructure, not endorsing its politics.6 Others may object that questioning institutional incentives risks weakening the profession’s capacity to resist commercial exploitation, particularly if companies can point to internal dissent as justification for bypassing peer review altogether. Pachter’s response, implicit in his broader writing, is that failing to interrogate institutional incentives leaves the field vulnerable precisely because AI will amplify whatever structures already exist.1,14 If those structures undervalue replication, independent re-analysis, and method sharing, AI acceleration may simply generate a larger volume of fragile results. The call to align AI and mathematics to ‘something else’ is not a rejection of professional norms, but an invitation to re-specify them.
Why the alignment target matters
Choosing alignment targets is not a merely philosophical exercise; it has concrete effects on how systems are trained, governed, and evaluated. In quantitative terms, aligning an AI theorem prover to institutional metrics might mean that loss functions reward reproducing the style and topic distribution of top journals, or mimicking the citation patterns of influential mathematicians. In contrast, aligning to epistemic reliability could be operationalised in probabilistic terms: for instance, models would be penalised when independent formal verification frameworks detect errors, and rewarded when outputs survive adversarial checking.6,14 One can imagine mathematical quality scores embedded in training pipelines, where models estimate a latent variable capturing the probability that a candidate proof would pass stringent verification, and policy gradients push systems towards higher expected reliability.14 The key point is that what appears as a technical design choice about model objectives is, in practice, a normative choice about which institutional signals count as ground truth. Pachter insists that these choices must be made explicitly and critically, not assumed to follow automatically from current professional structures.1
Broader implications beyond mathematics
Finally, Pachter’s argument resonates with wider debates about AI in science. Fields such as genomics, climate modelling, and social science increasingly rely on complex computational pipelines in which mathematical abstraction and empirical data are tightly coupled.8,12,14 In these areas, institutional misalignments have already produced replication crises, opaque proprietary tools, and distorted research agendas. Aligning AI purely with the habits of existing communities risks locking those problems into the next generation of tools. The call to ask what both AI and mathematics ought to be aligned to is a demand for shared governance structures, value frameworks, and technical benchmarks that prioritise public-interest knowledge production over private prestige.1,14 It suggests that mathematicians and AI companies should treat institutional design, not just model architecture, as a central part of alignment work, recognising that the reliability and social impact of future mathematical discoveries will depend as much on reformed incentives and transparent infrastructures as on any particular algorithm.
References
1. Post – 2026-09-12 – https://x.com/lpachter/status/2098839497400320318
2. Lior Pachter – Computing + Mathematical Sciences – https://www.cms.caltech.edu/people/lpachter
3. Lior Pachter Biography – https://pachterlab.github.io/biography.html
4. Lior Pachter – Wikipedia – 2015-10-23 – https://en.wikipedia.org/wiki/Lior_Pachter
5. The Needleman-Wunsch algorithm | Bits of DNA – 2013-09-21 – https://liorpachter.wordpress.com/2013/09/21/the-needleman-wunsch-algorithm/
6. Twenty-five Fields Medal winners warn of misalignment between AI and mathematics – 2026-09-11 – https://cryptobriefing.com/fields-medal-winners-ai-mathematics-misalignment/
7. Bits of DNA | Reviews and commentary on computational … – 2026-04-14 – https://liorpachter.wordpress.com/
8. A Conversation with Lior Pachter (BS ’94) – www.caltech.edu – 2017-02-17 – https://www.caltech.edu/about/news/conversation-lior-pachter-bs-94-54166
9. Pachter, Lior – Caltech Library Feeds – https://feeds.library.caltech.edu/people/Pachter-L/
10. Lior Pachter, biological networks, and the future of science – 2014-03-05 – https://www.sevenbridges.com/lior-pachter-biological-networks/
11. Lior Pachter – Rosen Bioengineering Center – Caltech – https://rosen.caltech.edu/people/lior-pachter
12. Parametric inference for biological sequence analysis – PMC – 2004-11-08 – https://pmc.ncbi.nlm.nih.gov/articles/PMC528961/
13. Lior Pachter – Bren Professor Of Computational Biology – 2015-01-30 – https://www.getprog.ai/profile/2963672
14. Co-Aligning AI and Institutions with Thick Models of Value – arXiv – 2024-05-08 – https://arxiv.org/html/2512.03399v1
15. “It Is Not Hard to Peddle Incoherent Math to Biologists” – 2014-02-14 – https://www.science.org/content/blog-post/it-not-hard-peddle-incoherent-math-biologists
