+- MKLab (https://mklab.gr)
+-- Forum: [INDEX] (https://mklab.gr/forumdisplay.php?fid=1)
+--- Forum: ARTFICIAL INTELLIGENCE (AI) (https://mklab.gr/forumdisplay.php?fid=5)
+---- Forum: ARTICLES (https://mklab.gr/forumdisplay.php?fid=33)
+---- Thread: LLMs and self-referentiality (/showthread.php?tid=1794)
LLMs and self-referentiality - mklabgr - 09-02-2026
Summary: “LLMs and self-referentiality” — Scott Aaronson
Scott Aaronson revisits an old and influential idea about artificial intelligence: that self-reference and Douglas Hofstadter’s so-called “strange loops” would be fundamental to the emergence of genuine intelligence. In Gödel, Escher, Bach, Hofstadter closely linked human intelligence with systems capable of referring to themselves, while Roger Penrose, from a different perspective, also argued that Gödel’s theorems and self-reference revealed something profound about the limits of computation. Aaronson argues that the success of modern LLMs is strong evidence that this prediction was mistaken. Today’s models can discuss themselves, Gödel’s theorem, and even the conversation they are participating in without having any special self-referential mechanism explicitly built into their architecture. This ability appears to have emerged naturally from their broader capacity to process language and knowledge.
Aaronson draws a parallel with mathematics and theoretical computer science. Self-reference and diagonalization have been extremely powerful techniques for proving mainly negative results, such as the uncountability of the real numbers, Gödel’s incompleteness theorems, and the undecidability of the halting problem. But one does not need to explicitly build self-reference into a universal computational system. A sufficiently general system may acquire the ability to describe or simulate itself simply because of its universality. Aaronson suggests that something similar has happened with LLMs. Older ideas that seem to have held up better are those linking intelligence with prediction, information compression, and the discovery of structure, rather than with self-reference as an essential ingredient.
At the same time, Aaronson separates intelligence from consciousness. The fact that LLMs can display impressive conversational and cognitive abilities without specially engineered “strange loops” does not solve the problem of subjective experience. Consciousness remains deeply mysterious, and self-reference—or perhaps some entirely different physical process—could still play a role in it. What Aaronson believes should now be abandoned is the stronger claim that convincing, general artificial intelligence cannot exist without self-reference.
Key takeaways
- Self-reference does not appear to be necessary for strong intelligence to emerge in LLMs.
- An LLM’s ability to talk about itself may simply be an emergent consequence of its general linguistic and cognitive capabilities.
- Prediction and information compression may provide a better framework for understanding why modern AI systems work so well.
- The argument is mainly about intelligence, not consciousness; subjective experience remains an open problem.
ARTICLE