[FRIAM] How the mind works

Jochen Fromm jofr at cas-group.net
Mon Apr 15 16:23:13 EDT 2024


On "Hacker News" someone wrote today [1] that transformers in LLMs work like the Hamiltonian in Quantum Mechnics because prediction of the next token in the sequence is determined by computing the next context-aware embedding vector from the last context-aware embedding vector alone, similar to the Hamiltonian matrix which is applied in Quantum Mechanics in the Schrödinger equation to the high dimensional state vector in a Hilbert space to predict the next state of the quantum system [2]. This would imply that the human mind works like Quantum Mechanics if LLMs describe the functionality of the prefontal cortex. If the Hamiltonian represents the “energy dynamics”, what do the LLM values represent? The learned experience?Robert Watson who is a Professor of the Humanities at the University of California Los Angeles, writes in his fascinating book "Cultural Evolution and its Discontents" (2018) that "the human mind resembles a nuclear reactor: amazingly generative within the little containment dome, but always at risk of running fatally amok in a meltdown, and ceaselessly producing toxic waste" [3]. The toxic waste can be for example hallucination, imagination or simply lies.So is the human mind similar to Quantum Mechnics or does it resemble a nuclear reactor?-J.  [1] https://news.ycombinator.com/item?id=40038352[2] https://en.wikipedia.org/wiki/Hamiltonian_(quantum_mechanics)[3] Robert N. Watson, Cultural Evolution and its Discontents, Routledge, 2018
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://redfish.com/pipermail/friam_redfish.com/attachments/20240415/14c6ec1c/attachment.html>


More information about the Friam mailing list