[FRIAM] A very good piece about ChatGPT.

[Jochen Fromm]

Interesting article. I have found this link to "GPT in 60 Lines of NumPy" on Hacker Newshttps://jaykmody.com/blog/gpt-from-scratch/It is similar to nanoGPT and minGPT from Andrej Karpathy, who has joined OpenAI again recentlyhttps://github.com/karpathy/nanoGPTThe secret is apparently not to use a complicated algorithm but just a huge amount of data, as Rich Sutton writes here http://www.incompleteideas.net/IncIdeas/BitterLesson.html-J.
-------- Original message --------From: Russ Abbott <russ.abbott at gmail.com> Date: 2/10/23  5:53 PM  (GMT+01:00) To: The Friday Morning Applied Complexity Coffee Group <friam at redfish.com> Subject: [FRIAM] A very good piece about ChatGPT. It's in the New Yorker and intended for a non-scientific audience.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://redfish.com/pipermail/friam_redfish.com/attachments/20230210/3d4479ca/attachment.html>