<html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"></head><body dir="auto"><div dir="auto">Interesting article. I have found this link to "GPT in 60 Lines of NumPy" on Hacker News</div><div dir="auto">https://jaykmody.com/blog/gpt-from-scratch/</div><div dir="auto"><br></div><div dir="auto">It is similar to nanoGPT and minGPT from Andrej Karpathy, who has joined OpenAI again recently</div><div dir="auto">https://github.com/karpathy/nanoGPT</div><div dir="auto"><br></div><div dir="auto">The secret is apparently not to use a complicated algorithm but just a huge amount of data, as Rich Sutton writes here </div><div dir="auto">http://www.incompleteideas.net/IncIdeas/BitterLesson.html</div><div dir="auto"><br></div><div dir="auto">-J.</div><div dir="auto"><br></div><div><br></div><div align="left" dir="auto" style="font-size:100%;color:#000000"><div>-------- Original message --------</div><div>From: Russ Abbott <russ.abbott@gmail.com> </div><div>Date: 2/10/23 5:53 PM (GMT+01:00) </div><div>To: The Friday Morning Applied Complexity Coffee Group <friam@redfish.com> </div><div>Subject: [FRIAM] A very good piece about ChatGPT. </div><div><br></div></div><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif;font-size:small;color:#000000" class="gmail_default"><a style="font-family:Arial,Helvetica,sans-serif" rel="noreferrer" href="https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web">It's in the New Yorker</a><span style="font-family:Arial,Helvetica,sans-serif;color:rgb(34,34,34)"> and intended for a non-scientific audience.</span><br></div><div class="gmail_quote"><div dir="auto"><div dir="auto" class="gmail_quote"><div dir="ltr"><div><div data-smartmail="gmail_signature" dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div></div>
</div></div>
</body></html>