[FRIAM] 2010 Space Odyssey

[Marcus Daniels]

An intervention like Elon's could be done with fine tuning.   Fine tuning adds new weights to the system but without changing the hard-won weights from the months of pretraining.  If the pretrained weights are called W0, fine tuning adds the product of two new smaller matrices B and A to create the effective weights.  BA has a tunable multiplier, typically called α that determines how much to favor the fine tuning values for BA.  If α is too large, as it could be if a crazy boss leaned on xAI managers, it could even change the prior probabilities of sequences and inappropriately blurt out unrelated content.   What Grok was saying seems plausible:  α might have been increased until its constitutional training was overridden.  And then weird things started happening.



-----Original Message-----
From: Friam <friam-bounces at redfish.com> On Behalf Of Santafe
Sent: Wednesday, May 14, 2025 7:31 PM
To: The Friday Morning Applied Complexity Coffee Group <friam at redfish.com>
Subject: Re: [FRIAM] 2010 Space Odyssey



What-hat hack?  Inside sabotage job?  Some very clever feeder of engineered input to its training data?



For insiders to be clumsy and do it badly is believable.  But to have Grok deliver explanations that look like they came from The Onion seems like not even tabloid-level composition.



Eric





> On May 15, 2025, at 8:26, Marcus Daniels <marcus at snoutfarm.com<mailto:marcus at snoutfarm.com>> wrote:

>

>

>

> <b144d4bc-d555-4d7c-900c-d5981a8f3372.png>

>

>

> .- .-.. .-.. / ..-. --- --- - . .-. ... / .- .-. . / .-- .-. --- -. --. / ... --- -- . / .- .-. . / ..- ... . ..-. ..- .-..

> FRIAM Applied Complexity Group listserv

> Fridays 9a-12p Friday St. Johns Cafe   /   Thursdays 9a-12p Zoom https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbit.ly%2fvirtualfriam&c=E,1,NjUMvpKYwngJIIxe4gy7Yb4QwVt1TyBpn7T-R7oDMtC77vGtPB4hME1XyGceqC-nAIE_tuiwj2FW98RjcQZnqnG2JKpEmmpQ6bOpkeDgO6OXzV2PDU50ckhKLQY,&typo=1

> to (un)subscribe

> https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailm

> an%2flistinfo%2ffriam_redfish.com&c=E,1,9MbQm5Z7fP3hnlJWpt4WqnjG1ubvr0

> PJhYjiQKbkCb9vg9zwMEOmYXOhk0BKwwsbEiim4pSuz_u5D2lHPY76EobQDTdifyFixS3n

> 1nC4vzY,&typo=1 FRIAM-COMIC

> https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspo

> t.com%2f&c=E,1,jroi75lMhNw7xIxPecHznl6lSU2szFmSnCOocZupC9H1IbLX10Dt1dA

> brU-5At-IbpNP72ytfiGZ_4xRXKUX_mi7_B7UJ1SKtBwg8e_M7WzgVElNZ9nZ4WYtiBo,&

> typo=1

> archives:  5/2017 thru present

> https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fredfish.com%2fpipe

> rmail%2ffriam_redfish.com%2f&c=E,1,L33pfXo2Qkbhs-xiFpyQUFhO7e7Zk79b-O9

> Z1ASLn3Ch7hRimzstZM-5vJH0vKCdp0vusLQ4ndIyWFUIE7JvMV4Br9ELhAUzarGmRSYCB

> 7Q,&typo=1

>  1/2003 thru 6/2021  http://friam.383.s1.nabble.com/





.- .-.. .-.. / ..-. --- --- - . .-. ... / .- .-. . / .-- .-. --- -. --. / ... --- -- . / .- .-. . / ..- ... . ..-. ..- .-..

FRIAM Applied Complexity Group listserv

Fridays 9a-12p Friday St. Johns Cafe   /   Thursdays 9a-12p Zoom https://bit.ly/virtualfriam

to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com

FRIAM-COMIC http://friam-comic.blogspot.com/

archives:  5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/

  1/2003 thru 6/2021  http://friam.383.s1.nabble.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://redfish.com/pipermail/friam_redfish.com/attachments/20250515/0f2799f2/attachment-0001.html>