[FRIAM] Datasets as Experience

[Marcus Daniels]

I don't know what Bing uses for storage, or how it relates to OpenAI's added codebase.   There are older references to use of TensorFlow at OpenAI, but things may have changed.   The "file" would likely be the serialization of the (distributed) tensors of the ChatGPT model.   One possible way storage works is with Azure Blobs but I see they also use more conventional POSIX-like filesystems like Lustre.   I'm not sure what the point of your remark is.   It seems obvious to me a well-placed data engineer at Microsoft could identify the exact scope of the secondary storage of Bing's neural networks.   My point is that passable cultural knowledge will probably fit in a rack of disk drives (or maybe even a few?).   I find that humorous, but I'm told unusual things amuse me.  

-----Original Message-----
From: Friam <friam-bounces at redfish.com> On Behalf Of glen
Sent: Wednesday, February 8, 2023 12:54 PM
To: friam at redfish.com
Subject: Re: [FRIAM] Datasets as Experience

Ha! It's cool you used the phrase "a set of files". What does "file" mean? I mean, hell, we can't really even well-define "set". The other day, some internet person was complaining that they wanted to leave Twitter now that Elno's taken it to hell. But they needed a Delete. I took the liberty of explaining that you can only delete things if there's only 1 of that thing. Any distributed implementation, at best, makes deletion difficult or, at worst, impossible. My example was a journaling file system, a boon for irresponsible "rm -rf *" people and data forensics, but a bane for Elno-types. We're so lost in metaphor, we can't even see our hand in front of our face.

On 2/8/23 11:47, Marcus Daniels wrote:
> I read that Bing won’t write a cover letter if asked.  I love the idea of a set of files sitting on a filesystem at Microsoft that represent human ethics.  It reminds me of people that complain about being characterized by their skill sets.  I think we are going to learn just how little we are.

-- 
ꙮ Mɥǝu ǝlǝdɥɐuʇs ɟᴉƃɥʇ' ʇɥǝ ƃɹɐss snɟɟǝɹs˙ ꙮ

-. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. .
FRIAM Applied Complexity Group listserv
Fridays 9a-12p Friday St. Johns Cafe   /   Thursdays 9a-12p Zoom https://bit.ly/virtualfriam
to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com
FRIAM-COMIC http://friam-comic.blogspot.com/
archives:  5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/
  1/2003 thru 6/2021  http://friam.383.s1.nabble.com/