[FRIAM] ChatGPT is not very smart...

[Santafe]

So probably this has all been analyzed to death already, by people who, unlike me, know what they are talking about.

But in re-reading it, I feel like the structure of the problem is characterizable.  

It is as if “facts” that are constraints on the sentences to be composed are ordered in a way that is somewhat like lexicographic ordering.  

Lexicographically, azzzzzzz is before zaaaaaaa; no subsequent letters even get consideration (much less the set of them all in aggregate), until the first letter has dictated as much of the sorting as its values can index.

Likewise, somewhere chatGPT was stuck in a local valley, where there was a “fact” that a particular list of two states is “the core of the answer” to this set of questions, and membership in the list is the first condition in a selection-tree for replies.  However tortured, the following sentences have to operate within a reality that has already been truncated by the “first fact”.

(Again, since this is obvious, my even belaboring it is kind of dull once I see it on the page.)

Come to think of it, it reminds me too of Vygotsky’s claim that children first assign category terms by what he called “family resemblances”, and only later at the age where some developmental threshold is crossed, do they form “predicates” in the sense we would use the term in langauge semantics.  “Family resemblances” can be, effectively, anything, are very idiosyncratic to the experiential history of any particular child-in-context, and in that sense are fragile categories.  The distinction in predicates, once they emerge, is that they seem to be much less fragile, which amounts to being exchangeable across thinkers and across situations for a single thinker.

As predicates, membership-in-a-list, letter-count, being-a-state-name, are of quite unlike types.  As there is a kind of Venn-diagram intersection logic that can be applied to letter-count and being-a-state-name, which does not exist in general form for membership in arbitrary lists, we learn that the latter predicates should get priority in navigating streams of thoughts and of sentences.  But if, to chatGPT, those are not yet predicates, but rather various modes of family resemblance, all comparably eligible, one can scan how a dialog of the below form would be a derivable outcome.

If that is the right analysis, the step of getting stuck in a pre-emptive membership-in-a-list commitment is not the revealing, or by that criterion the interesting, part of the dialog below.  The interesting part becomes the suddenly much-higher need for “cleverness”, to find flowing sentences that can be forced to the far side of an unresolvable contradiction.  It’s like my laptop, when some internet-check-in step becomes unsatisfiable, and it will dump more and more CPU into trying to do something that got mis-configured, the fan ramps up, and this will spiral indefinitely until I stop what I am doing to kill the offending process.  One can imagine that “learning” what predicates “are”, that they “have” logics, and what those logics “are”, is a feedback loop of trying to avoid the mental costs of getting into blind alleys.  The deeper the backtrack to find the unbinding choice, the harder the learning program is, until we get up to scientific categories, where it becomes quite difficult to recognize that we had invalid meanings for “time”, “space”, and “state”.  But a kind of continuous process of rewarding laziness across all those levels of organization of thought.

I also, of course, cannot keep out of mind the George Santos characters or similar pathological liars, who live full-time in this navigating-snags mode.  Police interrogators think they can wear even pathological liars down — catch them out — because the effort level is high enough that eventually nobody can sustain it.  But at the same time, humans have a wide talent range for different tasks, and I could believe that for the pathological liar, this snag-navigating can be done much more fluently and with lower effort, than the same degree of performance would demand of a “normie”.

All the above feels about as satisfying as listening to somebody explain a joke.  Oh well.

Eric


> On Feb 2, 2023, at 1:49 PM, Barry MacKichan <barry.mackichan at mackichan.com> wrote:
> 
> or is obsessed with four-letter words. From an email from another group. Paragraphs with an initial capital are ChatGPT’s responses. The others are input:
> 
> Chat GPT dialog, courtesy of Paul Ginsparg:
> 
> 
> “how many states in the united states have four letter names?
> 
> “There are actually two states in the United States that have four-letter names: Iowa and Ohio. Both states were named after Native American words, with Iowa derived from the word "ayuxba," which means "this is the place," and Ohio coming from the Iroquois word "ohi-yo," meaning "great river.
> 
> “what about utah?
> 
> “Utah is not a four-letter word. It is a state in the western United States, named after the Ute tribe of Native Americans. The word "Utah" is derived from the Ute word "yuttahih," which means "people of the mountains."
> 
> “how many letters does utah have?
> 
> “The word "Utah" has four letters. It is the name of a state in the western United States, known for its natural beauty, including parks like Arches National Park and Bryce Canyon National Park. The state was named after the Ute tribe of Native Americans and has a rich history and culture.
> 
> “then why did you say utah is not a four-letter word?
> 
> “I apologize if my previous response was unclear. I did not mean to imply that the word "Utah" is not a valid word or that it does not refer to the state in the United States. My previous response was intended to address the specific question of whether Utah was one of the states in the United States with a four-letter name. As I mentioned, there are only two states in the United States with four-letter names: Iowa and Ohio. Utah, while it is a four-letter word, is not one of those states. I apologize if my previous response was confusing. Please let me know if you have any other questions.
> 
> “but didn't you just say that the word utah has four letters and is a state in the united states?
> 
> “Yes, that is correct. The word "Utah" has four letters. As I mentioned in my previous response, it is the name of a state in the western United States. The state was named after the Ute tribe of Native Americans and is known for its beautiful landscapes and outdoor recreational opportunities. I apologize if my previous response was unclear. My previous response was intended to address the specific question of whether Utah was one of the two states in the United States with four-letter names. As I mentioned, there are only two states with four-letter names: Iowa and Ohio. While "Utah" is a four-letter word, it is not one of those states. I apologize for any confusion. Please let me know if you have any other questions
> 
> —Barry
> 
> -. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. .
> FRIAM Applied Complexity Group listserv
> Fridays 9a-12p Friday St. Johns Cafe   /   Thursdays 9a-12p Zoom https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fbit.ly%2fvirtualfriam&c=E,1,pkzJoqS7ZJSzrO3fkN3B7sE6VWNyJ70z7kBaJSIyNmJMVK3pczt5BelHF5-orSU-i-6g2NDKjf0gaQNoqdD-wtD73p-DgqZACvtKa29pzw,,&typo=1
> to (un)subscribe https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailman%2flistinfo%2ffriam_redfish.com&c=E,1,L_i-AoHvwYSpaBKqz2Q8_yjYjplPNbB8mQZgxKgubB_G6XIg1hjyBIh0iBS4u0sZNVzRfy0kng127VZj5tkotrkMgaNPfXrlZ-LuYiniFNpqaWHTndw2lcP37l4,&typo=1
> FRIAM-COMIC https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspot.com%2f&c=E,1,eGnmPRPtDigLRI0mT2nwSTQXV4MtPKpcfrtiOzQBcPYhBUmOwLm_ct3B8V2bWtB0KyrvxFMqyIJuy-RAJCe5YAs1nK8-VmwiD5bE6dbw8Os,&typo=1
> archives:  5/2017 thru present https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fredfish.com%2fpipermail%2ffriam_redfish.com%2f&c=E,1,Xck2nPoNRcuVwcyW4_Tf7wHv16URawm1GvFSlSgT2cWkzJH56wdA-iRCPQNdmPzbhZ0UNFvBECjAqUj4KmVF_u7J1RUv5hmMaNlAWJyJ_mnXL9c,&typo=1
>  1/2003 thru 6/2021  http://friam.383.s1.nabble.com/