<div dir="auto">I used to teach a course called "AI and expert systems" for management students at Carnegie Mellon. I remember that Mycin, a diagnosis system for infectious diseases and one of the most famous expert systems, had some explanation capability. According to Wikipedia, "<span style="color:rgb(32,33,34);font-family:-apple-system,blinkmacsystemfont,"segoe ui",roboto,lato,helvetica,arial,sans-serif;font-size:16px;background-color:rgb(255,255,255)">At the end, it [Mycin] provided a list of possible culprit bacteria ranked from high to low based on the probability of each diagnosis, its </span><a href="https://en.m.wikipedia.org/wiki/Confidence_interval" style="margin:0px;padding:0px;border:0px;line-height:inherit;font-family:-apple-system,blinkmacsystemfont,"segoe ui",roboto,lato,helvetica,arial,sans-serif;font-size:16px;vertical-align:baseline;background:none rgb(255,255,255);color:rgb(107,75,161);text-decoration-line:none">confidence</a><span style="color:rgb(32,33,34);font-family:-apple-system,blinkmacsystemfont,"segoe ui",roboto,lato,helvetica,arial,sans-serif;font-size:16px;background-color:rgb(255,255,255)"> in each diagnosis' probability, the reasoning behind each diagnosis..."</span><div dir="auto"><br><div data-smartmail="gmail_signature" dir="auto">But after publishing a few papers in the area I left that field. I assumed, mistakenly it seems, that later AI implementations did the same. Too bad.</div><div data-smartmail="gmail_signature" dir="auto"><br></div><div data-smartmail="gmail_signature" dir="auto">By the way, I realize, that AI systems can't assess non-respondent bias in the way it was done in Project Talent but perhaps there is some "machine readable" way to do it.</div><div data-smartmail="gmail_signature" dir="auto"><br></div><div data-smartmail="gmail_signature" dir="auto">---<br>Frank C. Wimberly<br>140 Calle Ojo Feliz, <br>Santa Fe, NM 87505<br><br>505 670-9918<br>Santa Fe, NM</div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 11, 2020, 9:05 AM David Eric Smith <<a href="mailto:desmith@santafe.edu">desmith@santafe.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space"><br><div><br><blockquote type="cite"><div>On Nov 11, 2020, at 8:54 AM, Frank Wimberly <<a href="mailto:wimberly3@gmail.com" target="_blank" rel="noreferrer">wimberly3@gmail.com</a>> wrote:</div><div><div dir="auto"><div dir="auto"><br></div><div dir="auto">Don't some AI systems include subsystems for explaining their reasoning?</div></div></div></blockquote><div><br></div><div>I don’t know how common that is, Frank. The few people I know who are active and skilled deep-learning practitioners have told me (if I have understood) that it is rare and limited. I spent some time looking at the zero-shot language translation, as something I wanted to convene at SFI, with the AI goal of unpacking what was the “universal language” internal representation, and with the linguistics goal of using it in cognate classification and historical reconstruction. Never could get a call-back from any of the google people. But I didn’t think at the time that zero-shot had been unpacked.</div><div><br></div><div>Probably some on this list know much more about the state of play.</div><div><br></div><div>Eric</div><br><blockquote type="cite"><div><div dir="auto"><div dir="auto"><br></div><div dir="auto">Happy Veterans Day,</div><div dir="auto"><br></div><div dir="auto">Frank<br><div dir="auto"><br><div data-smartmail="gmail_signature" dir="auto">---<br>Frank C. Wimberly<br>140 Calle Ojo Feliz, <br>Santa Fe, NM 87505<br><br>505 670-9918<br>Santa Fe, NM</div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 11, 2020, 3:25 AM David Eric Smith <<a href="mailto:desmith@santafe.edu" target="_blank" rel="noreferrer">desmith@santafe.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word;line-break:after-white-space">Friam poll:<div><br></div><div>How soon until classical telephone polling is just gone?</div><div><a href="https://www.nytimes.com/2020/11/10/upshot/polls-what-went-wrong.html" rel="noreferrer noreferrer" target="_blank">https://www.nytimes.com/2020/11/10/upshot/polls-what-went-wrong.html</a></div><div><br></div><div>If, as boasted, facebook knows when their users are pregnant before the users know, they know who someone supports and whether that person is likely to vote. </div><div><br></div><div>At this stage, trying to get accurate statistics from cold calls on the phone seems as quixotic as trying to infer something from the people who read books. But if there’s anything we can count on, it is that the number of people who don’t leave an internet fingerprint is too small to have any political impact at all.</div><div><br></div><div>How much effort they put into getting reliable calibrations will depend on what ways they see to monetize it, but the diversity of cash-outs should be nearly inexhaustible, for years to come.</div><div><br></div><div>So one more thing goes into what is both a black box and a private rather than public box. It will take over after the first few times it produces much more reliable results, but since we won’t know what it is based on — AIs don’t explain themselves — we will have no ability to extrapolate out of sample.</div><div><br></div><div>Eric</div><div><br></div><div><br></div></div>- .... . -..-. . -. -.. -..-. .. ... -..-. .... . .-. .<br>
FRIAM Applied Complexity Group listserv<br>
Zoom Fridays 9:30a-12p Mtn GMT-6 <a href="https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fbit.ly%2fvirtualfriam&c=E,1,MIlehtrxasGxzXCBAG-Wuptie4wVpHZCod2H9fKLPnfs1yGvGgHBDARSwVq4VdCdtzq4Dow-kWiVv4jc9hIVdl8zyYLkXNCJ81WlPwU_cCV-Wj_FaKxE&typo=1" rel="noreferrer noreferrer noreferrer" target="_blank">bit.ly/virtualfriam</a><br>
un/subscribe <a href="https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailman%2flistinfo%2ffriam_redfish.com&c=E,1,eEyTIKAnKXKW32Kg5QjvWagEgRoLZi2PtyoqSEHHUN3kS4q1_QFqepVMevdBzSM8Z9F4aZohLrRrIwqCA-ExUAfBhUBVHO7gf4xaB87f6I6MuI4i&typo=1" rel="noreferrer noreferrer noreferrer" target="_blank">http://redfish.com/mailman/listinfo/friam_redfish.com</a><br>
archives: <a href="http://friam.471366.n2.nabble.com/" rel="noreferrer noreferrer noreferrer" target="_blank">http://friam.471366.n2.nabble.com/</a><br>
FRIAM-COMIC <a href="https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspot.com%2f&c=E,1,owZjlS1njud5BssZPtYtW4jYIrQySTobJWmn1LQwCyeJUf-KLCb4RIvTldGJmHVC8OL-2OunE-nqJmBcsyFM7sBJTgDRQlvwtgQpNHs3-mBAwQlugck,&typo=1" rel="noreferrer noreferrer noreferrer" target="_blank">http://friam-comic.blogspot.com/</a> <br>
</blockquote></div>
- .... . -..-. . -. -.. -..-. .. ... -..-. .... . .-. .<br>FRIAM Applied Complexity Group listserv<br>Zoom Fridays 9:30a-12p Mtn GMT-6 <a href="http://bit.ly/virtualfriam" target="_blank" rel="noreferrer">bit.ly/virtualfriam</a><br>un/subscribe <a href="https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailman%2flistinfo%2ffriam_redfish.com&c=E,1,ZhFECaCEstC6R1KARgPxbu9IEAqI9wjTi65WxBGjDM4gwbxMCgeSOBQ2EKWK35vV6tuhdQlPpQ3q0AmGgUXMwPCscl0M5mPqvGm002E2VyScyzizkyplPu9NMaOH&typo=1" target="_blank" rel="noreferrer">https://linkprotect.cudasvc.com/url?a=http%3a%2f%2fredfish.com%2fmailman%2flistinfo%2ffriam_redfish.com&c=E,1,ZhFECaCEstC6R1KARgPxbu9IEAqI9wjTi65WxBGjDM4gwbxMCgeSOBQ2EKWK35vV6tuhdQlPpQ3q0AmGgUXMwPCscl0M5mPqvGm002E2VyScyzizkyplPu9NMaOH&typo=1</a><br>archives: <a href="http://friam.471366.n2.nabble.com/" target="_blank" rel="noreferrer">http://friam.471366.n2.nabble.com/</a><br>FRIAM-COMIC <a href="https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspot.com%2f&c=E,1,bcNwVv6Xg-iYdul8iBL7SSR37PBueIDjkSji3dd3y4G3o_reGRlxBEs9K8ZfZPNKeOYrtHreLpQMofHuId25yG_iN3xq5W7MgsWxOvjO&typo=1" target="_blank" rel="noreferrer">https://linkprotect.cudasvc.com/url?a=http%3a%2f%2ffriam-comic.blogspot.com%2f&c=E,1,bcNwVv6Xg-iYdul8iBL7SSR37PBueIDjkSji3dd3y4G3o_reGRlxBEs9K8ZfZPNKeOYrtHreLpQMofHuId25yG_iN3xq5W7MgsWxOvjO&typo=1</a> <br></div></blockquote></div><br></div>- .... . -..-. . -. -.. -..-. .. ... -..-. .... . .-. .<br>
FRIAM Applied Complexity Group listserv<br>
Zoom Fridays 9:30a-12p Mtn GMT-6 <a href="http://bit.ly/virtualfriam" rel="noreferrer noreferrer" target="_blank">bit.ly/virtualfriam</a><br>
un/subscribe <a href="http://redfish.com/mailman/listinfo/friam_redfish.com" rel="noreferrer noreferrer" target="_blank">http://redfish.com/mailman/listinfo/friam_redfish.com</a><br>
archives: <a href="http://friam.471366.n2.nabble.com/" rel="noreferrer noreferrer" target="_blank">http://friam.471366.n2.nabble.com/</a><br>
FRIAM-COMIC <a href="http://friam-comic.blogspot.com/" rel="noreferrer noreferrer" target="_blank">http://friam-comic.blogspot.com/</a> <br>
</blockquote></div>