<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
Cerebras says they can scale past 1 trillion parameters..
<div><br>
</div>
<div>
<div style="display: block;" class="">
<div style="-webkit-user-select: all; -webkit-user-drag: element; display: inline-block;" class="apple-rich-link" draggable="true" role="link" data-url="https://www.hpcwire.com/2021/08/24/wafer-scale-to-brain-scale-cerebras-touts-linear-scaling-for-up-to-192-cs-2-systems/">
<a style="border-radius:10px;font-family:-apple-system, Helvetica, Arial, sans-serif;display:block;-webkit-user-select:none;width:300px;user-select:none;-webkit-user-modify:read-only;user-modify:read-only;overflow:hidden;text-decoration:none;" class="lp-rich-link" rel="nofollow" href="https://www.hpcwire.com/2021/08/24/wafer-scale-to-brain-scale-cerebras-touts-linear-scaling-for-up-to-192-cs-2-systems/" dir="ltr" role="button" draggable="false" width="300">
<table style="table-layout:fixed;border-collapse:collapse;width:300px;background-color:#E9E9EB;font-family:-apple-system, Helvetica, Arial, sans-serif;" class="lp-rich-link-emailBaseTable" cellpadding="0" cellspacing="0" border="0" width="300">
<tbody>
<tr>
<td vertical-align="center" align="center"><img style="width:300px;filter:brightness(0.97);height:139px;" width="300" height="139" draggable="false" class="lp-rich-link-mediaImage" alt="Cerebras-MemoryX-SwarmX-CS-2_banner.png" src="cid:EDD9AE3F-3500-4577-BE0C-957A51093745"></td>
</tr>
<tr>
<td vertical-align="center">
<table bgcolor="#E9E9EB" cellpadding="0" cellspacing="0" width="300" style="font-family:-apple-system, Helvetica, Arial, sans-serif;table-layout:fixed;background-color:rgba(233, 233, 235, 1);" class="lp-rich-link-captionBar">
<tbody>
<tr>
<td style="padding:8px 0px 8px 0px;" class="lp-rich-link-captionBar-textStackItem">
<div style="max-width:100%;margin:0px 16px 0px 16px;overflow:hidden;" class="lp-rich-link-captionBar-textStack">
<div style="word-wrap:break-word;font-weight:500;font-size:12px;overflow:hidden;text-overflow:ellipsis;text-align:left;" class="lp-rich-link-captionBar-textStack-topCaption-leading">
<a rel="nofollow" href="https://www.hpcwire.com/2021/08/24/wafer-scale-to-brain-scale-cerebras-touts-linear-scaling-for-up-to-192-cs-2-systems/" style="text-decoration: none" draggable="false"><font color="#000000" style="color: rgba(0, 0, 0, 1);">Wafer Scale
to ‘Brain-Scale’ – Cerebras Touts Linear Scaling up to 192 CS-2 Systems</font></a></div>
<div style="word-wrap:break-word;font-weight:400;font-size:11px;overflow:hidden;text-overflow:ellipsis;text-align:left;" class="lp-rich-link-captionBar-textStack-bottomCaption-leading">
<a rel="nofollow" href="https://www.hpcwire.com/2021/08/24/wafer-scale-to-brain-scale-cerebras-touts-linear-scaling-for-up-to-192-cs-2-systems/" style="text-decoration: none" draggable="false"><font color="#A2A2A9" style="color: rgba(60, 60, 67, 0.6);">hpcwire.com</font></a></div>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</a></div>
</div>
<div><br>
</div>
That would be a power budget of a HPC center, but not out of the ordinary. Less than 10 MW. AWS, Azure, Google and national labs have facilities like that.</div>
<div>
<div dir="ltr"><br>
<blockquote type="cite">On Jan 18, 2023, at 12:41 AM, Pieter Steenekamp <pieters@randcontrols.co.za> wrote:<br>
<br>
</blockquote>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">I totally agree that realizable behavior is what matters.<br>
<br>
The elephant in the room is whether AI (and robotics of course) will (not to replace but to) be able to do better than humans in all respects, including come up with creative solutions to not only the world's most pressing problems but also small creative things
like writing poems, and then to do the mental and physical tasks required to provide goods and services to all in the world,<br>
<br>
Sam Altman said there are two things that will shape our future; intelligence and energy. If we have real abundant intelligence and energy, the world will be very different indeed.
<div><br>
</div>
<div>To quote Sam Altmen at <a href="https://economictimes.indiatimes.com/tech/startups/intelligence-energy-sam-altmans-technology-predictions-for-2020s/articleshow/86088731.cms">https://economictimes.indiatimes.com/tech/startups/intelligence-energy-sam-altmans-technology-predictions-for-2020s/articleshow/86088731.cms</a>
: <span style="color:rgb(0,0,0);font-family:Montserrat,sans-serif;font-size:12px">
<br>
<br>
"intelligence and energy have been the fundamental limiters towards most things we want. A future where these are not the limiting reagents will be radically different, and can be amazingly better."</span></div>
<br style="background:transparent;font-size:12px;margin:0px;outline:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0);font-family:Montserrat,sans-serif">
<div style="background:transparent;font-size:12px;margin:0px;outline:0px;padding:0px;vertical-align:baseline;color:rgb(0,0,0);font-family:arial">
<br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, 18 Jan 2023 at 03:06, Marcus Daniels <<a href="mailto:marcus@snoutfarm.com">marcus@snoutfarm.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Definitions are all fine and good, but realizable behavior is what matters. Analog computers will have imperfect behavior, and there will be leakage between components. A large network of transistors or neurons are sufficiently similar for my purposes.
The unrolling would be inside a skull, so somewhat isolated from interference.<br>
<br>
-----Original Message-----<br>
From: Friam <<a href="mailto:friam-bounces@redfish.com" target="_blank">friam-bounces@redfish.com</a>> On Behalf Of glen<br>
Sent: Tuesday, January 17, 2023 2:11 PM<br>
To: <a href="mailto:friam@redfish.com" target="_blank">friam@redfish.com</a><br>
Subject: Re: [FRIAM] NickC channels DaveW<br>
<br>
I don't quite grok that. A crisp definition of recursion implies no interaction with the outside world, right? If you can tolerate the ambiguity in that statement, the artifacts laying about from an unrolled recursion might be seen and used by outsiders. That's
not to say a trespasser can't have some sophisticated intrusion technique. But unrolled seems more "open" to family, friends, and the occasional acquaintance.<br>
<br>
On 1/17/23 13:37, Marcus Daniels wrote:<br>
> I probably didn't pay enough attention to the thread some time ago on serialization, but to me recursion is hard to distinguish from an unrolling of recursion.<br>
<br>
-- <br>
ꙮ Mɥǝu ǝlǝdɥɐuʇs ɟᴉƃɥʇ' ʇɥǝ ƃɹɐss snɟɟǝɹs˙ ꙮ<br>
<br>
-. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. .<br>
FRIAM Applied Complexity Group listserv<br>
Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom <a href="https://bit.ly/virtualfriam" rel="noreferrer" target="_blank">
https://bit.ly/virtualfriam</a><br>
to (un)subscribe <a href="http://redfish.com/mailman/listinfo/friam_redfish.com" rel="noreferrer" target="_blank">
http://redfish.com/mailman/listinfo/friam_redfish.com</a><br>
FRIAM-COMIC <a href="http://friam-comic.blogspot.com/" rel="noreferrer" target="_blank">
http://friam-comic.blogspot.com/</a><br>
archives: 5/2017 thru present <a href="https://redfish.com/pipermail/friam_redfish.com/" rel="noreferrer" target="_blank">
https://redfish.com/pipermail/friam_redfish.com/</a><br>
1/2003 thru 6/2021 <a href="http://friam.383.s1.nabble.com/" rel="noreferrer" target="_blank">
http://friam.383.s1.nabble.com/</a><br>
-. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. .<br>
FRIAM Applied Complexity Group listserv<br>
Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom <a href="https://bit.ly/virtualfriam" rel="noreferrer" target="_blank">
https://bit.ly/virtualfriam</a><br>
to (un)subscribe <a href="http://redfish.com/mailman/listinfo/friam_redfish.com" rel="noreferrer" target="_blank">
http://redfish.com/mailman/listinfo/friam_redfish.com</a><br>
FRIAM-COMIC <a href="http://friam-comic.blogspot.com/" rel="noreferrer" target="_blank">
http://friam-comic.blogspot.com/</a><br>
archives: 5/2017 thru present <a href="https://redfish.com/pipermail/friam_redfish.com/" rel="noreferrer" target="_blank">
https://redfish.com/pipermail/friam_redfish.com/</a><br>
1/2003 thru 6/2021 <a href="http://friam.383.s1.nabble.com/" rel="noreferrer" target="_blank">
http://friam.383.s1.nabble.com/</a><br>
</blockquote>
</div>
<span>-. --- - / ...- .- .-.. .. -.. / -- --- .-. ... . / -.-. --- -.. .</span><br>
<span>FRIAM Applied Complexity Group listserv</span><br>
<span>Fridays 9a-12p Friday St. Johns Cafe / Thursdays 9a-12p Zoom https://bit.ly/virtualfriam</span><br>
<span>to (un)subscribe http://redfish.com/mailman/listinfo/friam_redfish.com</span><br>
<span>FRIAM-COMIC http://friam-comic.blogspot.com/</span><br>
<span>archives: 5/2017 thru present https://redfish.com/pipermail/friam_redfish.com/</span><br>
<span> 1/2003 thru 6/2021 http://friam.383.s1.nabble.com/</span><br>
</div>
</blockquote>
</div>
</body>
</html>