Article URL: https://blog.semenzin.com/let-the-machines-in/ Comments URL: https://news.ycombinator.com/item?id=49147890 Points: 21 # Comments: 8

“From each art practiced in its time I derive a knowledge which compensates me in part for pleasures lost. I have supposed, and in my better moments think so still, that it would be possible in this manner to participate in the existence of everyone; such sympathy would be one of the least revocable kinds of immortality.” Marguerite Yourcenar, Memories of Hadrian “It’s very difficult to make predictions, especially about the future” reads an adage often attributed to Niels Bohr. I quote it often as a tongue-in-cheek way to commiserate about the difficulties of working in a line of business where attempting to predict the future is a daily task (I run an AI company). My husband maintains that the very fabric of the universe is irony. The fact that statistical next-token prediction machines are now dominating our construction of what the future will be (and as such, shaping our very present) is a bizarre turn of events that Douglas Hofstadter himself wouldn’t probably object to calling a Strange Loop: it’s very difficult to make predictions, especially about the future, especially when prediction itself is the future. I have been obsessed with artificial intelligence since I was a kid, like so many others: who amongst us who have experienced the rigorous and intoxicating joy of computation hasn’t drawn a throughline to thinking and intelligence themselves? Leibniz might have been first, but any programmer worth their salt ought to have wondered, at a point or another, how did the thing that they were getting these algid machines to do, this rigid and procedural execution of instructions, relate to their own thinking? And while the aspiration of mechanizing though is older than the field of computer science by a good margin, the advent of computers is what made that aspiration tangible. It’s called a Turing test for a reason. And yet, if I survey the scientists, researchers, software engineers, neuroscientists and psychologists that I get to call my friends, almost no-one can in good faith say that they expected that the answer to our hopes for a mechanical intelligence would just come from a combination of statistics and scale. LLMs are a bizarre turn of events. One that indeed ought to humble our very notions of originality and uniqueness, shedding light on how conventional, middle-of-the-bell-curve most of our existences are. After a bunch of AI winters, it turned out that a remarkable degree of what makes us human can be expressed just by a bunch of weights in a large-scale neural network. Eat your heart out Minsky, Lenat and Chomsky. This dizzying realization has set off a market frenzy – as it would-, as well as a reckoning around the inevitable questions on the very nature of intelligence – as it should. That intelligence can take many forms is an ill-defined truism that never fails to galvanize a dinner party; yet while most of us would embrace that notion without flinching, most of us also balked when machines started to exhibit intelligent traits. While modern LLMs are unable to perform a double pike or reason about space or time the way our brains can, they surely can debug a production issue. No matter the fact that our brains can process thoughts for a minuscule fraction of the energy expenditure of Claude or ChatGPT, we are finding that there is a pathway to arrive to intellectual result just the same. This is an incredible – and to some, unbelievable – outcome.