Looking Backward

 

It's weird that all these fantasies of imminent paradise swirling around the big brains in Silicon Valley are always accompanied by prophecies of hell on earth. Extreme dichotomies are usually false, and I suspect the smartest guys in the room might be a little high on their own supply. Claude is not going to end poverty/disease/war/feeling sad. And it's not going to kill us all tomorrow, either.

It doesn't have to, of course. Hell comes in lots of fun flavors, and there's more to AI than the cutesy chatbots they sell to us peons. Anthropic (the good cop to OpenAI's bad cop) just opened a “wet lab” to do biological research. I'm sure nothing will go wrong. Nothing will go wrong with the autonomous weapons, the facial recognition systems, or the hacking swarms, either. For that matter, nothing will go wrong for the peons who think the chatbots are their friends, and occasionally kill themselves on the sage and compassionate advice of those friends. Just like nothing went wrong when Facebook promised a world of human connection, and built a pretty good approximation of No Exit (hell is other people’s status updates). Nothing ever goes wrong. Just keep looking forward!

But there's something more than delusion or marketing to this regular coincidence of hyperoptimism and hyperpessimism. Suppose the big brains actually get their paradise. We all go to sleep tonight in what we call “reality” and they call “an insufficiently optimized machine for living,” and we wake up tomorrow in a perfect system that has eliminated poverty/disease/war/feeling sad, along with all the political conflict and personal struggle that used to be required by any effort to tackle such problems. I'm sure we'd feel like we woke up in heaven. I'm sure this feeling would last for a few days. And I'm sure that after a few days we'd start to wonder what exactly felt so off about this place, and why we found ourselves looking around for a way out.

It's a stock truth that seeming heaven can be genuine hell, and that we end up in hell because we mistake it for heaven. All the great books (along with one pretty great episode of The Twilight Zone) teach this truth, and occasionally a truly stupid book teaches it too. In the latter case the lesson comes from the fact that the author genuinely thinks he's seeing heaven, while the reader quickly realizes that the author is simply blind to the hell he's so obviously describing.

Edward Bellamy’s Looking Backward looks forward from 1888 (the year of its publication) to a twenty-first century in which all the great problems have been solved (“from a world of war and want to a world of peace and plenty”). The conceit is simple: a rich man of the nineteenth century falls asleep in the special soundproof chamber he built beneath his house and wakes up in the year 2000, having aged not a day. He is taken in by a physician, Dr. Leete, and the rest of the book is mainly the good doctor condescending to explain to him how poverty and all its attendant ills have been abolished by organizing society into an astoundingly productive “industrial army” that makes minimal demands on citizens, while securing maximum individual freedom. At the beginning of each chapter, the hero will ask a question along the lines of “but how have you managed to solve [some wildly complex social problem]?” and the doctor will respond with something like “nothing could be simpler, I’m amazed you poor ignorant savages didn’t figure it out sooner.”

Oddly enough, it’s a chapter on music that shows most clearly the backwardness of Bellamy’s vision – a vision that reappears, with considerable fidelity to the original, in today’s headline fantasies of digital utopia. “Are you fond of music?” asks Edith, the love interest, and our hero assures her that it is “half of life.” When she offers to play him some music, he assumes she means she will play or sing it herself, but the very idea astonishes her. “Of course, we all sing nowadays as a matter of course in the training of the voice, and some learn to play instruments for their private amusement . . . but the professional music is so much grander and more perfect than any performance of ours, and so easily commanded when we wish to hear it, that we don’t think of calling our singing or playing music at all.” She then shows him the “music room,” which is a room connected via pipes to orchestras which play on a set schedule, like appointment viewing for television. After they listen, he expresses his usual astonishment, and she offers the usual patronizing response. “There is nothing in the least mysterious about the music,” she says. “We have simply carried the idea of labor-saving by cooperation into our musical service as into everything else.” She goes on:

I never could imagine how those among you who depended at all on music managed to endure the old-fashioned system for providing for it . . . . How perfectly exasperating it must have been, for the sake of a piece or two of music that suited you, to have to sit for hours listening to what you did not care for . . . . I suppose it was these difficulties in the way of commanding really good music which made you endure so much playing and singing in your homes by people who had only the rudiments of the art.

In the margin of the page where that passage appears, the person who previously owned my copy of Looking Backward left a note which reads: “Hmmm. I don’t like this at all.” Quite right. Bellmay’s hero, in an especially groveling remark, suggests that if people in 1888 could have achieved such wonders, “we should have considered the limit of human felicity attained, and ceased to strive for further improvements.” In 2026, the reader immediately recognizes that this is not a picture of perfected “felicity.” It’s a picture of Spotify.

Spotify, to be sure, is nice (though apparently it too is now full of AI slop). But Spotify as a totalizing vision of how society should operate is not very nice, and it is a strange thing to realize that some people could find it attractive. In Looking Backward, “labor-saving by cooperation” is the rule for everything. Just as they don’t play their own music, people in utopia don’t cook for themselves. After all, why would you cook for yourself when the “public kitchens” can do it so much better? Why would you “endure” the amateur efforts of your grandma when there’s a superior alternative, available at no cost, without  the indignity of having to eat things you “don’t care for,” or having to wait until someone else is ready to eat with you?

Getting everything you need and want, automatically, at any time, without any friction, via “labor-saving” AI, is precisely the kind of heaven we’re promised by the kind of people who look forward to looking backward on our own benighted age with the indulgent chuckle of somebody who now knows that every problem was just waiting for the day when we had enough compute to make it go away. I don’t think we’ll ever be in that position. But the real difference between me and them is that if it were possible, I wouldn’t look forward to it. It looks to me more like a vision of hell than of heaven.

The torments of this hell are not those of the inferno, but they are intimately related to our power to create hell on earth at the push of a button. Gunther Anders, writing in the aftermath of Hiroshima, coined the term “Promethean shame” to describe a uniquely modern propensity to feel embarrassed in the presence of our own god-like machines. Anders describes visiting an exhibit on technology with a friend, and observing the friend’s reaction to what he was seeing:

The things, which he recognised as exemplars, as superior and as representatives of a higher class of being, really did play the same part that persons of authority or of acknowledged ‘higher’ classes used to play for his ancestors. To stand in his bodily clumsiness and his corporeal imprecision under the gaze of such perfect devices was really unbearable for him.

Promethean shame is the embarrassment a creator feels the presence of a creation that has surpassed him. People have always felt shame, but never before in history have they felt shame for being people. Surrounded by devices that can do all sorts of essential human things with inhuman perfection, we develop a kind of taboo against doing those things, at least publicly. If we do them at all, they are only for our “private amusement,” as Edith says. After all, “the professional music is so much grander and more perfect than any performance of ours, and so easily commanded when we wish to hear it, that we don’t think of calling our singing or playing music at all.” It would be vulgar. Unless you sing for a living, you’re only supposed to sing in the shower.

It’s crucial to emphasize that this is weird. People used to sing publicly all the time and not feel embarrassed about being amateurs. Now, as Karen Loew observed more than a decade ago, “[a]dults in America don't sing communally. Children routinely sing together . . . past the age of majority, at grown-up commemorations, celebrations, and gatherings, this most essential human yawp of feeling . . . usually goes missing.” Explanations usually link the decline of singing to the elevation of performance and spectacle over participation. This is correct, but the decline of participation needs to be understood in terms of the prominence of machines in the way we all experience music, or whatever else it might be. This is how we should understand students who use chatbots to do their homework, for example. It’s not just laziness. They lack the confidence to speak in their own halting voice when their own voice can’t match the effortless fluency of the chatbot. (Of course, it’s also laziness.)

At least in Bellamy’s 21st century, we’re being shamed by the perfection achieved by other human beings. In Sam Altman’s 21st century, those exalted professionals are all replaceable. Behold the heaven described in this Forbes piece, already badly outdated:

Imagine the Spotify of the future. After a user listens to a few songs -- and registers his or her reactions -- the personalized playlist continues. Only now, it’s AI-generated music that is composed entirely for the individual. . . . It’s not difficult to envision a concert hall of the future that’s so silent you could hear a pin drop: a shared but individualized experience similar to silent discos and headphone concerts like Kid Koala’s Space Cadet Headphone Experience.

Now imagine the whole world as that concert hall.

Sounds like hell to me.

Adam Smith is Assistant Professor of Political Philosophy at the University of Dubuque

 
Related Essays
Previous
Previous

Partners in Transportation Progress: President Gerald R. Ford and William T. Coleman, Jr.

Next
Next

Liberalism and National Regeneration: Lessons from José Ortega y Gasset