Grab all they can

Music from your formative years stays with you — generally in latent form, but at other times echoing resurgently through the amorphous cycles of nostalgia that stretch out into decades.

For me, it was the era of The Sisters of Mercy, New Order, The Psychedelic Furs, and Depeche Mode. Listening to the old LPs sometimes occasions a near-electric jolt when stanzas that seemed obscure are suddenly infused with stunning up-to-the-moment relevance. Stuck inside of Memphis with the mobile home, sing…

Several days ago, I noticed a new Metaculus question with a curious, almost clickbait-worthy title, When will we meet grabby aliens?

The reference is to a recent paper by Hanson, Martin, McCarter and Paulson that has been getting traction in response to write-ups by Scott Aronson and others. Hanson et al.’s abstract rebrands as “grabby”, a subset of extraterrestrials that would appear to bear certain similarities to the antagonists in Starship Troopers.

The parameters of the GC model determine how fast and in what manner space-time fills up with grabby civilizations, and are specified by (1) the rate at which grabby civilizations emerge, (2) the rate at which they expand, and (3) the number of “hard steps” (bottlenecks) in the so-called Great Filter, whatever it is that prevents non-living matter from making the transition to living matter.

The Hanson et al. abstract strikes me as a more or less point-by-point rephrasing of Everything Counts by Depeche Mode. Aside from the line about Korea (maybe misheard along the lines of “Here we are now in containers”?) everything in the song is fully relevant.

The grabbing hands grab all they can
All for themselves, after all
It’s a competitive world

Given the model assumptions, grabby civilizations blister out within the universe in a manner determined by the values of the three parameters. The paper has an attractive figure that illustrates one particular outcome, with 193 randomly candy-coated GCs appearing over several Hubble Times across a 2D slice 41.7 billion light years on a side.

The paper’s take-away argument is that we’re living at some point in the clear space above the GC surfaces, and at some point in the future we’ll either become a GC or we’ll be steamrolled by one. Moreover, it’s argued that at the present moment, it’s likely that a “third to a half of the universe is within grabby-controlled volumes.” Hmm.

The Metaculus question asks for predictions of the probability distribution over the number of years before we or our descendants encounter a GC. At the moment, the median of the community PDF is a staggering 22.7 billion years, with a significant peak at 2 billion years. Clearly, the emerging consensus is that this question might take a while to resolve.

Herman Bondi, Tommy Gold and Fred Hoyle’s steady state theory of cosmology introduced the so-called perfect cosmological principle, which holds that the universe is homogeneous and isotropic in both space and time. Two papers outlining the their theory appeared in 1948, and maintained considerable influence until evidence that the Big Bang occurred became incontrovertible. A satisfying anecdote relates that the steady-state theory was inspired by the circular plot of the British post-war horror film, The Dead of Night.

If a horror movie can act as the aesthetic pivot for a debunked cosmological theory, it stands to reason that Depeche Mode may have pointed toward the resolution of the Fermi Paradox. The key lies in the fact that if it’s a competitive world, then

Everything counts in large amounts.

When one talks about aliens and grabby extraterrestrial civilizations, one is really talking about computation. And if grabby computation is irreversible and device-based, then planets are really nowhere. They just don’t matter. A wind of catalyzed nano-devices within the outflow from a single dust-spewing extreme asymptotic giant branch star can accomplish of order 10^62 bit operations, a factor of ten million times more than a “habitable” planet can muster over 5 billion years if totally covered with solar panels. Again, when it comes to the big picture, planets are completely irrelevant.

Here’s a link to our working paper, The Black Clouds, which discusses how extreme Asymptotic Giant Branch stars can be commandeered in the service of computation. We might just be immersed in a colored region, and the WISE sources in the Mollweide projection above might just be our unfriendly local GC.

Or, as the song says,

Confidence taken in
By a suntan and a grin
.

Metaculus

A few years ago, I put up several posts describing Metaculus, the online prediction site that I co-founded with Anthony Aguirre and several other partners. In the interim, the site has grown substantially. It’s now logged roughly half a million predictions from a community of more than 10,000 users on a panoply of nearly 7,000 questions. Among the subset of binary questions that have resolved, the track record shows that Metaculus’ Brier Score stands at an impressive 0.117.

As the site has grown we’ve added staff, including a full-time CEO and a CTO, and a roster of analysts and question writers. We’re running real money competitions, including a $50K forecasting tournament on topics related to the development of artificial intelligence.

Many oklo.org readers may find interest in the Fermi-Drake question series, where we’re accumulating predictions on the terms of the famous equation for N.

Many readers will have their own opinions. Make your prediction count!

Beyond N, there are many active questions that touch on astrophysical topics.

The full list of astrophysics and cosmology questions is here.

including the ultimate question:

currently registering a 71% probability of resolving positively.

The Language Models

Writer’s block. Procrastination. Envy of those for whom words flow smoothly! Luxurious blocks of text. Paragraphs, Essays, Books.The satisfying end results of productivity made real.

Or, as Dorothy Parker put it, “I hate writing, I love having written.”

Over the past few years, this dynamic has kept me both keenly and uneasily interested in natural language generation — the emerging ability of computers to produce coherent prose. In a post that went up just under four years ago, I reported on experiments that used Torch-rnn to write in the vein of Oscar Wilde and Joris-Karl Huysmans, the acknowledged masters of the decadent literary style. A splendidly recursive quote from the Picture of Dorian Gray has Wilde describing the essence of Huysmans’ A Rebours.

Based on a 793587-character training set composed of the two novels, 2017-era laptop-without-a-GPU level language modeling — which worked by predicting the next character in sequence, one after another — could channel the aesthetic of décadence for strings of several words in a row, and could generate phrases, grammar and syntax more or less correctly. But there was zero connection from one sentence to the next. The results were effectively gibberish. Disappointing.

In the interim, progress in machine writing has been accelerating. Funding for artificial intelligence research is ramping up. Last year, a significant threshold was achieved by GPT-3, a language model developed and announced by OpenAI. The model contains 175 billion parameters and was trained (at a cost of around $4.6M) on hundreds of billions of words of English-language text. It is startlingly capable.

A drawback to GPT-3 is that it’s publicly available only through awkward, restrictive interfaces, and it can’t be fine-tuned in its readily available incarnations. “A.I. Dungeons” anyone? But its precursor model, the 2019-vintage GPT-2, which contains a mere 1.5 billion parameters, is open source and python wrappers for it are readily available.

For many years, oklo.org was primarily devoted to extrasolar planets. Looking back through the archives, one can find various articles that I wrote about the new worlds as they arose. One can also look back at contemporary media reports of the then-latest planetary discoveries. Here’s a typical example from a decade ago, the beginning of an article written by Dennis Overbye for the New York Times.

In collaboration with Simone Williams, a Yale undergraduate student, we scraped the media archives from the past two decades to assemble a library of news articles describing the discovery of potentially habitable extrasolar planets. Once all the articles were collected, we developed a consistent labeling schema, an example of which is shown just below. The Courier-font text is a summary “prompt” containing the characteristics of the planet being written about, as well as a record of the article’s source, while the Times-font text is the actual article describing an actual detected planet (with the title consistently bolded in san serif). In this case, it’s another piece by Dennis Overbye from 2007 reporting Gliese 581 c:

A benefit of the GPT series is that they are pre-trained. Fine tuning on the corpus of articles takes less than an hour using Google cloud GPUs.

And the result?

Here’s an imaginary article describing the discovery of a completely manufactured planet (albeit with a real name) with completely manufactured properties.

It’s definitely not perfect, but it’s also not that bad