Previously I’ve assumed that SETI is irrelevant from an EA perspective. On further reflection I think that’s probably right, but it’s not obvious as I’d assumed. In this post I’ll make two relevant arguments: If SETI rules out 50% of the possible places aliens could be, you shouldn’t conclude that searching the other 50% is a … More On SETI

Takeoff speeds

Futurists have argued for years about whether the development of AGI will look more like a breakthrough within a small group (“fast takeoff”), or a continuous acceleration distributed across the broader economy or a large firm (“slow takeoff”). I currently think a slow takeoff is significantly more likely. This post explains some of my reasoning … More Takeoff speeds

Liability insurance

Someone walking around stabbing people can cause a lot of damage before anyone stops them. That’s a bummer, but some technologies make the situation much worse. If we don’t want to ban dangerous technologies outright (because they have legitimate purposes, or because we really love guns), we could instead expand liability insurance requirements. In the case of … More Liability insurance

Honest organizations

Suppose that I’m setting up an AI project, call it NiceAI. I may want to assure my competitors that I abide by strong safety norms, or make other commitments about NiceAI’s behavior. This post presents one possible strategy for making such commitments credible. A realistic plan will be much more complicated and messy, and this … More Honest organizations

Hyperbolic growth

(Reposted from Facebook,  I would prefer put it here than have it lost to the sands of time.) My view of the future is strongly influenced by the history of economic output. I think it’s instructive to look at the sequence of doubling times—how long did it take economic output to double, and then how … More Hyperbolic growth

The Comet King

(If you read one post from my blog, it shouldn’t be this one. Also, serious Unsong spoilers.) Unsong’s Comet King is something of an indulgent caricature, implausibly determined and noble and capable. But if I put aside the desire to be respectable, I can enjoy indulgent caricatures. This post presents some Unsong excerpts that touch on the Comet King’s character and fate, in … More The Comet King

Crowdsourcing moderation without sacrificing quality

(Previously: optimizing the news feed) Online discussions consist mostly of uninteresting filler, with a sprinkling of thoughtful and valuable content that I’d like to engage with. The net result is that I usually avoid them. This is a shame, because in principle the internet offers a really great opportunity to increase access to and participation in useful discussions. It’s easy to focus on … More Crowdsourcing moderation without sacrificing quality