My phone is protected by a 4-digit PIN. I’d like to make it hard for an attacker to read information from my phone without knowing the PIN. Unfortunately, there are only 10,000 4-digit PINs, so it won’t take long to guess the right one. What to do? The standard solution involves tamper-resistant hardware. A trusted … More Locking phones with quantum bits
Previously I’ve assumed that the search for extraterrestrial life (SETI) is irrelevant to altruists. On further reflection I think that’s probably right, but it’s not obvious as I’d assumed. In this post I’ll argue: If SETI rules out 50% of the possible places aliens could be, you shouldn’t conclude that searching the other 50% is a … More On SETI
Futurists have argued for years about whether the development of AGI will look more like a breakthrough within a small group (“fast takeoff”), or a continuous acceleration distributed across the broader economy or a large firm (“slow takeoff”). I currently think a slow takeoff is significantly more likely. This post explains some of my reasoning … More Takeoff speeds
Someone walking around stabbing people can cause a lot of damage before anyone stops them. That’s a bummer, but some technologies make the situation much worse. If we don’t want to ban dangerous technologies outright (because they have legitimate purposes, or because we really love guns), we could instead expand liability insurance requirements. In the case of … More Liability insurance
Technology may reach a point where free use of one person’s share of humanity’s resources is enough to easily destroy the world. I think society needs to make significant changes to cope with that scenario. Mass surveillance is a natural response, and sometimes people think of it as the only response. I find mass surveillance … More Surveil things, not people
Suppose that I’m setting up an AI project, call it NiceAI. I may want to assure my competitors that I abide by strong safety norms, or make other commitments about NiceAI’s behavior. This post presents one possible strategy for making such commitments credible. A realistic plan will be much more complicated and messy, and this … More Honest organizations
(ETA: I think this problem is impossible and in particular this mechanism is broken. Credit to Daniel Kane for pointing out the error. At least I did warn: “I feel pretty confused and this might all be wrong.”) Suppose Alice and Bob are both interested in a public good: maybe it’s a movie they want … More 10,000-way donation matching
(Reposted from Facebook, I would prefer put it here than have it lost to the sands of time.) My view of the future is strongly influenced by the history of economic output. I think it’s instructive to look at the sequence of doubling times—how long did it take economic output to double, and then how … More Hyperbolic growth
I think that it’s worth having a simple picture of my own brain; this post presents my working model, which I’ve found extremely useful.
(If you read one post from my blog, it shouldn’t be this one. Also, serious Unsong spoilers.) Unsong’s Comet King is something of an indulgent caricature, implausibly determined and noble and capable. But if I put aside the desire to be respectable, I enjoy indulgent caricatures. This post presents some Unsong excerpts that touch on the Comet King’s character and fate, in chronological … More The Comet King
The sideways view 