Against Against Handover - By Scott Alexander

Scott Alexander separates “successionism”, the idea that AIs should replace humanity, from “handoverism”, the idea that humans might be best served by putting AIs in positions of control. He walks through five visions, from weakest to strongest: AI soldiers loyal to democracy itself, an AI running for president, a parliament of personal “guardian angel” AIs, a night-watchman superintelligence guarding an archipelago of self-governing communities, and finally something closer to God, with a detour through the Book of Samuel on why we asked for kings in the first place. * 00:00 - Introduction * 02:42 - Vision 1: Kemalist AI * 05:45 - Vision 2: President Claude * 09:29 - Vision 3: Parliament Of Angels * 12:23 - Vision 4: The Night Watchman * 20:25 - Vision 5: God https://open.substack.com/pub/astralcodexten/p/against-against-handover?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit askwhocastsai.substack.com/subscribe