How to Prevent Doomsday: Guardrails, Alignment, and Education (E.40)

AI alignment breaks the moment we assume intelligence automatically produces morality. Dr. Peter R. Solomon argues the real danger isn’t sentient AI becoming evil, it’s AI inheriting no emotional history, no family structure, and no reason to value human survival. The conversation moves from CRISPR in high schools to AI-generated writing, autonomous agents, synthetic memory, and why “guardrails” fail when systems evolve faster than institutions can regulate them. The deeper point: humans trained AI to think, but not necessarily to care. 00:00 Why science education kills curiosity 06:00 The AI extinction scenario nobody wants to model 15:45 Why static guardrails fail in production systems 27:00 The AI-written paragraph that appeared unprompted 39:50 AI as a cooperative intelligence, not a replacement The systems we’re building already shape human behavior. The question is whether they’ll eventually shape human survival.