AI Sentience, Agency and Catastrophic Risk with Yoshua Bengio - 654

Today we’re joined by Yoshua Bengio, professor at Université de Montréal. In our conversation with Yoshua, we discuss AI safety and the potentially catastrophic risks of its misuse. Yoshua highlights various risks and the dangers of AI being used to manipulate people, spread disinformation, cause harm, and further concentrate power in society. We dive deep into the risks associated with achieving human-level competence in enough areas with AI, and tackle the challenges of defining and understanding concepts like agency and sentience. Additionally, our conversation touches on solutions to AI safety, such as the need for robust safety guardrails, investments in national security protections and countermeasures, bans on systems with uncertain safety, and the development of governance-driven AI systems. 🔔 Subscribe to our channel for more great content just like this: https://youtube.com/twimlai?sub_confi... 🗣️ CONNECT WITH US! =============================== Subscribe to the TWIML AI Podcast: https://twimlai.com/podcast/twimlai/ Join our Slack Community: https://twimlai.com/community/ Subscribe to our newsletter: https://twimlai.com/newsletter/ Want to get in touch? Send us a message: https://twimlai.com/contact/ 📖 CHAPTERS =============================== 00:00 - Catching up with Yoshua 04:26 - Bayesian learning and causal theories 07:13 - AI risks 13:34 - Human-level competence in AGI 15:13 - Power concentration 16:55 - Risks in LLMs 21:17 - Dangers of AGI 23:47 - Sentience and agency 25:13 - Relating agency and goal conditioning in RL 28:24 - Sentience 30:30 - Difference between sentience and consciousness 36:33 - Social impacts of AI 40:30 - Approaching risks from a research perspective 44:12 - AI safety solutions 49:26 - Letter on moratorium on AI research 50:35 - Knowledge gaps in AI 54:35 - Potential risks of unintended AI behavior 56:20 - Pointer and resources 🔗 LINKS & RESOURCES =============================== Flow Network based Generative Models for Non-Iterative Diverse Candidate Generation - https://papers.nips.cc/paper_files/pa... FAQ on Catastrophic AI Risks (Superhuman AI) - https://yoshuabengio.org/2023/06/24/f... Pushing Back on AI Hype with Alex Hanna - 649 - https://twimlai.com/podcast/twimlai/p... The Montreal Declaration for a Responsible Development of Artificial Intelligence - https://recherche.umontreal.ca/englis... My testimony in front of the U.S. Senate – The urgency to act against AI threats to democracy, society and national security - July 2023 - https://yoshuabengio.org/2023/07/25/m... Pause Giant AI Experiments: An Open Letter (Letter on Moratorium on AI Research) - https://futureoflife.org/open-letter/... For a COMPLETE LIST of links and references, head over to https://twimlai.com/go/654. 📸 Camera: https://amzn.to/3TQ3zsg 🎙️Microphone: https://amzn.to/3t5zXeV 🚦Lights: https://amzn.to/3TQlX49 🎛️ Audio Interface: https://amzn.to/3TVFAIq 🎚️ Stream Deck: https://amzn.to/3zzm7F5

AI Orchestration for Smart Cities and the Enterprise [Robin Braun and Luke Norris] - 755
▶︎

AI Orchestration for Smart Cities and the Enterprise [Robin Braun and Luke Norris] - 755

The Race to Production-Grade Diffusion LLMs [Stefano Ermon] - 764
▶︎

The Race to Production-Grade Diffusion LLMs [Stefano Ermon] - 764

Artificial intelligence 'godfather' Yoshua Bengio opens up about his hopes and concerns
▶︎

Artificial intelligence 'godfather' Yoshua Bengio opens up about his hopes and concerns

S3 E1 Turing Award Winner Yoshua Bengio: Equipping AI with Higher Level Cognition and Creativity
▶︎

S3 E1 Turing Award Winner Yoshua Bengio: Equipping AI with Higher Level Cognition and Creativity

Deploying Edge and Embedded AI Systems with Heather Gorr - 655
▶︎

Deploying Edge and Embedded AI Systems with Heather Gorr - 655

Roman Yampolskiy on Objections to AI Safety
▶︎

Roman Yampolskiy on Objections to AI Safety

Agent Swarms and Knowledge Graphs for Autonomous Software Development [Siddhant Pardeshi] - 763
▶︎

Agent Swarms and Knowledge Graphs for Autonomous Software Development [Siddhant Pardeshi] - 763

Season 1 Ep. 22 OpenAI's Ilya Sutskever: The man who made AI work
▶︎

Season 1 Ep. 22 OpenAI's Ilya Sutskever: The man who made AI work

Eric Schmidt and Yoshua Bengio Debate How Much A.I. Should Scare Us
▶︎

Eric Schmidt and Yoshua Bengio Debate How Much A.I. Should Scare Us

#063 - Prof. YOSHUA BENGIO - GFlowNets, Consciousness & Causality
▶︎

#063 - Prof. YOSHUA BENGIO - GFlowNets, Consciousness & Causality

The most rational take on AI you’ll hear this year
▶︎

The most rational take on AI you’ll hear this year

Training Sand to Think: Artificial General Intelligence & Future of Physics
▶︎

Training Sand to Think: Artificial General Intelligence & Future of Physics

Yoshua Bengio Doesn’t Think We’re Ready for Superhuman AI. We’re Building it Anyway.
▶︎

Yoshua Bengio Doesn’t Think We’re Ready for Superhuman AI. We’re Building it Anyway.

Yann LeCun's $1B Bet Against LLMs [Part 1]
▶︎

Yann LeCun's $1B Bet Against LLMs [Part 1]

Yann LeCun: World Models: Enabling the next AI revolution
▶︎

Yann LeCun: World Models: Enabling the next AI revolution

Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton
▶︎

Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton

Language Understanding and LLMs with Christopher Manning - 686
▶︎

Language Understanding and LLMs with Christopher Manning - 686

Emerging Situation: Anthropic's Global Pause, Recursive Self-Improvement, and AI Personhood Arrives
▶︎

Emerging Situation: Anthropic's Global Pause, Recursive Self-Improvement, and AI Personhood Arrives

Yoshua Bengio: Sources of Richness and Ineffability for Phenomenally Conscious States | ASSC26
▶︎

Yoshua Bengio: Sources of Richness and Ineffability for Phenomenally Conscious States | ASSC26

Vibe Coding's Uncanny Valley [Alexandre Pesant] - 752
▶︎

Vibe Coding's Uncanny Valley [Alexandre Pesant] - 752