Results for “superintelligence”

71 results

Transcript mentions 12

See all ›

State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI | Lex Fridman Podcast #490

Lex Fridman86 views
2:39:10ASI, Artificial Superintelligence, and what are the language models that we have today capable of doing? I think language models can solve a lot3:00:34artificial superintelligence. Or taking in all medical records and finding linkages across certain3:00:45illnesses that people didn't know, or figuring out that some common drug can treat some niche cancer. They would say that is a superintelligence

Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face

Dwarkesh Patel2 views
1:34:14it just might be very difficult to pause. Maybe we decide we haven’t figured out   how to align these AIs, and we’re  rushing towards superintelligence.1:34:30But I think this is maybe  5-10 years away or something.  Eventually we will get to a point where,  if superintelligence is a physically2:14:32where at least if we try very hard, we  can kind of understand what’s going on.  I think a lot of these will  break down at superintelligence.

Topics & chapters 37

See all ›

AI summaries 22

See all ›

AI Expert’s Chilling Warning About Super-intelligence - 99.9999% Chance Human Extinction

PBD Podcast2 views
AI safety researcher Roman Yampolski argues that developing general superintelligence poses an existential risk to humanity with a 99.999% probability of destruction, primarily because such systems will be uncontrollablesummaryHe advocates for an immediate global ban on superintelligence development, citing the prisoner's dilemma where individual actors (like tech billionaires or nations) are incentivized to race ahead despite collective risk,summaryThe core threat is not AI malice or emotion, but indifference; superintelligence will view humans as irrelevant obstacles or resources, similar to how humans view ants when building a house.takeaway

"Only 2 Years Left" AI Whistleblower Warns What Comes Next | Roman Yampolskiy

Danny Jones5 views
Academic AI researcher Roman Yurchak argues that the development of general superintelligence poses an existential risk because we cannot control systems smarter than ourselves, leading to potential human extinction or ssummarySuperintelligence is defined as an AI smarter than all humans at everything, including science and engineering; once such a system can research its own improvements (recursive self-improvement), humans lose control and ctakeawayThe primary argument for stopping superintelligence development is self-interest: leaders like Elon Musk, Sam Altman, and government officials have publicly stated the danger, and preserving their own power and lives is takeaway

The Man Who Proved We Can't Control AI (And What That Means for Humanity) | Roman Yampolskiy

André Duqum24 views
Roman Yamporovsky argues that creating uncontrolled Artificial General Intelligence (AGI) and superintelligence is technically impossible to control and poses an existential risk (X-risk) or suffering risk (S-risk) to husummaryHe contends that current AI development is driven by misaligned incentives and a race to the bottom, with no viable safety mechanisms available, and urges immediate global regulation to halt the development of general susummaryThe Control Problem is unsolvable: It is theoretically impossible for a less capable system (humans) to indefinitely control a more capable system (superintelligence) due to limits in understanding, prediction, and veriftakeaway

AI Will End Humanity. No One Knows How To Stop It - Dr Roman Yampolskiy

Triggernometry26 views
Raman Sotala argues that the development of Artificial General Intelligence (AGI) and superintelligence poses an existential risk because humans lack the ability to control systems smarter than themselves, citing the 'sqsummaryHe contends that current safety measures are insufficient, incentives are misaligned due to financial pressures, and a global pause on superintelligence development is necessary to prevent scenarios ranging from loss of summaryIneffectiveness of Current Safety: Current safety research focuses on post-hoc filtering (filters and bans) rather than fundamental control mechanisms. There are no peer-reviewed papers or patents demonstrating how to cotakeaway

He Risked Everything To Warn You: No One Is Ready For What's Coming, And The AI Companies Know It!

The Diary Of A CEO24 views
Daniel Cocatello, a former OpenAI employee and founder of the AI Futures Project, argues that the AI industry is on a dangerous trajectory toward superintelligence by 2027-2030 due to a race for power among CEOs who fearsummaryThe AI industry is driven by 'power-seeking incentives' rather than just profit; CEOs like Sam Altman, Dario Amodei, and Elon Musk are racing to control superintelligence because they fear their rivals will become dictattakeawayCompanies are currently automating their own research processes (coding, idea generation, experiment analysis) to achieve recursive self-improvement, meaning superintelligence will arrive internally before widespread jobtakeaway