Philosophy › Contemporary › Philosophy of artificial intelligence
Nick Bostrom: superintelligence and the simulation argument
b. 1973; simulation argument 2003; Superintelligence 2014· Philosopher· Knowledge, logic & science
Well documentedSolid records, texts or physical evidence.
Swedish-born philosopher, long at Oxford, known for arguing that we may live in a computer simulation and for warnings about superintelligent AI.
See it on the Philosophy map →The idea
Idea: some low-probability, high-stakes risks deserve serious attention. His simulation argument (2003) says at least one is true: civilizations almost never reach advanced technology, or they rarely run simulations of their ancestors, or we are almost certainly simulated. Superintelligence (2014) argued that an AI far smarter than us could pursue goals at odds with ours, so controlling it must be solved before it is built. His 'paperclip maximizer' shows a harmless-sounding goal gone wrong. Main objection: critics call such scenarios speculative distractions from current harms.
Why it matters
He helped put existential risk and AI safety on the agenda of governments, tech companies and philanthropists, and shaped longtermist priorities.
Legacy and sources
He founded Oxford's Future of Humanity Institute in 2005 (closed 2024). 'Are You Living in a Computer Simulation?' (2003); Superintelligence (2014), a bestseller praised by Bill Gates and Elon Musk.
Still debated
How seriously to take superintelligence risk divides AI researchers; surveys show a wide spread in their estimates of the chance of catastrophe.
Connections (4)
▸Nick Bostrom: superintelligence and the simulation argument shaped the priorities of Effective altruism and longtermismMostly agreed
The connection
Bostrom argued that human extinction would destroy not only present lives but vast numbers of possible future ones, so even slightly reducing extinction risk could outweigh most other good deeds. Effective altruists adopted this reasoning, making AI safety and pandemic prevention top causes.
When and how
Bostrom's 'Astronomical Waste' (2003) and 'Existential Risk Prevention as Global Priority' (2013), from Oxford's Future of Humanity Institute, which worked closely with early effective altruists in Oxford.
How sure are we?
Longtermist books by Ord and MacAskill cite Bostrom heavily, and major funders list AI risk as a priority, though how much is due to Bostrom alone is uncertain.
Debates and open questions
Critics argue the expected-value reasoning behind these priorities is fragile; supporters reply that ignoring small chances of catastrophe is the real mistake.
▸Nick Bostrom: superintelligence and the simulation argument gave a new skeptical twist to What can we know?Mostly agreed
The connection
Bostrom's simulation argument updated the old dream and demon worries with probability. If advanced civilizations run many detailed simulations of their ancestors, simulated minds would vastly outnumber real ones, so we should think it likely we are simulated, unless such civilizations rarely arise or rarely bother.
When and how
Oxford, 2003, in his paper 'Are You Living in a Computer Simulation?' in the Philosophical Quarterly.
How sure are we?
The paper sets out the three-way argument; philosophers at once compared it with Descartes' demon and Hilary Putnam's 1981 brain-in-a-vat discussion.
Debates and open questions
Bostrom says it is not classic skepticism, since it rests on evidence about technology; critics question whether consciousness can be simulated at all.
▸Nick Bostrom: superintelligence and the simulation argument updated the evil-demon doubt of René DescartesMostly agreed
The connection
Descartes imagined an evil demon feeding him a false world, to find what cannot be doubted. Bostrom's simulation hypothesis gives that doubt a technological form: our experiences could be generated by a computer run by an advanced civilization, a demon made of hardware. Unlike Descartes, Bostrom argues it may be probable, not merely possible.
When and how
Descartes' Meditations (1641), First Meditation; Bostrom's 'Are You Living in a Computer Simulation?' (2003). Hilary Putnam's brain in a vat (1981) bridged them.
How sure are we?
Commentators routinely draw the comparison, but Bostrom says his argument differs from classic skepticism, so this is a family resemblance rather than direct borrowing.
Debates and open questions
Descartes used God to escape the doubt. Whether anything rescues knowledge if we are simulated, or whether a simulated world is still real, as Chalmers argues, is debated.
▸Nick Bostrom: superintelligence and the simulation argument popularized AI risk in Philosophy of artificial intelligenceMostly agreed
The connection
Bostrom's Superintelligence argued that a machine smarter than humans could gain decisive power, and that its goals might not match ours: the 'control problem'. This moved philosophy of AI from 'Can machines think?' toward 'What if they outthink us?' and helped make AI alignment a field.
When and how
Superintelligence: Paths, Dangers, Strategies (Oxford University Press, 2014); the statistician I. J. Good had predicted an 'intelligence explosion' in 1965.
How sure are we?
The book was a bestseller and prompted public warnings from figures such as Elon Musk and Bill Gates, though others, like Eliezer Yudkowsky, developed the ideas in parallel.
Debates and open questions
AI researchers remain split on whether superintelligence is near, distant, or a distraction from present problems like bias and misuse.