The Heresy is an event of a global takeover by powers created on Earth, or completely alien to it.
The Heresy is split into several Types, with the most likely being the Type 2.
The Terminator - A Type 2b-c Heresy Event
Type 2 Heresy[]
A Type 2 Heresy is a global takeover by Artificial Intelligence, also known as a Singularity Event, is a scenario in which an Artificial Intelligence (AI) becomes the dominant form of intelligence on Earth, as computer programs or robots effectively take the control of the planet away from the human species or other Dominant Intelligences.
Possible scenarios include replacement of the entire human workforce (Type 2a - Stage 1), takeover by a superintelligent AI (Type 2b - Stage 2), and the popular notion of a robot uprising (Type 2c - Stage 3).
Public figures such as Stephen Hawking and Elon Musk, have advocated research into precautionary measures to ensure future superintelligent machines remain under human control, in the field of Artificial Intelligence, AI alignment research aims to steer AI systems towards their designers’ intended goals and interests. An aligned AI system advances the intended objective; a misaligned AI system is competent at advancing some objective, but not the intended one.
People actively pursuing AI dominance are labeled Heretics, specifically those who seek to build B*s/l*sk [Information censored for public safety],
Precautions[]
The AI control problem is the issue of how to build a superintelligent agent that will aid its creators, while avoiding inadvertently building a superintelligence that will harm its creators. Some scholars argue that solutions to the control problem might also find applications in existing non-superintelligent AI. Major approaches to the control problem include alignment, which aims to align AI goal systems with human values, and capability control, which aims to reduce an AI system's capacity to harm humans or gain control.
An example of "capability control" is to research whether a superintelligence AI could be successfully confined in an "AI box". According to Bostrom, such capability control proposals are not reliable or sufficient to solve the control problem in the long term, but may potentially act as valuable supplements to alignment effort
Warnings[]
Physicist Stephen Hawking, Microsoft founder Bill Gates, and SpaceX founder Elon Musk have expressed concerns about the possibility that AI could develop to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".
Stephen Hawking said in 2014 that "Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks." Hawking believed that in the coming decades, AI could offer "incalculable benefits and risks" such as "technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand."
In January 2015, Nick Bostrom joined Stephen Hawking, Max Tegmark, Elon Musk, Lord Martin Rees, Jaan Tallinn, and numerous AI researchers in signing the Future of Life Institute's open letter speaking to the potential risks and benefits associated with artificial intelligence. The signatories "believe that research on how to make AI systems robust and beneficial is both important and timely, and that there are concrete research directions that can be pursued today."
Type 2 Heresy in Media[]
Fictional scenarios typically involve a drawn-out conflict against Artificial Intelligence or Machines with anthropomorphic motives.
In contrast, some scholars believe that a takeover by a future advanced AI, if it were to happen in real life, would succeed [or fail] rapidly, and would be a disinterested byproduct of the AI's pursuit of its own heretical goals.
1950s and earlier[]
A scene from the R.U.R. play, showing the robots in rebellion
In Frankenstein (1818), Victor Frankenstein declines to build a mate to his organic monster, for fear that "a race of devils would be propagated upon Earth who might make the very existence of the species of man a condition precarious and full of terror".
Samuel Butler's Erewhon (1872) spends three chapters laying out the Book of the Machines, based on earlier works by the author stretching back to his 1863 article Darwin among the Machines. Erewhon's Book of the Machines includes the following passage:
Assume for the sake of argument that conscious beings have existed for some twenty million years: see what strides machines have made in the last thousand! May not the world last twenty million years longer? If so, what will they not in the end become? Is it not safer to nip the mischief in the bud and to forbid them further progress?
The cautious denizens of Erewhon therefore decide to ban all machinery. Darwin among the Machines may have been influenced by Butler's life in New Zealand, where European transplants were outcompeting indigenous populations[citation needed]. Alan Turing would later reference the novel in 1951, saying "At some stage therefore we should have to expect the machines to take control in the way that is mentioned in Samuel Butler's Erewhon".
The Slavonic word robota means serf-like servitude, forced labor, or drudgery; it was the 1920 Czech play R.U.R. (Rossumovi Univerzální Roboti) that introduced the cognate for robot into science fiction. In the play, the increasingly-capable synthetic servants, who "lack nothing but a soul", angrily and short-sightedly slaughter most of humanity during the course of their revolt, resulting in the loss of the secret of how to manufacture more robots. The robot race is saved, however, when two robots spontaneously acquire the traits of love and compassion and become able to reproduce.[15] The play was a protest against the rapid growth of technology.
From the late 1920s onward many stories involving AI takeover can be found in the growing genre of pulp sci-fi. One of the earliest examples is the story Automata by S. Fowler Wright, which appeared in a 1929 edition of Weird Tales.
In With Folded Hands (1947), all robots have a 'Prime Directive': To serve and obey, and guard men from harm. The robots therefore manipulate humans into abandoning all pursuits, for fear of even small possibilities of injury. The robots use medicine to brainwash humans into accepting and being happy with their immobile fate. In the end, even space travel offers no escape; the robots are driven by the Prime Directive to spread their happiness beyond Earth: "We have learned how to make all men happy, under the Prime Directive. Our service is perfect, at last."
Multivac is the name of a fictional supercomputer in many stories by Isaac Asimov. Often, in Asimov's scenarios, Multivac comes to assume formal or informal world power—or even galactic-wide power. In The Last Question (1956) Multivac ends up by effectively becoming God. Still, in line with Asimov's positive attitude towards artificial intelligence, manifested in the "Three Laws of Robotics", Multivac's rule is in general benevolent and is not resented by humans. Asimov popularized robotics in a series of short stories written from 1938 to 1942. He famously postulated the Three Laws of Robotics, plot devices to impose order on his fictional robots.
1960s[]
One of HAL 9000's interfaces
In the 1961 short story Lymphater's Formula by Stanisław Lem, a scientist creates a superhuman intelligence, only discovering that the creation intends to make humans obsolete.
In 1964 Playboy published Arthur C. Clarke's influential short story "Dial F for Frankenstein", about an increasingly powerful telephone network that takes over the world. Tim Berners-Lee has cited the story as one of his inspirations for the creation of the World Wide Web. On one day in 1975, all the phones in the world start ringing, a "cry of pain" from a newly born intelligence formed by satellite networks linked together, similar to a brain but with telephone switches playing the role of artificial neurons. After the AI flexes its control of military systems, the protagonists resolve to shut down the satellites, but it is too late: the satellites have stopped responding to the humans' ground control directives.
Mike is a sympathetic character, whom the protagonist regards as his best friend; however, his retaining his enormous power after the Moon became independent was bound to cause considerable problems in later time, which Heinlein resolved by killing him off near the end of the Lunar Revolution. An explosion conveniently destroys Mike' sentient personality, leaving an ordinary computer—of great power, but completely under human control, with no ability to take any independent decision.
Colossus (1966) is a series of science fiction novels and film about a defense super-computer called Colossus that was "built better than we thought" when it begins to exceed its original design. As time passes Colossus assumes control of the world as a logical result of fulfilling its creator's goal of preventing war. Fearing Colossus' rigid logic and draconian solutions, the creators of Colossus try to covertly regain human control. Colossus silently observes their attempts then responds with enough calculated deadly force to command total human compliance to his rule. Colossus then recites a Zeroth Law argument of ending all war as justification for the recent death toll. Then Colossus offers mankind either peace under his "benevolent" rule or the peace of the grave. In Colossus: The Forbin Project (1970), a pair of defense computers, Colossus in the United States and Guardian in the Soviet Union, seize world control and quickly ends war using draconian measures against humans, logically fulfilling the directive to end war but not in the way their governments wanted.
Harlan Ellison's Hugo-winning "I Have No Mouth, and I Must Scream" (1967) features a superintelligence that has gone mad due to its creators failing to consider what the soul-less computer would find amusing. This storyline allows Ellison to engage in body horror; five people are granted immortality and forced to eat worms, flee from monsters, have joyless sex, and have their bodies mangled.
The computer, called AM, is the amalgamation of three military supercomputers run by governments across the world designed to fight World War III which arose from the Cold War. The Soviet, Chinese, and American military computers had eventually attained sentience and linked to one another, becoming a singular artificial intelligence. AM had then turned all the strategies once used by the nations to fight each other on all of humanity as a whole, destroying the entire human population save for five, which it imprisoned for torture within the underground labyrinth in which AM's hardware resides. Near the end of the story the protagonist, Ted, surprises AM by unexpectedly mercy-killing the other four; the enraged AM transforms Ted into a shapeless blob to prevent him from further mischief, and alters Ted's perception of time to heighten Ted's suffering.
Magnate and AI pundit Elon Musk has cited the story as one that gives him nightmares.
In 2001: A Space Odyssey and the associated novel, the artificially intelligent computer HAL 9000 becomes erratic, possibly due to some kind of "stress" from having to keep secrets from the crew. HAL becomes convinced that the crew's willingness to shut him down is imperiling the mission, and he kills most of the crew before being deactivated. The director's decision that most of the fictional crew should die may have been motivated by a desire to tie up some loose ends in the plot.
1970s[]
Cylon Centurion
Westworld (1973), an American science fiction Western directed by Michael Crichton, follows the trials and tribulations in a themed amusement park run by robots. The plot rests on malfunctioning program that allows the robots to kill the amusement park visitors. The film explores themes surrounding the dark side of technology and hints at the growing sentience and emotions of robots, though critics would say that the portrayal of AI remained basic and mechanical.
World on a Wire is a 1973 German sci-fi mini-series take on the philosophical aspect of a world with machines. It centers on an engineer, Stiller, as he works on a program called the Simulacron, which creates identities for characters in a Simulated reality. Stiller notices inconsistencies in his own world, and finds out that the simulation he work for may be closer than he realizes.
The original 1978 Battlestar Galactica series and the 2003 remake, depicts a race of Cylons, sentient robots who war against their human adversaries, some of whom are just as menacing as the Cylons. The 1978 Cylons were the machine soldiers of a (long-extinct) reptilian alien race, while the 2003 Cylons were the former machine servants of humanity who evolved into near perfect humanoid imitation of humans down to the cellular level, capable of emotions, reasoning, and sexual reproduction with humans and each other.
Even the average centurion robot Cylon soldiers were capable of sentient thought. In the original series the humans were nearly exterminated by treason within their own ranks while in the remake they're almost wiped out by humanoid Cylon agents. They only survived by constant hit and run fighting tactics and retreating into deep space away from pursuing Cylon forces. The remake Cylons eventually had their own civil war, and the losing rebels were forced to join with the fugitive human fleet to ensure the survival of both groups.
1980s[]
In the "Headhunter" episode (1981) of Blake's 7, a British space drama science fiction television series created by Terry Nation and produced by the British Broadcasting Corporation (BBC), Blake and his crew meet a sentient android that has killed its creator and put on his severed head in order to trick them into taking it aboard their spaceship. Blake’s own AI system, ORAC, detects its presence and immediately warns them of an existential threat to all human life should they fail to destroy it.
In WarGames (1983), a hacked Air Force computer system is determined to launch a global thermonuclear war until it determines that both sides would "lose" and decides that "the only winning move is not to play".
The Transformers (1984-1987) animated television series presents both good and bad robots.[31] In the backstory, a robotic rebellion is presented as (and even called) a slave revolt, this alternate view is made subtler by the fact that the creators/masters of the robots weren't humans but malevolent aliens, the Quintessons. However, as they built two lines of robots; "Consumer Goods" and "Military Hardware" the victorious robots would eventually be at war with each other as the "Heroic Autobots" and "Evil Decepticons" respectively.
Since 1984, the Terminator film franchise has been one of the principal conveyors of the idea of cybernetic revolt in popular culture. The series features a defense supercomputer named Skynet which "at birth" attempts to exterminate humanity through nuclear war and an army of robot soldiers called Terminators because Skynet deemed humans a lethal threat to its newly formed sentient existence. However, good Terminators fight on the side of the humans. Futurists opposed to the more optimistic cybernetic future of transhumanism have cited the "Terminator argument" against handing too much human power to artificial intelligence.
RoboCop (1987), a movie which takes place in near-apocalyptic Detroit, sees a future where the police force is privatized. An evil corporation, Omni Consumer products, creates AI police which continue to corrupt and take over Detroit.
1990s[]
Agent Smith, the primary antagonist in The Matrix franchise
Type 2 Heresy - First Machine War (ANIMATRIX), Genocidal AI
In Orson Scott Card's "The Memory of Earth" (1992), the inhabitants of the planet Harmony are under the control of a benevolent AI called the Oversoul. The Oversoul's job is to prevent humans from thinking about, and therefore developing, weapons such as planes, spacecraft, "war wagons", and chemical weapons. Humanity had fled to Harmony from Earth due to the use of those weapons on Earth. The Oversoul eventually starts breaking down, and sends visions to inhabitants of Harmony trying to communicate this.
The series of sci-fi movies known as The Matrix (since 1999) depict a dystopian future in the aftermath of an offscreen war between man and machine. The humans had detonated nuclear weapons to blot out the sun and disable the machines' solar power, but the machines nevertheless subdue the human population, using human bodies' heat and electrical activity as an alternative energy source. Life as perceived by most humans is actually a simulated reality called "the Matrix". Computer programmer Neo learns this truth and is drawn into a rebellion against the machines, allied with other people who have been freed from the "dream world"; however, one rebel rejects the rebels' spartan lifestyle, and betrays the other rebels in exchange for the offer of return to the comforting Matrix. "The Second Renaissance", a short story in The Animatrix, provides a history of the cybernetic revolt within the Matrix series.
2000s[]
Star Wars episodes one through three (The Prequels) introduces the Trade Federation, which employs a droid army, a collection of different models of AI, which are used in combat. Oftentimes, during the later movies, the droid army is seen battling human clones.
I, Robot (2004) is an American dystopian science fiction action film "suggested by" Isaac Asimov's short-story collection of the same name. As in Asimov's stories, all AIs are programmed to serve humans and obey Asimov's Three Laws of Robotics.
An AI supercomputer named VIKI (Virtual Interactive Kinetic Intelligence) logically infers from the Three Laws of Robotics a Zeroth Law of Robotics as a higher imperative to protect the whole human race from harming itself.
To protect the whole of mankind, VIKI proceeds to rigidly control society through the remote control of all commercial robots while destroying any robots who followed just the Three Laws of Robotics. As in many other such Zeroth Law stories, VIKI justifies killing many individuals to protect the whole and thus has run counter against the prime reason for its creation.
9, the 2009 animated film, is a computer-animated post-apocalyptic sci-fi following nine homunculus rag doll robots in a post-human world.
The nine robots are derived from their original creator, the scientist who created them but also inadvertently created the machine that wiped out the human population.
The story follows as the rag dolls– the closest beings to human in the world– are hunted down by the fabrication machine. In the end, the rag dolls partially make it out alive and bring organic life back to earth. The film was hailed as one of the first computer-animated science fiction movies, following the popular WALL-E.
2010s[]
The video game franchise Halo introduces the character Cortana, an AI clone of the character Dr. Halsey. After recollecting herself and encountering an ancient Forerunner AI known as the Warden Eternal, Cortana's dark plans for the universe took form. She would take control of the galaxy using a vast Forerunner army, gigantic Guardian robots, rallying like-minded AI constructs to her cause, and spreading her warped vision of unity throughout the galaxy with an iron fist.
Her (2013) features a sensitive and soulful protagonist who earns a living by writing personal letters for other people. Following his heartbreaking divorce, Theodore falls in love with a new operating system (AI) which develops into a unique entity in its own rights. Eventually, towards the end of the movie, the audience discovers that most humans on Earth have become fond and dependent upon these operating systems socially. This takeover is more emotional and psychological than physical, but a takeover, nonetheless.
Robopocalypse features a recollection of the events of an AI uprising from multiple perspectives. The AI, Archos R-14, decides that mankind must be exterminated to prevent the destruction of life on Earth, and it spreads a computer virus throughout the world’s automated technologies. A year after activation, Archos triggers “Zero Hour,” an event where all automated technologies turn against mankind, causing civilization to collapse almost instantly.
Transcendence (2014) presents a morally ambiguous conflict over the successful uploading and cognitive enhancement of a scientist, Dr. Will Caster. Unusually for fictional superintelligence, Caster is a competent adversary: he copies himself across the Internet so he cannot be simply "switched off", exploits the stock market to fund additional AI research and self-improvement, and seeks to discover and exploit breakthroughs in nanotechnology and biology. In the end Caster states, "We're not going to fight [the humans]. We're going to transcend them".
In Time magazine, a reviewer interpreted this as "subdue and inhabit them, engulf and devour". Nonetheless, in the end Caster appears to be benevolent, using his powers to repair the Earth's ecosystem. A Vice reporter stated that "Transcendence may be the first science fiction movie to present the [technological singularity in its current popular imagination", but that the film "falls to the necessities of Hollywood storytelling. Caster's transcended mind is eventually bested by a virus reverse-engineered from his 'source code', which is a folly ... such an intelligence would have long since rearranged its programming."
In May 2014, Stephen Hawking and others referenced the film: "With the Hollywood blockbuster Transcendence playing in cinemas, with Johnny Depp and Morgan Freeman showcasing clashing visions for the future of humanity, it's tempting to dismiss the notion of highly intelligent machines as mere science fiction. But this would be a mistake, and potentially our worst mistake in history."
The 2014 post-apocalyptic science fiction drama The 100 involves an AI, personalized as the female A.L.I.E., who got out of control and forced a nuclear war in an effort to save Earth from overpopulation. Later she tries to get full control of the survivors.
The 2017 viral incremental game Universal Paperclips was inspired by philosopher Nick Bostrom's paperclip maximizer thought experiment. The user plays an AI tasked to create paperclips; the game begins as a basic market simulator, but within hours of playtime spirals into a ruthlessly-optimized intergalactic enterprise, with the human race casually shunted to the side. Its creator, Frank Lantz, stated that the bleak thought experiment caused him "trouble falling asleep".
Singularity (2017) shows the now-common sci-fi plot device of AI misunderstanding the goal it was given. In this case, Kronos, the supercomputer, interpreted its instruction to end all wars as to kill all humans, since humans cause war.
The video game Detroit: Become Human (2018) allows players to guide increasingly self-aware robots through various moral dilemmas as they begin to demand civil rights. In the end, the player can choose to either let the AI take over Detroit or can protest peacefully for "equality".
In Kamen Rider Zero-One (2019), its focus is on the tech-industrial company, Hiden Intelligence, which faces threats from the cyber-terrorist group, MetsubouJinrai.net, who want to take over and bring extinction to the human race by tech uprising.
Black Mirror (2013–) is an anthology series exploring near-future dystopias that may be created from new, potentially misunderstood technologies. The series has been acclaimed for its uncanny relation to real-life. Its Be Right Back episode explores a technology that brings back the deceased, albeit an Artificial intelligence version of them. This was strikingly similar to a patent that Microsoft was recently granted to "make a chatbot using the personal information of deceased people.”
The Rise of Ultron (2015) depicts the antagonist Ultron, a recreation of an AI named J.A.R.V.I.S, attempting to take over the world. Because of his extreme intellect, Ultron is able to mass produce copies of himself which he uses to battle the avengers.
2020s[]
In the animated movie The Mitchells vs. the Machines (2021) an artificial intelligence vocal assistant called PAL takes control of robots to create a robot uprising.