Skip to content
Tuesday 28 July 2026London --:--Frankfurt --:--Zurich --:--
NewslettersSearchEN · DE
City PM

European business, markets and politics

FTSE 100
10,781.75
+0.42%
DAX
25,361.03
0.00%
CAC 40
8,406.06
0.00%
STOXX 50
6,282.21
0.00%
  • Europe
  • Markets
  • Business
  • Economy
  • Technology
  • Politics
  • Opinion
More
GermanyFranceBankingAIEnergyFintechPropertyCapital Markets
  • Germany
  • France
  • Europe
  • Markets
  • Business
  • Economy
  • Technology
  • Politics
  • Opinion
  • DE
Wednesday 22 May 2019 8:21 am  |  Updated:  Wednesday 05 June 2019 8:33 am

Malevolent superintelligence? That’s science fiction, not reality

By: Yorick Wilks

Add as a preferred source on Google

In Stanley Kubrick’s 2001: A Space Odyssey, HAL 9000 was an all-knowing robot that decided to destroy a spacecraft and its crew. Naturally enough, the crew didn’t care for this.

The film was an important crossover moment from science fiction to science fact. Many who saw HAL came to believe that there are indeed such computers in charge of things.

What was once the stuff of fiction is now closer to reality, and the question of whether artificial intelligence (AI) will cause us harm has become more important than ever.

After all, automated cars will soon take to our roads, and drivers may begin to worry that the family saloon might decide to kill them in order to save a coachload of schoolgirls.

Fears around AI have been stoked by the concerns of some public figures. Stephen Hawking said that the emergence of AI could be the “worst event in the history of our civilization”, as it may try to replace humans.

Meanwhile Nick Bostrom, a philosopher at Oxford and author of the best-selling book Superintelligence, thinks that AI could create an “existential catastrophe” for us all.

Released in 2014, Superintelligence scared a huge number of people by describing AI research as being at the cusp of suddenly taking over and controlling our lives – or at worst, destroying us all.

This sounds compelling, because it panders to our love of catastrophe as our lives become ever more comfortable and less arduous. It also plays into a cultural moment for AI, with several TV and film dramas featuring the technology.

But there’s no reason to be afraid. AI developments are hyped up to appear far more intelligent than they really are.

It is true that the technology is blooming everywhere, from health to space to agriculture, but there is no hint as yet of the kind of general intelligence that we humans have and which can create these marvels.

Already, AI can have capabilities more like those of animals and far superior to our own: AI-powered eyes, like those of an eagle, can see a stamp a mile away. But just as an eagle poses no risk to us, neither are these tech developments a threat to humans.

Bostrom also believes that intelligent machines will have goals of their own and will be hostile to us, but he is reduced to describing absurd scenarios such as a machine wanting to make an infinite number of paperclips and destroying all the world’s resources to do so. This is very early science fiction indeed – it is straight out of The Sorcerer’s Apprentice, a poem from 1797.

One of the odd things about Bostrom’s menacing AI prediction is that he assumes there will be only one of them, because it will have killed all the others – a bit like the dragons fighting it out with the zombified dragon in Game of Thrones.

But this assumes that superintelligent computers never evolve towards the same thing that humans acquired in spades thanks to evolution: the ability to cooperate and work together.

Also, why assume that any creation would want to destroy its creator?

All the myths and religions we know assume that created things are more or less well-disposed towards their creators, and much more likely to worship them and build temples than to seek to kill them. In Bostrom’s science fiction, the Superintelligences want to kill their parents.

Of course, AI could be dangerous in the future – extraordinary weapons are now being created by all the major powers, from submarines with no crews to huge flocks of heavily-armed drones and tiny tanks.

The AI that we need to be most careful of is the one that extends already-existing technologies – like weapons, cars, and fully-automatic factories – and makes them much cheaper, yet also more deadly.

But AI rebelling against us? That’s just science fiction.

Share this article

  • Facebook
  • X
  • LinkedIn
  • WhatsApp
  • Email

Similarly tagged content:

Sections

  • News
  • Opinion

Categories

  • Business
  • Opinion
  • Tech

Related Topics

Trending Articles

  • Wise denied US banking licence in blow to expansion plans

  • Big Four’s AIM exodus accelerates as mid-tier firms seize mandates

  • FTSE 100 firm agrees £5.7bn takeover in latest private equity swoop

  • Scotland’s tax hike may have backfired as receipt falls

  • Burnham backs plan to pump £1bn pension funds into start-ups

More from City PM

  • Everything’s going to sh*t. Here are 25 of the best dystopian novels

    Life&Style
    Stack of popular dystopian novels including 1984 and Brave New World on a wooden table, perfect for book enthusiasts.
  • Breaking up the science department is a setback for Britain’s AI ambitions

    Opinion
    Kanishka Narayan, wearing glasses and a suit, speaks at London Tech Week, with the event logo visible.
  • ‘Phenomenal waste of time’: Burnham slammed over plans to dismantle tech department

    Tech
    Andy Burnham speaking at a press conference, expressing confidence despite challenges, highlighting leadership and resilie...
  • Burnham accused of gutting tech department’s ‘biggest strength’

    Tech
    Andy Burnham, Mayor of Greater Manchester, smiling in glasses, dark jacket, light blue shirt, blurred green background.
  • ‘Fantastic news’ as Burnham brings Britain’s AI minister into Cabinet

    Tech
    Kanishka Narayan, prominent figure in the news, engaging in a public event or discussion, showcasing leadership and influe...
  • Planet Opens London Office, Expanding European Footprint

    Business Wire
  • Rory Sutherland joins Adam Smith Institute as senior fellow

    News
    Business meeting with diverse professionals discussing financial growth strategies in a modern conference room setting
  • Sport documentaries muddle grey area of storytelling vs reality

    Sport Business
    Alex Albon of Williams Racing giving an interview, with a camera crew nearby and Atlassian branding visible.
CityPM

Independent European business, markets and political news for decision-makers.

Morning Briefing

Europe

  • Germany
  • France
  • Europe
  • UK & Ireland

Business

  • Markets
  • Banking
  • Technology
  • Energy
  • Property
  • Fintech

Editorial

  • Opinion
  • Editorial Policy
  • Corrections
  • Contact

Company

  • About City PM
  • Privacy Policy
  • Terms of Use
  • Cookie Policy
© 2026 City PM Ltd · Published by CityPM Media, Bahnhofstrasse 65, 8001 Zürich, Switzerland
Privacy · Terms · Cookies · Facebook