Driverless cars offer new forms of control – no wonder governments are keen

June 22, 2018 by Neil Mcbride, The Conversation
Credit: Shutterstock

Imagine a state-of-the-art driverless car is zipping along a road with a disabled 90-year-old-passenger. A young mother with a toddler steps into the road. The car must make a decision: drive into the mother and child and kill them, or career into a wall and kill the passenger.

This is a variation of the trolley problem, which dominates academic and popular thinking about the ethics of driverless cars. The problem is that such debates not only dismiss the complexity of the system in which driverless cars will exist, but are really moral red herrings. The real ethical issues lie in the politics and power concerns with driverless cars.

Governments across the world are taking a deep interest in driverless cars. The German has produced ethical guidelines for driverless cars. The UK government has promised driverless cars on the road by 2021, and the Russian government by the end of 2018. China has ambitious plans to connect driverless cars to the internet and install sensors in roads and traffic lights by 2025.

Most revealing is the way driverless cars feature in the EU's white paper on the future of Europe in 2025, published in March 2017. They form a telling part of a snapshot of how Europe might look in a future where EU countries have effectively joined to become one federal superstate. In this scenario, the white paper says, driverless cars will flourish, flitting unhindered across borders from city to city.

There's a reason why governments are so keen on driverless cars – and it's not just because of the potential economic benefits. They offer the chance for even greater tracking and even control of citizens' every move. Far from setting us free, driverless cars threaten to help enable new forms of surveillance and oppression.

A is a computer on wheels, the ultimate internet-connected mobile device. Bristling with sensors, it provides a constant two-way flow of information. The car sends information about its performance to the manufacturer. It receives software updates, control signals about adjustments to its behaviour. The manufacturer knows where the car is, what the road conditions and temperature are and how the vehicle is performing at a particular speed.

The car's insurer may receive minute-by-minute information about the car's state, location, speed and the condition of the road it's on, and could vary the insurance accordingly. It could even give ten minutes' warning of loss of cover and halt the car.

Meanwhile, government databases will also be likely to know where the car is, whether it is meant to be there and where it's going. And even, using predictive analytics, where it will go for its next journey. Smart motorways will manage flows of traffic, slowing down driverless cars as part of a stream of communication between the car and the road. In smart cities, traffic lights will reroute cars into detours according to calculations and predictions about traffic jams, road works, or state requirements.

Credit: Shutterstock

Markets in fast routes through cities and to central destinations may be created. Companies may pay for employees to use priority virtual routes. Travel logs may make it quite clear where you've gone and when. Reasons for your journey may be inferred predictably from the landscape, from destinations and from timing.

End of autonomy

For more than 130 years, cars have represented the ultimate in autonomy, individuality and democratic freedom. Our car trips are private and anonymous. We can go where we like and when we like. We don't have to tell anybody. And we retain responsibility for whether we obey the law. Driverless cars will bring that to an end.

Now manufacturers, governments and city authorities will know where we're going, what we're doing and when. If anyone doesn't like what we're doing, they will be able to stop us, withdraw technical and accident cover, stop us using particular roads or streets, or just shut us down. It won't be the car that's autonomous but the authorities and systems that run and maintain that car, that draw and send information to and from the car.

Driverless cars will herald a new age of citizen control. In the rhetoric of making us safer and reducing risk, power will be taken away and delivered to central authorities – whether they are cities, governments or commissions. To render us safe, governments will leave us powerless.

Now the controllers can simply change our route for their own purposes, whether to prevent traffic jams or to clear a route for a dignitary. Now they can send us to particular shops, or directly to a police station. Now the controllers can manage populations of cars to meet the purposes of the council or government.

In a democratic state, the growing flow of personalised information towards centralised authority will provides the basis for the regulation and enforcement. Its new managed citizens will be the target for behavioural nudges and advertising flowing into the driverless car. In the dictatorial state, the authorities can stop you going to a demonstration, or stop you going to church.

And such centrally managed systems, which will be essential for the safety of driverless cars, are not only open to the inevitable technology failures of complex systems, but also to hacking and attacks by other states and individuals. Why hack into one car, when you can hack into a whole city system and bring traffic to a halt, or crash 30,000 cars into each other?

In reflecting on the ethics of driverless cars we need to move beyond the constraints of trolleys and levers to a wider agenda that addresses the concepts of autonomy, community, transparency, identity, value and empathy. Our ethical debate has to address the power shifts, the political responsibilities and the human rights that our vision of driverless cars may require to be sacrificed.

Explore further: Traffic light tech will be tested in UK, allows cars to leverage signal change

Related Stories

China to see driverless cars in '3-5 years': Baidu

March 15, 2018

Self-driving cars will hit the roads in China "within three to five years", the founder of Chinese internet giant Baidu, one of the world's leading designers of driverless cars, said Thursday.

How driverless cars will change travel

December 22, 2017

The idea of a completely autonomous vehicle is exciting—and a bit scary. As we envision future advancements on the road, many would like to know just how much driverless cars could change human travel.

Recommended for you

Late to the party, German carmakers join race against Tesla

September 23, 2018

After years watching Tesla's electric cars speed ahead while they have been on the defensive over an industry-wide diesel emissions scandal, German high-end manufacturers have finally unveiled their first challengers to the ...

5 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Nik_2213
1 / 5 (1) Jun 22, 2018
Well, the car could start by braking, instead of getting its algorithms into a logical knot...
Squirrel
1 / 5 (1) Jun 22, 2018
Driverless car create new possibilities for anti-government protest. Today only the brave will sit down in a road to stop traffic. No one wants to anger and frustrate drivers who cannot be relied to not try and avoid you. But driverless car can be trusted to stop and stay paralyzed. Imagine an antigovernment movement in which individuals randomly forced the stopping of driverless cars. Government could be made more vulnerable with driverless cars not less to public pressure.
Jeffhans1
1 / 5 (1) Jun 22, 2018
Driverless car create new possibilities for anti-government protest. Today only the brave will sit down in a road to stop traffic. No one wants to anger and frustrate drivers who cannot be relied to not try and avoid you. But driverless car can be trusted to stop and stay paralyzed. Imagine an antigovernment movement in which individuals randomly forced the stopping of driverless cars. Government could be made more vulnerable with driverless cars not less to public pressure.


The cameras and sensors in the cars will easily identify the morons blocking a road and they will find themselves with arrest warrants long before the cops arrive.
bruce33333
3 / 5 (2) Jun 23, 2018
Boy am I glad I'm older and not young. This article is correct; the future looks horrible in terms of how easy it will be to control people with almost any digital technology that "calls home." The only thing that can stop this from happening is a very organized populace, well informed and constantly fighting against everything that centralizes control. Unfortunately, I don't see much of that happening, and it really pains me when I hear naive young people saying basically that they don't care about privacy disappearing because they don't have anything to hide. Most seem to have little education of history and are so lost in their multiple, digital social identities, that they can't see what's coming. Well, its probably all down hill from here, folks, and that's sad. It looked like we had a chance for awhile, but it won't be long now before its too late to stop it. I don't look forward to the next 10 or 15 years that I have left. Its going to be quite painful to watch.
TheGhostofOtto1923
not rated yet Jun 24, 2018
"There's a reason why governments are so keen on driverless cars – and it's not just because of the potential economic benefits. They offer the chance for even greater tracking and even control of citizens' every move. Far from setting us free, driverless cars threaten to help enable new forms of surveillance and oppression."

-I knew it, this article smelled bad from the start. The only people who this tech will be oppressing are the careless, thoughtless, impaired, emotional humans who currently have the freedom to wreak havoc on the highway.

" If anyone doesn't like what we're doing, they will be able to stop us..."

-Psst hey buddy, they've been able to do that for some time now. Cops are everywhere. AI will only remove the freedom of scofflaws like yourself to try to evade and elude them.

Sorry. Back in your cage Vin Diesel. Domestications a bitch no?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.