Neural networks enable learning of error correction strategies for quantum computers

October 25, 2018, Max Planck Society
Learning quantum error correction: the image visualizes the activity of artificial neurons in the Erlangen researchers' neural network while it is solving its task. Credit: Max Planck Institute for the Science of Light

Quantum computers could solve complex tasks that are beyond the capabilities of conventional computers. However, the quantum states are extremely sensitive to constant interference from their environment. The plan is to combat this using active protection based on quantum error correction. Florian Marquardt, Director at the Max Planck Institute for the Science of Light, and his team have now presented a quantum error correction system that is capable of learning thanks to artificial intelligence.

In 2016, the computer program AlphaGo won four out of five games of Go against the world's best human player. Given that a of Go has more combinations of moves than there are estimated to be atoms in the universe, this required more than just sheer processing power. Rather, AlphaGo used , which can recognize visual patterns and are even capable of learning. Unlike a human, the program was able to practise hundreds of thousands of games in a short time, eventually surpassing the best human player. Now, the Erlangen-based researchers are using neural networks of this kind to develop error-correction learning for a quantum computer.

Artificial neural networks are computer programs that mimic the behaviour of interconnected nerve cells (neurons) - in the case of the research in Erlangen, around two thousand artificial neurons are connected with one another. "We take the latest ideas from computer science and apply them to physical systems," explains Florian Marquardt. "By doing so, we profit from rapid progress in the area of artificial intelligence."

Artificial neural networks could outstrip other error-correction strategies

The first area of application are quantum computers, as shown by the recent paper, which includes a significant contribution by Thomas Fösel, a doctoral student at the Max Planck Institute in Erlangen. In the paper, the team demonstrates that artificial neural networks with an AlphaGo-inspired architecture are capable of learning—for themselves—how to perform a task that will be essential for the operation of future quantum computers: . There is even the prospect that, with sufficient training, this approach will outstrip other error-correction strategies.

To understand what it involves, you need to look at the way quantum computers work. The basis for quantum information is the quantum bit, or qubit. Unlike conventional digital bits, a qubit can adopt not only the two zero and one, but also superpositions of both states. In a quantum computer's processor, there are even multiple qubits superimposed as part of a joint state. This entanglement explains the tremendous processing power of quantum computers when it comes to solving certain complex tasks at which conventional computers are doomed to fail. The downside is that quantum information is highly sensitive to noise from its environment. This and other peculiarities of the quantum world mean that quantum information needs regular repairs—that is, quantum error correction. However, the operations that this requires are not only complex but must also leave the quantum information itself intact.

Quantum error-correction is like a game of Go with strange rules

"You can imagine the elements of a quantum computer as being just like a Go board," says Marquardt, getting to the core idea behind his project. The qubits are distributed across the board like pieces. However, there are certain key differences from a conventional game of Go: all the pieces are already distributed around the board, and each of them is white on one side and black on the other. One colour corresponds to the state zero, the other to one, and a move in a game of quantum Go involves turning pieces over. According to the rules of the quantum world, the pieces can also adopt grey mixed colours, which represent the superposition and entanglement of quantum states.

When it comes to playing the game, a player—we'll call her Alice—makes moves that are intended to preserve a pattern representing a certain quantum state. These are the quantum error correction operations. In the meantime, her opponent does everything they can to destroy the pattern. This represents the constant noise from the plethora of interference that real qubits experience from their environment. In addition, a game of quantum Go is made especially difficult by a peculiar quantum rule: Alice is not allowed to look at the board during the game. Any glimpse that reveals the state of the pieces to her destroys the sensitive quantum state that the game is currently occupying. The question is: how can she make the right moves despite this?

Auxiliary qubits reveal defects in the quantum computer

In quantum computers, this problem is solved by positioning additional qubits between the qubits that store the actual quantum information. Occasional measurements can be taken to monitor the state of these auxiliary qubits, allowing the quantum computer's controller to identify where faults lie and to perform correction operations on the information-carrying qubits in those areas. In our game of quantum Go, the auxiliary qubits would be represented by additional pieces distributed between the actual game pieces. Alice is allowed to look occasionally, but only at these auxiliary pieces.

In the Erlangen researchers' work, Alice's role is performed by artificial neural networks. The idea is that, through training, the networks will become so good at this role that they can even outstrip correction strategies devised by intelligent human minds. However, when the team studied an example involving five simulated qubits, a number that is still manageable for conventional computers, they were able to show that one artificial neural alone is not enough. As the network can only gather small amounts of information about the state of the quantum bits, or rather the game of quantum Go, it never gets beyond the stage of random trial and error. Ultimately, these attempts destroy the quantum state instead of restoring it.

One neural network uses its prior knowledge to train another

The solution comes in the form of an additional neural network that acts as a teacher to the first network. With its prior knowledge of the quantum computer that is to be controlled, this teacher network is able to train the other network—its student—and thus to guide its attempts towards successful quantum correction. First, however, the teacher network itself needs to learn enough about the quantum computer or the component of it that is to be controlled.

In principle, artificial neural networks are trained using a reward system, just like their natural models. The actual reward is provided for successfully restoring the original quantum state by quantum error correction. "However, if onliy the achievement of this long-term aim gave a reward, it would come at too late a stage in the numerous correction attempts," Marquardt explains. The Erlangen-based researchers have therefore developed a reward system that, even at the training stage, incentivizes the teacher neural network to adopt a promising strategy. In the game of quantum Go, this reward system would provide Alice with an indication of the general state of the game at a given time without giving away the details.

The student network can surpass its teacher through its own actions

"Our first aim was for the teacher network to learn to perform successful quantum error correction operations without further human assistance," says Marquardt. Unlike the school student network, the teacher network can do this based not only on measurement results but also on the overall quantum state of the . The student network trained by the teacher network will then be equally good at first, but can become even better through its own actions.

In addition to error correction in computers, Florian Marquardt envisages other applications for artificial intelligence. In his opinion, physics offers many systems that could benefit from the use of pattern recognition by artificial neural networks.

Explore further: Ion qubits offer early glimpse of quantum error detection

More information: Thomas Fösel et al, Reinforcement Learning with Neural Networks for Quantum Feedback, Physical Review X (2018). DOI: 10.1103/PhysRevX.8.031084

Related Stories

Ion qubits offer early glimpse of quantum error detection

November 9, 2017

Computers based on quantum physics promise to solve certain problems much faster than their conventional counterparts. By utilizing qubits—which can have more than just the two values of ordinary bits—quantum computers ...

First proof of quantum computer advantage

October 18, 2018

For many years, quantum computers were not much more than an idea. Today, companies, governments and intelligence agencies are investing in the development of quantum technology. Robert König, professor for the theory of ...

Researchers 'teleport' a quantum gate

September 5, 2018

Yale University researchers have demonstrated one of the key steps in building the architecture for modular quantum computers: the "teleportation" of a quantum gate between two qubits, on demand.

Quantum 'hack' to unleash computing power

February 1, 2018

Physicists at the University of Sydney have found a 'quantum hack' that should allow for enormous efficiency gains in quantum computing technologies.

Recommended for you

Helping Marvel superheroes to breathe

November 18, 2018

Marvel comics superheroes Ant-Man and the Wasp—nom de guerre stars of the eponymous 2018 film—possess the ability to temporarily shrink down to the size of insects, while retaining the mass and strength of their normal ...

Scientists explain how wombats drop cubed poop

November 18, 2018

Wombats, the chubby and beloved, short-legged marsupials native to Australia, are central to a biological mystery in the animal kingdom: How do they produce cube-shaped poop? Patricia Yang, a postdoctoral fellow in mechanical ...

Explaining a fastball's unexpected twist

November 18, 2018

An unexpected twist from a four-seam or a two-seam fastball can make the difference in a baseball team winning or losing the World Series. However, "some explanations regarding the different pitches are flat-out wrong," said ...

Scientists produce 3-D chemical maps of single bacteria

November 16, 2018

Scientists at the National Synchrotron Light Source II (NSLS-II)—a U.S. Department of Energy (DOE) Office of Science User Facility at DOE's Brookhaven National Laboratory—have used ultrabright x-rays to image single bacteria ...

Quantum science turns social

November 15, 2018

Researchers in a lab at Aarhus University have developed a versatile remote gaming interface that allowed external experts as well as hundreds of citizen scientists all over the world to optimize a quantum gas experiment ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.