Independent research group testing D-Wave Two finds no quantum speedup

June 20, 2014 by Bob Yirka report
Pictured is D-Wave’s current 512-qubit version. Credit: Courtesy of D-Wave Systems Inc.

( —An independent research team with members affiliated with several universities in the U.S. and Switzerland has concluded that the D-Wave Two computer shows no signs of quantum speedup. They've written a paper describing how they tested one of the computers that was purchased by Lockheed Martin and the results they found and have had it published in the journal Science.

Scientists would really like to build a truly quantum computer, the benefits it would offer would almost certainly be groundbreaking, leading to new discoveries in and other areas—plus it would likely allow for speeding up processer intensive applications like weather forecasting. Unfortunately, such a computer is still decades away, and that's assuming building one is really possible at all. In the meantime, researchers have made progress in building machines that are partially quantum, and one company D-Wave Systems, a startup in Burnaby, Canada has made one such machine for sale. Because of the high price, only a few have been sold, to Lockheed Martin, Google and likely some entities that have not been made public. Prime applications for such a machine are those that are analogous to seeking a lowest point or deepest valley in hilly terrain. Conventional machines must traverse all the hills and valleys to find a solution, while a machine such as the D-Wave (a quantum annealer that takes advantage of ) should be able to burrow though the hills to gain direct access to the valleys.

Since announcing its first machine, D-Wave representatives have maintained that their machine is capable of quantum speedup (running an application faster than a conventional computer) for certain applications. After running some tests on the machine it purchased, a team at Google backed up the claim.

Others, particularly in the physics community, have been skeptical, suggesting the results obtained by the Google team came about due to unfair comparisons—problems designed to run well on the D-Wave Systems were run without optimizing on conventional machines. In this new effort, the team sought to test the latest version of the D-Wave machine to see if they could determine if the machine is actually capable of quantum speedup.

The team ran 1000 random optimization problems on the 503-qubit D-Wave Two device measuring how long it took to solve them, compared with a classical PC. They report that while some ran somewhat faster, others ran a lot slower. They report that they found no evidence of quantum speedup.

To be fair, the team is not claiming the machine to be a fraud, instead, they note that the machine they tested failed to show quantum speedup under the conditions in which it was tested. They are not ruling out the possibility that the computer could show quantum speedup under other conditions.

The results found by the independent group aren't likely to spell doom for the D-Wave machines, though the company that makes them is likely to face more skepticism going forward. It appears doubts will only be erased if more research conducted covering many more conditions are able to validate the initial claims.

Explore further: Stronger benchmarks needed to fully quantify quantum speedup, physicist says

More information: 1. Paper: Defining and detecting quantum speedup, Science DOI: 10.1126/science.1252319

The development of small-scale quantum devices raises the question of how to fairly assess and detect quantum speedup. Here we show how to define and measure quantum speedup, and how to avoid pitfalls that might mask or fake such a speedup. We illustrate our discussion with data from tests run on a D-Wave Two device with up to 503 qubits. Using random spin glass instances as a benchmark, we find no evidence of quantum speedup when the entire data set is considered, and obtain inconclusive results when comparing subsets of instances on an instance-by-instance basis. Our results do not rule out the possibility of speedup for other classes of problems and illustrate the subtle nature of the quantum speedup question.

2. ETH Zurich Q&A: … /2014/06/d-wave.html

Related Stories

Quantum computing machine under scrutiny

March 18, 2014

A new and innovative computing machine is currently attracting a great deal of attention in specialist circles. A team under the leadership of Matthias Troyer, a professor at ETH Zurich, has now confirmed that the machine ...

D-Wave sells first commercial quantum computer

June 1, 2011

( -- Last week, Burnaby, British Columbia-based company D-Wave Systems, Inc., announced that it sold its first commercial quantum computer. Global security company Lockheed Martin, based in Bethesda, Maryland, ...

The road to quantum computing

May 15, 2014

Anticipating the advent of the quantum computer, related mathematical methods already provide insight into conventional computer science.

D-Wave chip passes rigorous tests

March 5, 2014

With cutting-edge technology, sometimes the first step scientists face is just making sure it actually works as intended.

Recommended for you

Carefully crafted light pulses control neuron activity

November 17, 2017

Specially tailored, ultrafast pulses of light can trigger neurons to fire and could one day help patients with light-sensitive circadian or mood problems, according to a new study in mice at the University of Illinois.

Strain-free epitaxy of germanium film on mica

November 17, 2017

Germanium, an elemental semiconductor, was the material of choice in the early history of electronic devices, before it was largely replaced by silicon. But due to its high charge carrier mobility—higher than silicon by ...

New imaging technique peers inside living cells

November 16, 2017

To undergo high-resolution imaging, cells often must be sliced and diced, dehydrated, painted with toxic stains, or embedded in resin. For cells, the result is certain death.

The stacked color sensor

November 16, 2017

Red-sensitive, blue-sensitive and green-sensitive color sensors stacked on top of each other instead of being lined up in a mosaic pattern – this principle could allow image sensors with unprecedented resolution and sensitivity ...


Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Jun 20, 2014
Pffft... Hocus pocus. If and when someone truly achieves this it will be obvious- just like cold fusion, dark matter, etc... Marketing gimmicks, IMO.
5 / 5 (1) Jun 20, 2014
h20dr, it seems you overestimate the power of quantum speed-up. There aren't really that many useful algorithms for universal quantum computers that show the kind of significant speed-up that for instance Shor's algorithm can achieve for factorization.

The D-Wave machines performs quantum annealing and operates with qubits (another Troyer et al. paper already showed that). But this doesn't automatically translate to magic super-performance. On the other hand this is new technology with chip structures much larger than our mature CMOS technology.
Jun 20, 2014
This comment has been removed by a moderator.
Jun 20, 2014
This comment has been removed by a moderator.
1 / 5 (1) Jun 20, 2014
Considering that the quantum machine is inherently probabilistic, one has to repeat the calculation many times to achieve a certain level of certainty over the result.

The question then becomes, why not design a conventional algorithm that uses a monte-carlo principle of guessing where the optimum point is by using a reduced number of pseudo-random searches over the problem space and simply letting it have a certain degree of error over the solution to reduce the number of calculations to the point where the margin of error is identical to the quantum computer - to achieve the same speedup over the quantum algorithm.

It's like finding the lowest point of the valley not by plumbing each and every point, but by dropping the line every mile, and then searching around a bit around the points. The quantum algorithm -might- be confident that there's a deep well somewhere if you ran the calculation a million times, but the chances of finding it over a million random drops could be equal.
not rated yet Jun 20, 2014
@Eikka There is such algorithm - it is called Simulated annealing.
not rated yet Jun 21, 2014
@Eikka There is such algorithm - it is called Simulated annealing.

So, how does it stack up against real quantum algorithms?
3 / 5 (2) Jun 21, 2014
I wish I could design a new brand kind of computer, which, on first generations matches or beats all the generations of standard computers made.

This computer haves less that a kilobit (kiloqubit?) and is roughly on the same league than standard state of the art silicon running at gigaherz speeds.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.