Computer scientist reviews frontier technologies to determine fundamental limits of computer scaling

August 13, 2014
Can our computers continue to get smaller and more powerful?
Advanced techniques such as 'structured placement,' shown here and developed by Markov's group, are currently being used to wring out optimizations in chip layout. Different circuit modules on an integrated circuit are shown in different colors. Algorithms for placement optimize both the locations and the shapes of modules; some nearby modules can be blended when this reduces the length of the connecting wires. Credit: Jin Hu, Myung-Chul Kim, Igor L. Markov, University of Michigan

From their origins in the 1940s as sequestered, room-sized machines designed for military and scientific use, computers have made a rapid march into the mainstream, radically transforming industry, commerce, entertainment and governance while shrinking to become ubiquitous handheld portals to the world.

This progress has been driven by the industry's ability to continually innovate techniques for packing increasing amounts of computational circuitry into smaller and denser microchips. But with miniature now containing millions of closely-packed transistor components of near atomic size, chip designers are facing both engineering and fundamental limits that have become barriers to the continued improvement of computer performance.

Have we reached the limits to computation?

In a review article in this week's issue of the journal Nature, Igor Markov of the University of Michigan reviews limiting factors in the development of computing systems to help determine what is achievable, identifying "loose" limits and viable opportunities for advancements through the use of emerging technologies. His research for this project was funded in part by the National Science Foundation (NSF).

"Just as the second law of thermodynamics was inspired by the discovery of heat engines during the industrial revolution, we are poised to identify fundamental laws that could enunciate the limits of computation in the present information age," says Sankar Basu, a program director in NSF's Computer and Information Science and Engineering Directorate. "Markov's paper revolves around this important intellectual question of our time and briefly touches upon most threads of scientific work leading up to it."

The article summarizes and examines limitations in the areas of manufacturing and engineering, design and validation, power and heat, time and space, and information and .

Can our computers continue to get smaller and more powerful?
The image on the right shows the physical placement of a large integrated circuit with logic gates in blue and 'packing peanuts' (spacers) in red. The 'heat maps' on the left show wiring congestion -- green and yellow show sparse connectivity, but red and purple show insufficient routing resources. Routing congestion is one of the manifestations of physical limits to computation. The progression of images illustrates how computer-aided design tools address routing congestion by revising circuit placement. Credit: Myung-Chul Kim, Jin Hu, Igor L. Markov, University of Michigan

"What are these limits, and are some of them negotiable? On which assumptions are they based? How can they be overcome?" asks Markov. "Given the wealth of knowledge about limits to computation and complicated relations between such limits, it is important to measure both dominant and emerging technologies against them."

Limits related to materials and manufacturing are immediately perceptible. In a material layer ten atoms thick, missing one atom due to imprecise manufacturing changes electrical parameters by ten percent or more. Shrinking designs of this scale further inevitably leads to quantum physics and associated limits.

Limits related to engineering are dependent upon design decisions, technical abilities and the ability to validate designs. While very real, these limits are difficult to quantify. However, once the premises of a limit are understood, obstacles to improvement can potentially be eliminated. One such breakthrough has been in writing software to automatically find, diagnose and fix bugs in hardware designs.

Limits related to power and energy have been studied for many years, but only recently have found ways to improve the energy consumption of processors by temporarily turning off parts of the chip. There are many other clever tricks for saving energy during computation. But moving forward, silicon chips will not maintain the pace of improvement without radical changes. Atomic physics suggests intriguing possibilities but these are far beyond modern engineering capabilities.

Limits relating to time and space can be felt in practice. The speed of light, while a very large number, limits how fast data can travel. Traveling through copper wires and silicon transistors, a signal can no longer traverse a chip in one clock cycle today. A formula limiting parallel computation in terms of device size, communication speed and the number of available dimensions has been known for more than 20 years, but only recently has it become important now that transistors are faster than interconnections. This is why alternatives to conventional wires are being developed, but in the meantime mathematical optimization can be used to reduce the length of wires by rearranging transistors and other components.

Several key limits related to information and computational complexity have been reached by modern computers. Some categories of computational tasks are conjectured to be so difficult to solve that no proposed technology, not even quantum computing, promises consistent advantage. But studying each task individually often helps reformulate it for more efficient computation.

When a specific limit is approached and obstructs progress, understanding the assumptions made is key to circumventing it. Chip scaling will continue for the next few years, but each step forward will meet serious obstacles, some too powerful to circumvent.

What about breakthrough technologies? New techniques and materials can be helpful in several ways and can potentially be "game changers" with respect to traditional limits. For example, carbon nanotube transistors provide greater drive strength and can potentially reduce delay, decrease energy consumption and shrink the footprint of an overall circuit. On the other hand, —sometimes not initially anticipated—tend to obstruct new and emerging technologies, so it is important to understand them before promising a new revolution in power, performance and other factors.

"Understanding these important limits," says Markov, "will help us to bet on the right new techniques and technologies."

Explore further: IBM to spend $3 bn aiming for computer chip breakthrough

More information: Limits on fundamental limits to computation, Nature, DOI: 10.1038/nature13570

Related Stories

Project at IBM looks to carbon nanotube future

July 2, 2014

How can miniaturization continue beyond the limits of current silicon-based device technology? A project at IBM aims to have transistors built using carbon nanotubes, ready to take over from silicon transistors in the coming ...

A step closer to a photonic future

February 19, 2014

The future of computing may lie not in electrons, but in photons – that is, in microprocessors that use light instead of electrical signals. But these so-called photonic devices are typically built using customized methods ...

Recommended for you

WhatsApp vulnerable to snooping: report

January 13, 2017

The Facebook-owned mobile messaging service WhatsApp is vulnerable to interception, the Guardian newspaper reported on Friday, sparking concern over an app advertised as putting an emphasis on privacy.

US gov't accuses Fiat Chrysler of cheating on emissions

January 12, 2017

The U.S. government accused Fiat Chrysler on Thursday of failing to disclose software in some of its pickups and SUVs with diesel engines that allows them to emit more pollution than allowed under the Clean Air Act.


Adjust slider to filter visible comments by rank

Display comments: newest first

2.3 / 5 (3) Aug 14, 2014
Move along, nothing to read here!
1 / 5 (2) Aug 14, 2014
So, WTF are the limits? Another fact free article from Physorg
not rated yet Aug 14, 2014
So, WTF are the limits? Another fact free article from Physorg

And the banal comments. I demand a refund!

On topic: For a bit in the future we can always fall back on the structure of biological gray matter as a paradigm of how to more efficiently solve some computational problems. Fewer and fewer problems though.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.