# Explained: Linear and nonlinear systems

##### Feb 26, 2010 by Larry Hardesty

Much scientific research across a range of disciplines tries to find linear approximations of nonlinear behaviors. But what does that mean?

Spend some time browsing around the web site of MIT’s and Artificial Intelligence Laboratory, and you'll find hundreds if not thousands of documents with titles like "On Modeling Nonlinear Shape-and-Texture Appearance Manifolds" and "Non-linear Drawing systems," or, on the contrary, titles like “Packrat Parsing: Simple, Powerful, Lazy, Linear Time” and "Linear-Time-Encodable and List-Decodable Codes."

The distinction between linear and nonlinear phenomena is everywhere in the sciences and engineering. But what exactly does it mean?

Suppose that, without much effort, you can toss a tennis ball at about 20 miles per hour. Now suppose that you’re riding a bicycle at 10 miles per hour and toss a tennis ball straight ahead. The ball will travel forward at 30 miles per hour. Linearity is, essentially, the idea that combining two inputs — like the velocity of your arm and the velocity of the bike — will yield the sum of their respective outputs — the velocity of the ball.

Now suppose that, instead of tossing a tennis ball, you toss a paper airplane. Depending on the airplane’s design, it might sail straight ahead, or it might turn loops. Some paper planes seem to behave more erratically the harder you throw them: the bike’s added velocity might make it almost impossible to get the plane to do anything predictable. That’s because airflow over a paper plane’s wings can be very nonlinear.

If the had built-in and an onboard computer, it could calculate the of the tennis ball in a fraction of a second. But it could never hope to calculate all the airflows over the paper plane’s wing in time to do anything useful. “I think that it’s a reasonable statement that we mostly understand linear phenomena,” says Pablo Parrilo, the Finmeccanica Career Development Professor of Engineering MIT’s Laboratory for Information and Decision Systems.

To make the distinction between linearity and nonlinearity a bit more precise, recall that a mathematical equation can be thought of as a function — something that maps inputs to outputs. The equation y = x, for instance, is equivalent to a function that takes as its input a value for x and produces as its output a value for y. The same is true of y = x2.

The equation y = x is linear because adding together inputs yields the sum of their respective outputs: 1 = 1, 2 = 2, and 1 + 2 = 1 + 2. But that’s not true of y = x2: if x is 1, y is 1; if x is 2, y is 4; but if x is 3, y is not 5.

This example illustrates the origin of the term “linear”: the graph of y = x is a straight line, while the graph of y = x2 is a curve. But the basic definition of linearity holds for much more complicated equations, such as the differential equations used in engineering to describe dynamic systems.

While linear functions are easy enough to define, the term “nonlinear” takes in everything else. “There’s this famous quote — I’m not sure who said it first — that the theory of nonlinear systems is like a theory of non-elephants,” Parrilo says. “It’s impossible to build a theory of nonlinear systems, because arbitrary things can satisfy that definition.” Because linear equations are so much easier to solve than nonlinear ones, much research across a range of disciplines is devoted to finding linear approximations of nonlinear phenomena.

Russ Tedrake, for example, the X Consortium Associate Professor of Electrical Engineering and Computer Science at MIT, has adapted theoretical work done by Parrilo to create novel control systems for robots. A walking robot’s gait could be the result of a number of mechanical systems working together in a nonlinear way. The collective forces exerted by all those systems might be impossible to calculate on the fly. But within a narrow range of starting conditions, a linear equation might describe them well enough for practical purposes. Parrilo’s theoretical tools allow Tedrake to determine how well a given linear approximation will work within how wide a range of starting conditions. His control system thus consists of a whole battery of linear control equations, one of which is selected depending on the current state of the robot.

Explore further: Optimising the future with mathematics

## Related Stories

#### Nonlinear thinker: Making sense of previously insoluble problems

Jan 29, 2010

If an airplane is cruising along and raises the flaps on its wings a degree or two, it will tilt upward. If it raises the flaps twice as much, it will tilt upward about twice as much. But if it tilts upward ...

#### Solving big problems with new quantum algorithm

Nov 09, 2009

(PhysOrg.com) -- In a recently published paper, Aram Harrow at the University of Bristol and colleagues from MIT in the United States have discovered a quantum algorithm that solves large problems much faster ...

#### Quantum computing may actually be useful, after all

Oct 09, 2009

(PhysOrg.com) -- In recent years, quantum computers have lost some of their luster. In the 1990s, it seemed that they might be able to solve a class of difficult but common problems — the so-called NP-complete ...

#### Study Shows Time Traveling May Not Increase Computational Power

Oct 22, 2009

(PhysOrg.com) -- For more than 50 years, physicists have been intrigued by the concept of closed time-like curves (CTCs). Because a CTC returns to its starting point, it raises the possibility of traveling backward in time. ...

#### Being Isaac Newton: Computer derives natural laws from raw data

Apr 02, 2009

If Isaac Newton had access to a supercomputer, he'd have had it watch apples fall - and let it figure out the physical matters. But the computer would have needed to run an algorithm, just developed by Cornell ...

#### New study cites lower rate of quakes along some subduction zones

Dec 04, 2009

Most earthquakes occur along fault lines, which form boundaries between two tectonic plates. As the relative speed of the plates around a fault increases, is there a corresponding increase in the number of earthquakes produced ...

## Recommended for you

#### Giving dangerous employees socialization, close supervision can avoid problems

8 hours ago

Two UT Arlington management professors argue that employers can prevent workplace violence by keeping dangerous employees positively engaged and closely supervising them to ensure they get the help they need.

#### Gift giving 101: When do 'perfect' gifts backfire?

13 hours ago

When it comes to shopping for gifts, we try to select things we think people both want and need. According to a new study in the Journal of Consumer Research, focusing too much on the gift recipient can lead to giving the gi ...

#### What's the upside of feeling too sad for chocolate?

13 hours ago

The instant gratification and the pleasure derived from consuming excessive chocolate and deep-fried foods can lead way to a double-edged sword of negative consequences ranging from weight gain to feelings of low self-esteem. ...

#### Study shows men and women both biased against women's math abilities

13 hours ago

(Phys.org) —A study conducted by business and economic researchers Ernesto Reuben, Paola Sapienza, and Luigi Zingales, has found that both men and women hold biases against women's math abilities. In their ...

#### Power play: Empowered consumers are more likely to switch brands

13 hours ago

As consumers, we form favorite brands and select services providers from a plethora of choices. According to a new study in the Journal of Consumer Research, how powerful we feel in our daily lives may impact our likelihood of swi ...

#### Study finds investors prefer good-looking male backed entrepreneurial ventures

13 hours ago

(Phys.org) —A study conducted by a team of researchers from Harvard, Wharton and MIT has revealed that venture capitalists prefer to back entrepreneurial opportunities when pitched by a man and that they ...

## More news stories

#### Study shows men and women both biased against women's math abilities

(Phys.org) —A study conducted by business and economic researchers Ernesto Reuben, Paola Sapienza, and Luigi Zingales, has found that both men and women hold biases against women's math abilities. In their ...

#### Study finds investors prefer good-looking male backed entrepreneurial ventures

(Phys.org) —A study conducted by a team of researchers from Harvard, Wharton and MIT has revealed that venture capitalists prefer to back entrepreneurial opportunities when pitched by a man and that they ...

#### Study suggests more than two hours of homework a night may be counterproductive

Education scholar Denise Pope has found that too much homework has negative effects on student well-being and behavioral engagement.

#### New analyses verify the use of fire by Peking Man

Zhoukoudian Locality 1 in northern China has been widely known for the discovery of the Middle Pleistocene human ancestor Homo erectus pekinensis ( known as Peking Man ) since the 1920s. By 1931, the suggestion ...

#### Gift giving 101: When do 'perfect' gifts backfire?

When it comes to shopping for gifts, we try to select things we think people both want and need. According to a new study in the Journal of Consumer Research, focusing too much on the gift recipient can lead to giving the gi ...

#### Liver transplant may arrest neurological damage in a rare and progressive form of autism

A patient with a rare metabolic disease that causes liver failure and autistic behavior experienced significant improvements in both her physical and mental health after receiving a liver transplant, according to a new case ...

#### World's first 3-D acoustic cloaking device hides objects from sound

(Phys.org) —Using little more than a few perforated sheets of plastic and a staggering amount of number crunching, Duke engineers have demonstrated the world's first three-dimensional acoustic cloak. The ...

#### At tech fest: 3D printers, bitcoin and 'Titanfall'

Bitcoin, 3-D printed candy and George Takei, the Star Trek-actor-turned-Facebook-phenomenon, are among the attractions this week at the South By Southwest festival in Austin, Texas, where the geek set is ...

#### Long-term warming likely to be significant despite recent slowdown

A new NASA study shows Earth's climate likely will continue to warm during this century on track with previous estimates, despite the recent slowdown in the rate of global warming.

#### London launches hi-tech trial for pedestrian safety

(Phys.org) —London is trying out intelligent pedestrian technology to make crossing the road easier and safer. Announced earlier this month, the technology is said to be the first scheme of its kind in ...