Scale-out processors: Bridging the efficiency gap between servers and emerging cloud workloads

Mar 21, 2012

Cloud computing has emerged as a dominant computing platform providing billions of users world-wide with online services. The software applications powering these services, commonly referred to as scale-out workloads and which include web search, social networking and business analytics, tend to be characterized by massive working sets, high degrees of parallelism, and real-time constraints – features that set them apart from desktop, parallel and traditional commercial server applications.

To support the growing popularity and continued expansion of cloud services, providers must overcome the physical space and power constraints that limit the growth of data centers. Problematically, the predominant processor micro-architecture is inherently inefficient for running these demanding scale-out workloads, which results in low compute density and poor trade-offs between performance and energy. Continuing the current trends for data production and analysis will further exacerbate these inefficiencies.

Improving the cloud’s computational resources whilst operating within physical constraints requires server efficiency to be optimized in order to ensure that server hardware meets the needs of scale-out workloads.

To this end, the team of HiPEAC member Babak Falsafi, a Professor in the School of Computer and Communication Sciences at EPFL, the director of the EcoCloud research center at EPFL (founded to innovate future energy-efficient and environmentally friendly cloud technologies), presented Clearing the Clouds: A Study of Emerging Workloads on Modern Hardware, which received the best paper award as ASPLOS 2012. ASPLOS is a flagship international computer systems venue with a high citation index.

“While we have been studying and tuning conventional server workloads (such as transaction processing and decision support) on hardware for over a decade, we really wanted to see how emerging scale-out workloads in modern datacenters behave.” says Falsafi. “To our surprise, we found that much of a modern server processor’s hardware resources including the cores, caches and off-chip connectivity are overprovisioned when running scale-out workloads leading to huge inefficiencies.”

Mike Ferdman, a senior PhD student team member explains: “efficiently executing scale-out workloads requires optimizing the instruction-fetch path for up to a few megabytes of program instructions, reducing the core complexity while increasing core counts, and shrinking the capacity of on-die caches to reduce area and power overheads.”

Scale-out Processors

“The insights from the evaluation are now driving us to develop server processors tuned to the demands of scale-out ”, says Boris Grot a postdoctoral team member. “In a paper that will appear in the flagship computer architecture conference, ISCA, this year, our team proposes the Scale-Out Processor, a processor organization that unlike current industrial chip design trends does away with power-hungry cores and much of on-die cache capacity and network fabric to free area and power for a large number of simple cores built around a streamlined memory hierarchy.” Not only do these improvements lead to greater performance and efficiency at the level of each chip, they also enable a net reduction in the total cost of ownership in datacenters.

Explore further: Canada says China hacked its science agency computers

add to favorites email to friend print save as pdf

Related Stories

Recommended for you

Microsoft unveils Xbox in China as it faces probe

20 minutes ago

Microsoft on Wednesday unveiled its Xbox game console in China, the first to enter the market after an official ban 14 years ago, even as it faces a Chinese government probe over business practices.

Teens love vacation selfies; adults, not so much

59 minutes ago

(AP)—Jacquie Whitt's trip to the Galapagos with a group of teenagers was memorable not just for the scenery and wildlife, but also for the way the kids preserved their memories. It was, said Whitt, a "selfie ...

Tiny UAVs and hummingbirds are put to test

1 hour ago

Hummingbirds in nature exhibit expert engineering skills, the only birds capable of sustained hovering. A team from the US, British Columbia, and the Netherlands have completed tests to learn more about the ...

US spy agency patents car seat for kids

4 hours ago

Electronic eavesdropping is the National Security Agency's forte, but it seems it also has a special interest in children's car seats, Foreign Policy magazine reported Wednesday.

User comments : 0