Software to unlock the power of grids

Jul 13, 2009
Software to unlock the power of grids

( -- A huge amount of computing power sits idle most of the time, and new technologies enabling the sharing of resources aim to capitalise on that. Now European researchers have developed software to simultaneously run applications on very different IT infrastructures.

Unlocking the power of has become one of the top priorities in the IT world. Optimising the use of existing resources rather than deploying new infrastructure is becoming increasingly important in the current economic climate.

At the same time, applications are taking longer to execute using traditional computing methods, with the amount of data being processed increasing at a rapid pace. This presents a problem because is not keeping up with demand.

Moore’s Law predicted that the processing power of , or chips, would roughly double every 18 months. This has held true from the late 1950s until recently - the exponential growth has finally slowed down as the miniaturisation of components is nearing its limit.

An EU-funded project, GridCOMP, has been working around this conundrum by developing some clever software and middleware which allows applications to run on several, or even many, computers at the same time regardless of different infrastructures and architectures.

Parallel computing the way forward

The project’s scientific coordinator Denis Caromel says: “We have been developing an open source suite of products to allow parallel, distributed, multi-core computing. What this means is that an application can be run on a series of machines, or a cluster of servers, or an enterprise grid comprising many machines and even all the way up to cloud computing, or any combination of these.”

An example of this would be the heavy-duty enterprise data processing used by financial institutions or telecoms operators. These huge applications typically take a long time to run and make often-inefficient use of a large amount of internal .

What the project’s ProActive Parallel Software Suite does is to allow an organisation to use all of its computing hardware - wherever in the world it is based, and whatever manufacturer it is made by - to run an application simultaneously. If there is not enough computing power inhouse, then outside resources, such as cloud computing where processing power is rented from other companies, can also be deployed.

What is particularly clever about the software, though, is its automatic ability to monitor quality of service (QOS) on a real-time basis, and add or remove processing power as required. “If there is an expected QOS of (for example) several seconds, and the system sees this degrading to, say, a minute, then it will automatically add new resources, be they internal or external, for as long as they are needed,” Caromel explains.

Developing new standards

The project worked alongside the European standards body, ETSI, while developing the components of GridCOMP. During the course of the project, four standards were developed and approved by ETSI and are now officially available on the body’s standards sheet. The project was also supported by many of the big names in IT and telecoms, including IBM, Sun, Oracle, HP, NEC, Alcatel Lucent, top Chinese equipment maker Huawei, Nokia Siemens, British Telecom, France Telecom/Orange and Telefonica/O2.

Field trials of the software were also conducted to develop different use cases. One of these was with a major telco in the field of extended data record (EDR) processing. Information from the millions of calls made by customers is processed following a set of rules and, from the processed data, useful conclusions can be drawn and valuable business knowledge obtained.

Prior to GridCOMP, the transformation took a lot of time and required a considerable amount of computing resources. But with GridCOMP the telco was able to use multi-platform, low-cost hardware instead of single platform, expensive hardware.

GridCOMP also replaced high management costs with automatic management providing built-in redundancy and fault tolerance and made a process which was difficult and expensive into one which was cheap and easy to scale. And expensive, commercial, closed-source software was replaced by a free open-soft framework.

Cutting down on costs

A second use case was at IBM where a biometric identification system (BIS), based on fingerprint matching, was built using the project’s software. It was proved to work on a large user population in real time while being easily scalable and cost efficient.

The third use case involved keeping tables on unpaid invoices in a large organisation, while a fourth aimed to largely replace expensive wind tunnels in aircraft design with a computerised simulation. Both proved highly successful.

On the back of this success, a commercial entity - a professional open source company called ActiveEon - has also been spun off from the project to support users of the ProActive Parallel Software Suite and be their partners in accelerating and scaling applications.

Caromel expects it to be a success, as more and more companies look at ways to improve efficiency, cut costs and utilise existing resources to the full.

GridCOMP has been funded under the ICT strand of the EU’s Sixth Framework Programme for research.

More information: Watch videos of GridCOMP protoypes and use cases.

Explore further: Making smartphone browsing 20% faster while reducing power consumption by 40%

add to favorites email to friend print save as pdf

Related Stories

IBM Introduces Ready-to-Use Cloud Computing

Nov 15, 2007

In Shanghai today, IBM unveiled plans for “Blue Cloud,” a series of cloud computing offerings that will allow corporate data centers to operate more like the Internet by enabling computing across a distributed, ...

Foundations for the World Wide Grid

Nov 20, 2008

The dream of using the internet to allow people to access as much computer processing and storage power as they need, when they need it, is a step closer thanks to European researchers.

IBM to Build First Cloud Computing Center in China

Feb 01, 2008

IBM today announced it will establish the first Cloud Computing Center for software companies in China, which will be situated at the new Wuxi Tai Hu New Town Science and Education Industrial Park in Wuxi, China

Grids get down to business

Oct 13, 2008

( -- New technology developed by European researchers allows companies to deploy their business processes using grid computing and, even better, it validates a platform that gives easy access to grid resources. ...

As Grid problem solving flows smoothly

Dec 22, 2005

By developing the architecture to run Computational Fluid Dynamics (CFD) applications on the Grid, the IST programme-funded initiative has provided industrial and academic users with the ability to solve complex problems ...

Recommended for you

Microsoft beefs up security protection in Windows 10

5 hours ago

What Microsoft users in business care deeply about—-a system architecture that supports efforts to get their work done efficiently; a work-centric menu to quickly access projects rather than weather readings ...

US official: Auto safety agency under review

18 hours ago

Transportation officials are reviewing the "safety culture" of the U.S. agency that oversees auto recalls, a senior Obama administration official said Friday. The National Highway Traffic Safety Administration has been criticized ...

Out-of-patience investors sell off Amazon

18 hours ago

Amazon has long acted like an ideal customer on its own website: a freewheeling big spender with no worries about balancing a checkbook. Investors confident in founder and CEO Jeff Bezos' invest-and-expand ... domain sold for big payout

19 hours ago

The owners of the website have scored a big payday with the outbreak of the epidemic, selling the domain for more than $200,000 in cash and stock.

Hacker gets prison for cyberattack stealing $9.4M

23 hours ago

An Estonian man who pleaded guilty to orchestrating a 2008 cyberattack on a credit card processing company that enabled hackers to steal $9.4 million has been sentenced to 11 years in prison by a federal judge in Atlanta.

Magic Leap moves beyond older lines of VR

Oct 24, 2014

Two messages from Magic Leap: Most of us know that a world with dragons and unicorns, elves and fairies is just a better world. The other message: Technology can be mindboggingly awesome. When the two ...

User comments : 0