New Globus Online service to use the grid for high-performance file transfer

Nov 22, 2010 By Vas Vasiliadis

A new tool that will provide secure file–transfer service to manage large–scale data was introduced Nov. 18 at an international conference in New Orleans. Globus Online, which will use a cloud–based system rather than complex, custom information technology infrastructure, was displayed at SC10, an international conference for high–performance computing, networking, storage and analysis.

The team that created Globus is housed at the Computation Institute, a joint initiative between the University of Chicago and Argonne National Laboratory, and includes collaborators from the University of Southern California’s Information Sciences Institute and Lawrence Berkeley National Laboratory.

Globus Online automates the mundane but error–prone and time–consuming activity of moving files across wide area networks. Users can make their file–transfer request, and Globus Online will manage the entire operation, monitor performance, retry failed transfers and recover from faults automatically whenever possible so that users focus on their research.

The National Energy Research Scientific Computing Center was an early adopter of Globus Online and is now recommending the service to its users as a secure, fault–tolerant file–transfer solution.

“We are excited to offer a simplified, yet reliable data movement method to our users,” said David Skinner, group leader at NERSC. “As the collection of Globus Online endpoints grows, our users will be using the highest–performing wide area network–tuned systems with simplicity.”

Globus Online works across and between any servers that have the GridFTP installed, including systems at Department of Energy facilities such as NERSC, Oak Ridge, and Argonne; large–scale Globus based cyberinfrastructure in the United States and abroad, such as TeraGrid, Open Science Grid, European Grid Infrastructure, and Australian Research Collaboration Service; as well as many campus grids. Users can rapidly access this international pool of resources using Web, command line and Representation State Transfer interfaces, without installing any software.

“We are in an era of explosive data growth, where requirements for reliable data movement are more demanding, and distributed environments are more complex. Globus Online goes a long way toward helping users navigate this ‘perfect data storm’ without expensive, custom–built solutions,” said Ian Foster, director of the Computation Institute. “Building on our 15–year heritage with the Globus Toolkit, we continue to challenge ourselves to deliver innovative solutions for large–scale distributed computing.”

Commonly used file transfer mechanisms, such as the secure copy command found on most systems, require complex configuration for optimal performance and frequent attention from the user to deal with transient faults — perhaps the most frustrating aspect of distributed data management. Globus Online transparently handles faults by re–trying failed transfers and provides detailed logs for users and service operators to understand the reasons behind any failed transfers.

Managing security across multiple domains has traditionally been a challenge for grid users. Globus Online manages multiple security credentials automatically on behalf of users. When a certificate expires, for example, Globus Online suspends the file transfer, notifies the user and automatically resumes when a valid credential is received.

In its current release, Globus Online allows users to move files between systems with GridFTP installed. Upcoming releases will add support for HTTP, opening up the service to any file system with access to a Web server, as well as InCommon, allowing members of many academic and research institutions to access the service using their existing campus logins.

Explore further: Android gains in US, basic phones almost extinct

add to favorites email to friend print save as pdf

Related Stories

New technology enables high-speed data transfer

Jun 18, 2009

GridFTP, a protocol developed by researchers at Argonne National Laboratory, has been used to transfer unprecedented amounts of data over the Department of Energy's (DOE) Energy Sciences Network (ESnet), which provides a ...

How energy-efficient is cloud computing?

Oct 08, 2010

(PhysOrg.com) -- Conventionally, data storage and data processing are done at the user's own computer, using that computer's storage system and processor. An alternative to this method is cloud computing, ...

Recommended for you

Android gains in US, basic phones almost extinct

Apr 18, 2014

The Google Android platform grabbed the majority of mobile phones in the US market in early 2014, as consumers all but abandoned non-smartphone handsets, a survey showed Friday.

Hackathon team's GoogolPlex gives Siri extra powers

Apr 17, 2014

(Phys.org) —Four freshmen at the University of Pennsylvania have taken Apple's personal assistant Siri to behave as a graduate-level executive assistant which, when asked, is capable of adjusting the temperature ...

Microsoft CEO is driving data-culture mindset

Apr 16, 2014

(Phys.org) —Microsoft's future strategy: is all about leveraging data, from different sources, coming together using one cohesive Microsoft architecture. Microsoft CEO Satya Nadella on Tuesday, both in ...

User comments : 0

More news stories

Ex-Apple chief plans mobile phone for India

Former Apple chief executive John Sculley, whose marketing skills helped bring the personal computer to desktops worldwide, says he plans to launch a mobile phone in India to exploit its still largely untapped ...

Airbnb rental site raises $450 mn

Online lodging listings website Airbnb inked a $450 million funding deal with investors led by TPG, a source close to the matter said Friday.

Health care site flagged in Heartbleed review

People with accounts on the enrollment website for President Barack Obama's signature health care law are being told to change their passwords following an administration-wide review of the government's vulnerability to the ...

A homemade solar lamp for developing countries

(Phys.org) —The solar lamp developed by the start-up LEDsafari is a more effective, safer, and less expensive form of illumination than the traditional oil lamp currently used by more than one billion people ...

NASA's space station Robonaut finally getting legs

Robonaut, the first out-of-this-world humanoid, is finally getting its space legs. For three years, Robonaut has had to manage from the waist up. This new pair of legs means the experimental robot—now stuck ...

Filipino tests negative for Middle East virus

A Filipino nurse who tested positive for the Middle East virus has been found free of infection in a subsequent examination after he returned home, Philippine health officials said Saturday.

Egypt archaeologists find ancient writer's tomb

Egypt's minister of antiquities says a team of Spanish archaeologists has discovered two tombs in the southern part of the country, one of them belonging to a writer and containing a trove of artifacts including reed pens ...