SLAC's X-ray laser explores big data frontier

June 14, 2013 by Glenn Roberts Jr., SLAC National Accelerator Laboratory
Managing large data is the topic for an upcoming National User Facility Organization annual meeting that will be held from June 19-21 at Lawrence Berkeley National Laboratory. SLAC's Amedeo Perazzo is scheduled to present a talk on "Data Management at the LCLS" at 1 p.m. June 20.

( —It's no surprise that the data systems for SLAC's Linac Coherent Light Source X-ray laser have drawn heavily on the expertise of the particle physics community, where collecting and analyzing massive amounts of data are key to scientific success.

With its detectors collecting information on atomic- and molecular-scale phenomena measured in quadrillionths of a second, LCLS stores data at a rate and scale comparable to experiments at the world's most powerful , the in Europe.

The LCLS data team manages about 10 of data from experiments – about three times more than the total data library for movie-streaming and rental company Netflix. That's enough data to fill about 2.2 million DVDs, which if stacked would stand about 8,800 feet high. An experiment at one LCLS instrument produces about 10 million X-ray images in about 48 hours, on average, with the largest experiments generating 150-200 terabytes (about 154,000 to 205,000 gigabytes) of data.

Big data gets bigger

Coupled with such head-spinning statistics is the unavoidable reality that this "big data" frontier in science is ever-growing, which presents constant challenges: At LCLS, more sensitive detectors, more complex experiments. Multiple simultaneous experiments, a possible increase in the laser and other planned upgrades will require advances in data acquisition, storage and delivery systems.

"Pretty soon we will be taking a factor of 20 more data than we are taking today," said Amedeo Perazzo, who leads the Photon Controls and Data Systems Department at SLAC, which manages LCLS data. "At that point we will not be able to operate in the same way we do now."

Scientific diversity presents unique challenges

Many of the people on Perazzo's staff have worked on experiments such as BaBar and ATLAS. And while the data demands at LCLS are similar to those of the high-energy physics community, the data team at LCLS has adapted to the varying needs of LCLS users, who come from a wide range of scientific backgrounds.

SLAC's Amedeo Perazzo discusses data management at the Linac Coherent Light Source X-ray laser.

"You have biologists and chemists and materials scientists and different kinds of physicists," said Igor Gaponenko, a research software developer for LCLS data systems. "It's a new world. It's very diverse."

In high-energy physics, scientists have a common vocabulary and standardized data systems, and individual experiments can run for years. But at LCLS, experiments typically run for only a few days, and scientists need immediate access to their data so they can decide whether to change samples or X-ray energies in the middle of an experiment.

LCLS users want "reliability, flexibility and immediacy," said Sebastien Carron Montero, an engineering physicist who works on data systems for the Atomic, Molecular and Optical Science instrument at LCLS. "To have all of them at the same time is very demanding. And each one of them is using different tools."

An equal playing field for data access

Carron Montero added that in particle physics it's common to immediately and aggressively filter the data to single out particular types of events. But at LCLS, "We tend to collect most of the data, which puts an enormous burden on our data system. That makes our system here quite big and difficult to manage."

The amount of data produced by experiments can vary widely, Perazzo said, noting that his team has upgraded the capabilities to capture up to 10 gigabytes per second, enough to handle the load from simultaneous experiments and larger detectors.

Some teams choose to store and analyze their data at SLAC, while others transfer data over high-speed scientific computing networks. Larger teams may bring their own data experts to LCLS for experiments.

There is a push to improve the user interface to make LCLS data tools more accessible to scientists, offer more real-time data during experiments, train staff to work more closely with users on learning the data systems and continue to work toward common data standards.

"Our job is to make it so all of the groups have the ability to extract science from the data. We need to find a language that works for the entire community and we need to lower the threshold that is required to start out," Perazzo said. "Something we have learned is that we really need to sit with them. We want to establish a closer relationship on the data-analysis side."

The next generation

As data demands increase, a likely solution will be the routine high-speed transfer of data to other data storehouses, where it can remain accessible for longer periods of time, freeing up LCLS to accept data from new experiments.

Perazzo said his department's system for handling LCLS data is scalable to meet these challenges, noting that other X-ray laser facilities launching over the next several years, including the European X-ray Free-Electron Laser project in Germany, are considering LCLS as a model for their own data systems.

"I do believe we are in the right spot," said Perazzo. "The next generation is actually looking at our systems."

Explore further: New X-ray tool proves timing is everything

Related Stories

New X-ray tool proves timing is everything

February 20, 2013

(—With SLAC's Linac Coherent Light Source X-ray laser, timing is everything. Its pulses are designed to explore atomic-scale processes that are measured in femtoseconds, or quadrillionths of a second. Determining ...

Sharper images for extreme LCLS experiments

April 17, 2013

( —An imaging technique conceived 50 years ago has been successfully demonstrated at SLAC's Linac Coherent Light Source, where it is expected to improve results in a range of experiments, including studies of extreme ...

X-ray laser pulses in two colors

March 27, 2013

( —SLAC researchers have demonstrated for the first time how to produce pairs of X-ray laser pulses in slightly different wavelengths, or colors, with finely adjustable intervals between them – a feat that will ...

X-rays capture electron 'dance'

January 31, 2013

(—The way electrons move within and between molecules, transferring energy as they go, plays an important role in many chemical and biological processes, such as the conversion of sunlight to energy in photosynthesis ...

X-ray laser research ranks in Science magazine's top 10

December 24, 2012

(—Research at SLAC's powerful X-ray laser that could lead to the development of specialized drugs to better combat African sleeping sickness has been recognized by Science magazine as one of the nine runners-up ...

Recommended for you

Walking crystals may lead to new field of crystal robotics

February 23, 2018

Researchers have demonstrated that tiny micrometer-sized crystals—just barely visible to the human eye—can "walk" inchworm-style across the slide of a microscope. Other crystals are capable of different modes of locomotion ...

Recurrences in an isolated quantum many-body system

February 23, 2018

It is one of the most astonishing results of physics—when a complex system is left alone, it will return to its initial state with almost perfect precision. Gas particles, for example, chaotically swirling around in a container, ...

Seeing nanoscale details in mammalian cells

February 23, 2018

In 2014, W. E. Moerner, the Harry S. Mosher Professor of Chemistry at Stanford University, won the Nobel Prize in chemistry for co-developing a way of imaging shapes inside cells at very high resolution, called super-resolution ...

Hauling antiprotons around in a van

February 22, 2018

A team of researchers working on the antiProton Unstable Matter Annihilation (PUMA) project near CERN's particle laboratory, according to a report in Nature, plans to capture a billion antiprotons, put them in a shipping ...

Urban heat island effects depend on a city's layout

February 22, 2018

The arrangement of a city's streets and buildings plays a crucial role in the local urban heat island effect, which causes cities to be hotter than their surroundings, researchers have found. The new finding could provide ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.