What's so hard about counting craters? (w/ video)

Mar 26, 2014
What's so hard about counting craters?
Experts identified and measured craters on this image from the Wide-Angle Camera above the Lunar Reconnaissance Orbiter. The image includes both lunar mare (bottom) and the heavily cratered ancient terrain of the highlands (above the fine dotted white line). Counting craters in the mare is much easier than counting those in the highlands. There are roughly 500 million craters bigger than 35 feet across on the moon. Credit: Robbins, et al/Icarus

(Phys.org) —Providing a rare glimpse of the trade secrets of planetary scientists, the journal Icarus published a study this month that compared lunar crater counts by eight professionals with crowdsourced counts by volunteers.

The professional crater counts varied by as much as a factor of two; some professionals counted twice as many craters as others. But the population of craters found by the volunteers was statistically similar to that found by the experts, said the study's lead author, Stuart Robbins, PhD, of the University of Colorado at Bouder.

These somewhat paradoxical results suggest both that it is harder to count craters than to count, say, train cars, but also that, if there are enough people counting, the robust similarity of their responses washes out slight individual differences.

The professionals included scientists from seven different universities, including Washington University in St. Louis. The volunteers were Moon Mappers who had signed up to count craters through Cosmoquest, a citizen science website.

To find out more, we talked to the WUSTL crater counters: postdoctoral research associate Kelsi Singer, PhD, who has mapped craters on the icy satellites in the outer solar system, and graduate student Michael Zanetti, who has counted craters on the and Mars. Both are in the Department of Earth and Planetary Sciences. Neither was surprised by the two-fold discrepancy between expert counts.

This video is not supported by your browser at this time.
Crater counts by WUSTL graduate student Michael Zanetti and postdoctoral research associate Kelsi Singer appear in the video, published by the University of Colorado at Boulder, which led the crater-counting study.

"There were very few singletons, craters only one person mapped," Singer said. "Most of the discrepancies showed up in counts of degraded, or 'subdued,' craters, or ones that were very small."

Zanetti explained that one of the images they were asked to analyze included both lunar maria and highlands. "It's not so bad counting craters on the flat, smooth maria created by volcanic eruptions. But it's a different story counting them in the heavily cratered lunar highlands," Zanetti said.

"You're never going to get a true distribution of crater sizes there," he said. "You've reached something called saturation, where each new crater obliterates old ones."

For the most part, Singer added, crater counts are used to reconstruct the history of a planet. "A heavily cratered feature is probably older than one with few craters, she said.

"But we're usually trying to understand whether a feature is a million, 100 million or a billion years old. Even if you are off by a factor of two in your counts, it's not going to change your understanding of the history," she said.

Nonetheless, Zanetti said, when he is working on an important problem, he counts all the craters himself to make sure the count is at least self-consistent. He then publishes his technique and his definition of a crater with his results. "There's a bit of subjectivity to it, but not as much as you might think," he said.

But, he added, it can take a couple of months to count the thousands of craters for really big projects.

"You don't undertake something like that lightly," he said. "The question you're trying to answer has to be a really good one."

Zanetti admits that after a long stint of crater counting, he sees colored circles everywhere, including around the bumps on a stuccoed wall.

So both Zanetti and Singer are happy to know that crater counts could be crowdsourced. "We have way too many craters to possibly map them ourselves," Singer said.

At bottom, the study showed that people are fantastic pattern recognizers. "Pattern-recognition software is still not up to the game," Zanetti said. "It takes as long, if not longer, to double-check the software's counts as it does to do the count yourself."

"But people are good at finding circles," Singer said. "Even if the crater is half gone, our brains fill in the rest of the circle."

Explore further: Comet dust—planet Mercury's 'invisible paint'

Related Stories

Cookie Monster crater on Mercury

Oct 15, 2012

Big Bird has been grabbing the headlines lately, and its time for another Muppet to get a little face time. So, here's Cookie Monster's face, plastered across the surface of Mercury. Well, it looks like it, ...

Mars name-a-crater scheme runs into trouble

Mar 11, 2014

The world's paramount astronomical authority on Tuesday slapped down a bid to hawk the names of Mars' craters, saying the Red Planet's monickers are not up for sale.

A peek at a pitch-black pit

Mar 20, 2012

MESSENGER captured this high-resolution image of an elongated pit crater within the floor of the 355-km (220-mile) -wide crater Tolstoj on Mercury on Jan. 11, 2012. The low angle of sun illumination puts the ...

Recommended for you

Cassini: Return to Rhea

2 hours ago

After a couple of years in high-inclination orbits that limited its ability to encounter Saturn's moons, NASA's Cassini spacecraft returned to Saturn's equatorial plane in March 2015.

Comet dust—planet Mercury's 'invisible paint'

9 hours ago

A team of scientists has a new explanation for the planet Mercury's dark, barely reflective surface. In a paper published in Nature Geoscience, the researchers suggest that a steady dusting of carbon from p ...

It's 'full spin ahead' for NASA soil moisture mapper

12 hours ago

The 20-foot (6-meter) "golden lasso" reflector antenna atop NASA's new Soil Moisture Active Passive (SMAP) observatory is now ready to wrangle up high-resolution global soil moisture data, following the successful ...

What drives the solar cycle?

12 hours ago

You can be thankful that we bask in the glow of a relatively placid star. Currently about halfway along its 10 billion year career on the Main Sequence, our sun fuses hydrogen into helium in a battle against ...

MESSENGER completes 4,000th orbit of Mercury

12 hours ago

On March 25, the MESSENGER spacecraft completed its 4,000th orbit of Mercury, and the lowest point in its orbit continues to move closer to the planet than ever before. The orbital phase of the MESSENGER ...

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Mar 26, 2014
if there are enough people counting, the robust similarity of their responses washes out slight individual differences.

With the caveat that if you have to have a skill for something then taking the 'crowndsourced/averaged' value may be misleading. consider doing tumor counts on x-rays. Surgeons and radiologists are trained to spot these whereas the public is not. You will still find large variations between the specialists, but the crowdsourced/averaged answer would, while robust, be definitely. wrong.

But the crater count would be an ideal PhD thesis in image analysis. I don't know why they tried crowdsourcing for this. Classifying/counting partially circular, superposed or eroded craters should be not too hard for an algorithm. At least you'd have a standard to work from for other bodies without incurring the variability each time.
1 / 5 (2) Mar 26, 2014
I **** the spiders on the wall...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.