Court transcripts, military reports reveal telling patterns in information

Apr 17, 2013
Year-to-year trial patterns from the Old Bailey criminal court in London, England, with trials clustered by semantic structure. Each of the four rows represents a cluster, ordered by dominance, with the most common form of trial at the top. From year to year, the trial clusters are semantically related to each other. The system's structure shifts slowly, on decade-long timescales. When two clusters are semantically related in neighboring years, a heavy black line connects the two. Credit: Simon DeDeo, Sara Klingenstein, and Tim Hitchcock

(—If you were to wander the halls of a courthouse during a murder trail, could you predict the verdict from the conversations you would overhear? And what would be the smallest amount of information you would require to make that prediction?

Discovering in information is more than a game of courtroom prescience; it is a serious matter with applications in warfare, stock markets, human health, and other complex systems.

Finding a reliable technique for detecting such patterns, however, is difficult. SFI Research Fellow Simon DeDeo, SFI Graduate Fellow Sara Klingenstein, and undergraduate researcher Robert Hawkins are drawing on information theory and a couple of remarkable data sets for help.

In one example, the researchers analyzed some 250 years of transcripts from the Old Bailey criminal court in England to look for patterns in trials that led to guilty verdicts.

"Courthouses are fundamentally an trying to come to a verdict," says DeDeo.

In their analyses, which used techniques from information theory to place strict bounds on the predictive ability of their outcomes, the researchers found evidence for different distinct trial patterns: in other words, more than one pathway to a guilty verdict.

"The system is not just processing information, but doing so in a structured fashion," he says, "with separate and non-overlapping pathways through the decision process."

In a second case they studied five years of WikiLeaks-published military reports about insurgent attacks in Afganistan – data about locations, durations, combatants, and more.

"Insurgency is not just about violence," says DeDeo, "but also about signaling and coordination with rivals." An insurgent group's attack is a message to rival insurgent groups, to NATO forces, or to the .

"In the South, some provinces were predictive of what would happen later in others, but not vice versa," DeDeo explains. This asymmetry suggests an underlying structure to a highly-dispersed conflict.

"In contrast to the ad hoc and fragile nature of many other methods of analysis, provides an explicit and robust framework of assumptions that help you do the science," DeDeo says.

Their paper is to appear in a special issue of the journal Entropy.

Explore further: Researchers help Boston Marathon organizers plan for 2014 race

More information: Read their paper on Arxiv (February 5, 2013).

Related Stories

New clues to Wikipedia's shared super mind

Mar 28, 2013

( —Wikipedia's remarkable accuracy and usefulness comes from something larger than the sum of its written contributions, a new study by SFI Research Fellow Simon DeDeo finds.

Predicting insurgent attacks with a mathematical model

Dec 17, 2009

When bombs and bullets left 37 dead during Friday prayers at a mosque in Pakistan, earlier this month, the insurgency was using the element of surprise. Unpredictability is the hallmark of modern insurgent attacks such as ...

Games may help train analysts to overcome bias

Nov 13, 2012

Game-playing may help intelligence analysts with the serious business of identifying biases that can cloud decision-making and problem-solving during life or death situations, according to researchers.

Recommended for you

Which foods may cost you more due to Calif. drought

38 minutes ago

With California experiencing one of its worst droughts on record, grocery shoppers across the country can expect to see a short supply of certain fruits and vegetables in stores, and to pay higher prices ...

Creative activities outside work can improve job performance

10 hours ago

Employees who pursue creative activities outside of work may find that these activities boost their performance on the job, according to a new study by San Francisco State University organizational psychologist Kevin Eschleman ...

Performance measures for CEOs vary greatly, study finds

17 hours ago

As companies file their annual proxy statements with the U.S. Securities and Exchange Commission (SEC) this spring, a new study by Rice University and Cornell University shows just how S&P 500 companies have ...

User comments : 0

More news stories

Which foods may cost you more due to Calif. drought

With California experiencing one of its worst droughts on record, grocery shoppers across the country can expect to see a short supply of certain fruits and vegetables in stores, and to pay higher prices ...

Robotics goes micro-scale

( —The development of light-driven 'micro-robots' that can autonomously investigate and manipulate the nano-scale environment in a microscope comes a step closer, thanks to new research from the ...

Biologists help solve fungi mysteries

( —A new genetic analysis revealing the previously unknown biodiversity and distribution of thousands of fungi in North America might also reveal a previously underappreciated contributor to climate ...