The economics of database searching

Aug 11, 2011

( -- Searching the internet might seem simple, but applying a little bit of economic theory to information retrieval can shed some light on the best search strategies to adopt, according to researchers.

Dr. Leif Azzopardi from the School of at the University of Glasgow took production theory from microeconomics and applied it to the process of searching the internet, or any other .

In economics, production theory deals with the process of turning inputs, like capital and labour, into outputs, like goods and services. Production theory helps to determine how resources can be efficiently turned into such products i.e. least effort, most gain.

Working on the premise that searching for information requires effort, such as assessing documents, and submitting queries, Dr. Azzopardi sought to consider what search strategies a user should employ to efficiently undertake a search when looking for a number of relevant documents.

Dr. Azzopardi said: “Short queries can be quite effective for finding one highly-relevant document, but searching for a number of relevant documents often requires numerous queries to be posed. Generally speaking, a user will only examine the first page or so of the result list.”

Dr. Azzopardi said: “We also know that longer queries are more effective, and that there is often more relevant items on subsequent pages. So are people being lazy when they search or are they being strategic and rational when they search?”

“Being able to answer such questions is important for interactive information retrieval because while behavioural and observational studies have been conducted, there is a lack of formal theory to explain why such observations are witnessed.”

Dr. Azzopardi conducted a simulated analysis that varied the way in which a simulated user interacted with three different types of database search methods: BM25, Boolean and TFIDF.

Boolean searches use logical connections to search terms – using AND, OR, NOT; and are typically used in patent or library search systems.

BM25 ranks documents based on relevance using the incidence of key words searched that are contained in the document; and TFIDF (term frequency-inverse document frequency) is another method of searching for relevant keywords within a document.

By applying production theory from economics Dr. Azzopardi was able to identify which search strategies users of different retrieval systems should use.

Overall, he found that BM25 systems supported a greater variety of search strategies than Boolean or TFIDF.  However, the most ‘cost-efficient’ search on a BM25 system involved examining only the first page or so of results and then posting further queries until the desired level of gain was achieved. This finding is consistent with how users search the internet using commercial search engines.

On the other hand using Boolean systems suggests users would have to delve deeper into the result listings looking at 100s of documents per query and issuing substantially more queries to achieve the same level of gain. However, this finding is consistent with how patent searchers interact with Boolean based patent systems.

Dr. Azzopardi said:  “This work provides the foundations on which to build formal methods for describing, understanding and explaining the interactions between a user and system.”

“It also shows that we can apply economics to human computer interaction, more generally, and therefore we can predict how a user will utilize a system.”

Explore further: IBM Watson Group to transform the consumer shopping experience

More information: The research was presented at a conference of the Special Interest Group on Information Retrieval in Beijing in July and is published on the website of the Association for Computer Machinery. ( )

Provided by University of Glasgow

5 /5 (1 vote)

Related Stories

Branding matters -- even when searching

Jun 28, 2007

Web searchers who evaluated identical search-engine results overwhelmingly favored Yahoo! and Google, providing evidence that branding matters as much on the Internet as off, according to a Penn State study.

The engines of change

Nov 05, 2010

In today's wired world, search engines have changed the way people find data, and social searches are making it even easier to find exactly what you're looking for, with a little help from your friends. For ...

If at first you don't succeed, let the search engine try

Jun 05, 2009

No matter how good a search engine is, it is sometimes necessary to change the search terms to get the information you need. But what if you did not have to change the search terms yourself? What if the search engine could ...

Recommended for you

Computer-assisted accelerator design

Apr 22, 2014

Stephen Brooks uses his own custom software tool to fire electron beams into a virtual model of proposed accelerator designs for eRHIC. The goal: Keep the cost down and be sure the beams will circulate in ...

First steps towards "Experimental Literature 2.0"

Apr 21, 2014

As part of a student's thesis, the Laboratory of Digital Humanities at EPFL has developed an application that aims at rearranging literary works by changing their chapter order. "The human simulation" a saga ...

User comments : 0

More news stories

Jacket works like a mobile phone

A fire is raging in a large building and the fire leader is sending a message to all firefighters at the scene. But they don't need a mobile phone – they simply check their jacket sleeves and read the message ...

Is nuclear power the only way to avoid geoengineering?

"I think one can argue that if we were to follow a strong nuclear energy pathway—as well as doing everything else that we can—then we can solve the climate problem without doing geoengineering." So says Tom Wigley, one ...

Male-biased tweeting

Today women take an active part in public life. Without a doubt, they also converse with other women. In fact, they even talk to each other about other things besides men. As banal as it sounds, this is far ...

High-calorie and low-nutrient foods in kids' TV

Fruits and vegetables are often displayed in the popular Swedish children's TV show Bolibompa, but there are also plenty of high-sugar foods. A new study from the University of Gothenburg explores how food is portrayed in ...