Using Twitter to predict financial markets

Mar 26, 2012

A University of California, Riverside professor and several other researchers have developed a model that uses data from Twitter to help predict the traded volume and value of a stock the following day.

A trading strategy based on the model created by Vagelis Hristidis, an associate professor at the Bourns College of Engineering, one of his graduate students and three researchers at Yahoo! in Spain, outperformed other baseline strategies by between 1.4 percent and nearly 11 percent and also did better than the Dow Jones Industrial Average during a four-month .

"These findings have the potential to have a big impact on market investors," said Hristidis, who specializes in data mining research, which focuses on discovering patterns in large data sets. "With so much data available from social media, many investors are looking to sort it out and profit from it."

Hristidis and his co-authors, Eduardo J. Ruiz, one of his graduate students, and Carlos Castillo, Aristides Gionis and Alejandro Jaimes, all of whom work for Yahoo! Research Barcelona, presented the findings last month at the Fifth ACM International Conference on Web Search & Data Mining in Seattle.

Hristidis and his co-authors set out to study how activity in Twitter is correlated to stock prices and traded volume. While past research has looked the sentiment, positive or negative, of tweets to predict stock price, little research has focused on the volume of tweets and the ways that tweets are linked to other tweets, topics or users. Further, past work has mostly studied the overall stock market indexes, and not individual stocks.

They obtained the daily closing price and the number of trades from Yahoo! Finance for 150 randomly selected companies in the S&P 500 Index for the first half of 2010.

Then, they developed filters to select only relevant tweets for those companies during that time period. For example, if they were looking at Apple, they needed to exclude tweets that focused on the fruit.

They expected to find the number of trades was correlated with the number of tweets. Surprisingly, the number of trades is slightly more correlated with the number of what they call "connected components." That is the number of posts about distinct topics related to one company. For example, using Apple again, there might be separate networks of posts regarding Apple's new CEO, a new product it released and its latest earnings report.

They also found stock price is slightly correlated with the number of connected components.

For the study, the researchers simulated a series of investments between March 1, 2010 and June 30, 2010 and analyzed performance using several investment strategies. During that time frame, the fell 4.2 percent.

In two variants of an autoregression model, that is buying every day stocks based on the assumption that the is a function of the prices of the stock in the last few days, losses were 8.9 percent and 13.1 percent.

In the random model, in which as random set of stocks is bought every, sold at the end of the day and repeated the next day, the average loss was 5.5 percent.

In the fixed model, which involves buying a set of stocks that have best combination of market cap, company size and total debt and keeping them for the entire simulation, the average loss was 3.8 percent.

The model the researchers developed using data lost on average 2.4 percent.

Hristidis notes several potential weaknesses in the study.

First, the trading strategy worked in a period when the Dow Jones dropped, but it may not produce the same results when the Dow Jones is rising. There is also sensitivity related to the duration of the trading. For example, it took 30 days in the simulation to start outperforming the Dow Jones.

Explore further: Researchers develop fast, economical method for high-definition video compositing

More information: The published paper that outlines the findings can be found at www.cs.ucr.edu/~vagelis/publications/wsdm2012-microblog-financial.pdf

Related Stories

Twitter analysis provides stock predictions

Apr 04, 2011

Economists at the Technical University of Munich have developed a website that predicts individual stock trends. To this end, economists are using automatic text analysis methods to evaluate thousands of daily Twitter microblog ...

Bazaarvoice, Proto Labs surge in market debuts

Feb 24, 2012

(AP) -- A splashy Wall Street debut by Bazaarvoice Inc. and Proto Labs Inc. is the latest sign that investor appetite for initial public offerings has rebounded after a dismal IPO market in 2011.

Recommended for you

Pandora posts in-line 1Q loss, upbeat sales

7 hours ago

(AP)—Internet radio company Pandora reported higher-than-expected revenue in the latest quarter, with losses in line with analysts' forecasts, as the number of subscribers who pay for ad-free listening rose above 2.5 million.

Google Drive sports new view and scan enhancements

7 hours ago

(Phys.org) —Google Drive has a new look and functions. The makeover in Google Drive features scanning and interface enhancements that put the user into "card" mode. The enhancements make it easy for the ...

Inventor creates Card Beams with 3D printer

8 hours ago

What are card beams, you may ask? They are the building toy that allows you to build gravity-defying houses of cards with the help of friction, gravity, and two types of beams - the cap and the connector.

Solar Kettle allows for boiling water off the grid

9 hours ago

(Phys.org) —A company called Contemporary Energy has unveiled a new device it calls the Solar Kettle. It looks very much like a normal coffee thermos, but has flaps on one side that open to allow for collecting ...

Review: Google music plan solid, serendipitous

11 hours ago

Google's new music service offers a lot of eye candy to go with the tunes. The song selection of around 18 million tracks is comparable to popular services such as Spotify and Rhapsody, and a myriad of playlists ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

AWaB
not rated yet Mar 26, 2012
Even if they can figure out a way to make this consistently work, Mr. Market will, as always, unknowingly punish them.

More news stories

Solar Kettle allows for boiling water off the grid

(Phys.org) —A company called Contemporary Energy has unveiled a new device it calls the Solar Kettle. It looks very much like a normal coffee thermos, but has flaps on one side that open to allow for collecting ...

Google Drive sports new view and scan enhancements

(Phys.org) —Google Drive has a new look and functions. The makeover in Google Drive features scanning and interface enhancements that put the user into "card" mode. The enhancements make it easy for the ...

Review: Google music plan solid, serendipitous

Google's new music service offers a lot of eye candy to go with the tunes. The song selection of around 18 million tracks is comparable to popular services such as Spotify and Rhapsody, and a myriad of playlists ...

Controlling mood through the motions of mitochondria

(Medical Xpress)—Regulating the distribution of power in neurons is done by a system that makes the national electric grid look simple by comparison. Each neuron has several thousand mitochondria confined ...

A quantum simulator for magnetic materials

Physicists understand perfectly well why a fridge magnet sticks to certain metallic surfaces. But there are more exotic forms of magnetism whose properties remain unclear, despite decades of intense research. ...