Incapsula reports that web bots now account for 61% of web traffic

Dec 13, 2013 by Bob Yirka report
Credit: Incapsula

(Phys.org) —Cloud based application delivery platform provider Incapsula is reporting via blog post that web bots now account for 61 percent of all web traffic, an increase of 21 percent over last year.

Web bots, are of course, programs that are run on connected computers that scour the Internet looking for . What they do once they find them depends on what their programmers have in mind. Some are considered "good" such as the bots run by Google or Amazon to provide listings for search engines or to track visitor stats, while others are considered bad or malicious because they are used to scrape (steal data), hack (add malware), spam (leave spam in comment sections) or impersonate legitimate users.

On a positive note, Incapsula reports that the proportion of good bots is rising—their tests indicate that they now make up 31 percent of traffic (up from 21 percent last year). They also suggest that the majority of the increase in bot activity is likely due to more activity by existing bots rather than the introduction of new ones.

One area of concern the company found is an 8 percent uptick in the number of impersonator bots—those that try to fool websites into believing they are ether good bots or legitimate users. They are generally the worst sort of bot because their purpose is generally to cause harm to the web site itself, generally through denial of service attacks.

To come to these conclusions, Incapsula captured data from every visit to every one of its 20,000 client web sites over a 90 day period (amounting to 1.45 billion visits) and then analyzed the results. It should be noted that Incapsula offers its clients security services, thus the numbers it is reporting may not be a fair representation of the world-wide-web in general. What is also not clear are what other impacts bots may be having on the web, such as whether they cause slowdowns or if their sheer numbers are causing a skewing of the metrics they deliver. If over half of all visitors to sites are bots, for example, how does that play for those that are receiving advertising revenue for site visits?

While it's not clear just how many bots there really are compared to real users, what is apparent from the Incapsula report is that bots have become a major part of and that they are becoming more sophisticated, which suggests perhaps, that maybe an organization should be set up to monitor, track and perhaps work with law enforcement to identify those seeking to do harm, before they cause serious problems.

Explore further: Twitter takes note of other apps on smartphones

add to favorites email to friend print save as pdf

Related Stories

reCAPTCHA eases up on the human eye

Oct 28, 2013

(Phys.org) —Google, assuming you are human and reading this, wants you to know that CAPTCHAs are more readable. There will be easier days ahead than having to put your face against the screen, struggling ...

Spot a bot to stop a botnet

May 01, 2012

Computer scientists in India have developed a two-pronged algorithm that can detect the presence of a botnet on a computer network and block its malicious activities before it causes too much harm. The team ...

Computer scientist looks for bad guys in cyberspace

Feb 11, 2013

(Phys.org)—The weakest link in many computer networks is a gullible human. With that in mind, Sandia National Laboratories computer science researcher Jeremy Wendt wants to figure out how to recognize potential ...

Tweet timing tells bots, people and companies apart

Jul 03, 2013

Tweet timing can differentiate individual, corporate and bot-controlled Twitter accounts independent of the language or content of a tweet, according to research published July 3 in the open access journal ...

Recommended for you

UN moves to strengthen digital privacy (Update)

Nov 25, 2014

The United Nations on Tuesday adopted a resolution on protecting digital privacy that for the first time urged governments to offer redress to citizens targeted by mass surveillance.

Spotify turns up volume as losses fall

Nov 25, 2014

The world's biggest music streaming service, Spotify, announced Tuesday its revenue grew by 74 percent in 2013 while net losses shrank by one third, in a year of spectacular expansion.

Virtual money and user's identity

Nov 25, 2014

Bitcoin is the new money: minted and exchanged on the Internet. Faster and cheaper than a bank, the service is attracting attention from all over the world. But a big question remains: are the transactions ...

User comments : 1

Adjust slider to filter visible comments by rank

Display comments: newest first

alfie_null
1 / 5 (1) Dec 14, 2013
Is scraping bad or good? Depends on your perspective. Are you a site owner, or are you a potential customer?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.