Incapsula reports that web bots now account for 61% of web traffic

December 13, 2013 by Bob Yirka report
Credit: Incapsula

( —Cloud based application delivery platform provider Incapsula is reporting via blog post that web bots now account for 61 percent of all web traffic, an increase of 21 percent over last year.

Web bots, are of course, programs that are run on connected computers that scour the Internet looking for . What they do once they find them depends on what their programmers have in mind. Some are considered "good" such as the bots run by Google or Amazon to provide listings for search engines or to track visitor stats, while others are considered bad or malicious because they are used to scrape (steal data), hack (add malware), spam (leave spam in comment sections) or impersonate legitimate users.

On a positive note, Incapsula reports that the proportion of good bots is rising—their tests indicate that they now make up 31 percent of traffic (up from 21 percent last year). They also suggest that the majority of the increase in bot activity is likely due to more activity by existing bots rather than the introduction of new ones.

One area of concern the company found is an 8 percent uptick in the number of impersonator bots—those that try to fool websites into believing they are ether good bots or legitimate users. They are generally the worst sort of bot because their purpose is generally to cause harm to the web site itself, generally through denial of service attacks.

To come to these conclusions, Incapsula captured data from every visit to every one of its 20,000 client web sites over a 90 day period (amounting to 1.45 billion visits) and then analyzed the results. It should be noted that Incapsula offers its clients security services, thus the numbers it is reporting may not be a fair representation of the world-wide-web in general. What is also not clear are what other impacts bots may be having on the web, such as whether they cause slowdowns or if their sheer numbers are causing a skewing of the metrics they deliver. If over half of all visitors to sites are bots, for example, how does that play for those that are receiving advertising revenue for site visits?

While it's not clear just how many bots there really are compared to real users, what is apparent from the Incapsula report is that bots have become a major part of and that they are becoming more sophisticated, which suggests perhaps, that maybe an organization should be set up to monitor, track and perhaps work with law enforcement to identify those seeking to do harm, before they cause serious problems.

Explore further: reCAPTCHA eases up on the human eye

Related Stories

reCAPTCHA eases up on the human eye

October 28, 2013

( —Google, assuming you are human and reading this, wants you to know that CAPTCHAs are more readable. There will be easier days ahead than having to put your face against the screen, struggling to figure out if ...

Spot a bot to stop a botnet

May 1, 2012

Computer scientists in India have developed a two-pronged algorithm that can detect the presence of a botnet on a computer network and block its malicious activities before it causes too much harm. The team describes details ...

Computer scientist looks for bad guys in cyberspace

February 11, 2013

(—The weakest link in many computer networks is a gullible human. With that in mind, Sandia National Laboratories computer science researcher Jeremy Wendt wants to figure out how to recognize potential targets ...

Tweet timing tells bots, people and companies apart

July 3, 2013

Tweet timing can differentiate individual, corporate and bot-controlled Twitter accounts independent of the language or content of a tweet, according to research published July 3 in the open access journal PLOS ONE by Aldo ...

Recommended for you

Volvo to supply Uber with self-driving cars (Update)

November 20, 2017

Swedish carmaker Volvo Cars said Monday it has signed an agreement to supply "tens of thousands" of self-driving cars to Uber, as the ride-sharing company battles a number of different controversies.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

1 / 5 (1) Dec 14, 2013
Is scraping bad or good? Depends on your perspective. Are you a site owner, or are you a potential customer?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.