As promised earlier, we are publishing the second part of our first annual trend report – The Rising Demand for Data: Oxylabs’ 2020 Trend Report. In this part, you will learn all about how Oxylabs’ clients used our data center proxies in 2019 in terms of the number of requests and total traffic volume, the most prominent client segments, and other curious tidbits.
If you’re in a hurry, we invite you to take a look at the key takeaways. However, for a more comprehensive picture, be sure to read the full report, which you can easily download just by entering your email in the form below.
• In 2019 there was a substantial 22.7% growth in the total number of requests.
• Total data center proxy traffic volume grew by 45.8% in 2019. This suggests that Oxylabs clients gathered more data per request on average than in 2018.
• The retail segment continues to dominate, and it is also the fastest-growing vertical, registering a 95% surge in the number of requests issued via data center proxies. The finance segment is second, recording a noteworthy 86% increase.
Data center proxies prove to be sufficient for the majority of web scraping tasks
Research conducted by our Data Analysis Department has found that in 2019 there was a substantial 22.7% growth in total request volume via data center proxies, compared to 2018 recorded metrics.
Taking a closer look at the data center proxies’ request graph below, we can see that the most significant increase in the number of requests was recorded in June, showing an impressive 47.2% surge.
On the subject of data center proxy traffic in 2019, there was a 45.8% increase noted in total traffic load, compared to the year before. Based on this significant growth, we can expect that 2020 will also see a double-digit increase in traffic load.
Most popular segments
Furthermore, our Data Analysis Department revealed that the most prominent segments in 2019 by the overall data center proxy request volume were as following:
As expected, the retail segment continues to dominate, and it is also the fastest-growing vertical, registering a 95% surge in the number of requests processed via data center proxies, compared to 2018 data.
More surprisingly, the second most rapid growth in the number of requests processed was noted in the finance segment, recording a noteworthy 86% increase, compared to 2018.
Most prominent segments by single client requests
Naturally, companies in each industry have diverse external data requirements, as evidenced by the differences between requests generated by a single client via data center proxies.
Taking into account 2019 recorded statistics and exploring one client’s average generated data center proxy requests in their sector, the cybersecurity segment’s client noted the highest number of requests, followed by the retail and travel sectors’ client, based on an average.
To put this into perspective, the cybersecurity sector’s client on average processed 25% more requests per month compared to the retail sector’s client and 31% more requests than the travel segment’s customer.
Unsurprisingly, the retail and travel segments continue to increasingly rely on web scraping tasks, harnessing real-time data, which aids businesses in these segments in quickly reacting to dynamic market conditions.
Whereas, against the majority of expectations, the cybersecurity segment’s clients are proving the point that the web scraping practice can be an effective countermeasure against various online threats for global companies.