The OxyCon 2021 web scraping conference has come to an end but provided us with good food for thought. Read this article summarising the top takeaways from Day Two.

The first day of OxyCon 2021 has passed. We had some amazing presentations and learned a lot about the world of web scraping. Here are the top key takeaways from day one.

This article discusses the differences between WebSocket and HTTP and their use cases.

Download this free white paper and get all the information on how you can benefit from web scraping in the travel industry and deal with challenges when gathering the required public data.

This article will discuss different types of financial data, their use cases, and financial data management and analysis tools.

This article discusses the tools that can be used to test a proxy's performance.

Download our free white paper and get all the information on competitive intelligence and how to solve the main issues that may arise when building competitive intelligence process in your organization.

In this step-by-step guide, you will go through the basics of how to use cURL with proxy. Also, you will get bonus tips on smooth and easy proxy usage.

OxyCon 2021, a virtual two-day web scraping conference, has already attracted a lot of attention from industry leaders and the web scraping community. It’s time to reveal what engaging presentations and discussions are waiting for you on 25 and 26 August.

In this article, we explore C# and show how to build a real-life C# public web scraper.

In this article, you will learn how to use the Java programming language for web scraping and create a web scraper using this language.

Oxylabs is happy to announce that Adaptive Parser is now at full blast! With AI-powered Adaptive Parser, our clients can unlock structured data from any e-commerce page. Read more!

In this article, you'll learn what exactly an API is and how an API works. Simply put, an API is a tool that delivers your request to the provider that you're requesting and then responds to you. Some websites (or apps) even provide APIs to give access for developers to receive specific data.

Bots are everywhere and we hardly notice them: from malicious bots to so-called good bots. What is a bot? How do they work? How do websites detect bots? Read more in this article.

Read this article to learn what XPath and CSS selectors are and how to create them. Find out the differences between XPath vs CSS, and know which option to choose.

Building your tools to generate leads can be a lot more cost-efficient, and using web scraping is one of the most optimal ways to generate leads for your business. In this article, we'll go through the process of web scraping for lead generation and where to start.

In this article, we will go over both Proxy and VPN terms, explore their similarities and differences in order to establish when one should be picked over another.

This article is intended to offer a 360-degree view of search engine ad intelligence: what it is and how to collect it using proxies alongside in-house web scrapers or ready-to-use tools.

Read why collecting alternative data is essential for applications in financial markets. Find out the main challenges while scraping alternative data and learn the solutions that can help make the best out of alternative data in the financial industry.

If you’re interested in learning everything about competitive intelligence, this article is for you. Read this article to understand what competitive intelligence is and learn more about competitive intelligence sources, its challenges, and best practices.

In this article, we explained what the main differences between forward and reverse proxies are. We also provided the prominent use cases of each proxy type.

During OxyCon, Oxylabs' legal councils presented landmark scraping cases that set the tone for future scraping legal claims such as copyright, CFAA, etc. Learn how it affects scraping today and what web scraping legal issues can one encounter when scraping certain websites.

Dealing with pagination in web scraping might be challenging and result in missing data. Learn about different approaches when scraping multiple pages.

What is an IP address? What are the main types of IP addresses? What are the challenges in IP management? Read this article and find out!

This article explains in depth what concurrency and parallelism are. We'll also use a practical example to explore the concepts even more and show how using concurrency and parallelism can help speed up the web scraping process.

A question might have arisen whilst scrolling through the infinite pools of proxy information - “what’s the difference between data center and residential proxies?” Well, this article aims to tackle this question. Let’s dive in.

Read how we, in cooperation with Censuswide, have surveyed senior data decision makers in the UK finance sector! Get all the details they shared on how alternative data is being used in their industry.

Where to start with web scraping? What tools to choose? Get your questions answered by web scraping experts and watch a live demonstration of a powerful web scraper!

From now on, you can access and manage your Datacenter Proxies via our Datacenter Proxy API! With it, you can replace your IPs from a specific subnet in your existing proxy list.

Join this webinar to learn why ethical proxy acquisition should be important to businesses that use proxy services as much as the services themselves.

Find out what Jupyter Notebook is, its use cases, how to set it up, and whether it’s ideal for beginners. Importantly, this article discusses the application of Jupyter Notebook for web scraping.

Save your seat at OxyCon 2021 on August 25–26, and join the discussion on the most relevant topics in the world of web scraping! The two-day virtual event will bring global business leaders and Oxylabs' experienced team together for in-depth, engaging talks and workshops.

A honeypot is a security system designed to attract malicious activity from cybercriminals. Read this article to understand how honeypot traps affect web scraping.

Proxy-reliant companies have long been familiar with the benefits of residential proxies. However, very little is known about the risks of using unethical or even illegal proxies. Lack of knowledge on this matter is dangerous both for proxy network participants and companies using residential proxies. Read this article to learn more about proxy sourcing risks and how to avoid them.

If you are interested in starting to make data-driven decisions, this white paper is for you! Learn everything about pricing intelligence and how third-party data gathering solutions help you forget web scraping challenges.

What are price scrapers? Why is it essential for e-commerce businesses, and what tools should they be using? Find all about it in our new article.

Data scraping has become the ultimate tool for business development with a significant influence in nearly any business area. With this article, we're covering the intricacies of data scraping in greater detail.

Unethically sourced residential proxies

What is online reputation management? Why is it beneficial? What are the main challenges of monitoring it? Read the article and find out more.

Find out what is a headless browser, what software engineers use it for, and what browsers are most popular in a headless environment. What limitations do headless browsers have? We cover it here, too.

Counterfeiting is a big issue around the world. Anti-counterfeiting technologies have to be well advanced to be capable of finding counterfeit goods online, anywhere in the world. Web scraping tools and proxies are an inseparable part of modern anti-counterfeiting solutions.

Honeygain and Oxylabs have signed an exclusive agreement! Find out how this will strengthen our long-lasting partnership and benefit the proxy industry at large.