Back to blog

New Self-Service Pricing Plans
Oxylabs’ Scraper APIs and Web Unblocker Are Now in Self-Service!

Get access to Oxylabs’ top products using a quick self-checkout process – request and start using in just a few clicks!

Yelyzaveta Nechytailo

2023-04-06

3 min read

Most popular articles
How to Use cURL With Proxy?

Iveta Vistorskyte

2021-08-09

6 min read

What Is HTTP Proxy?

Adelina Kiskyte

2021-01-12

4 min read

How to Use cURL With Python

Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.

Roberta Aukstikalnyte

2023-05-17

4 min read

What Is Data as a Service (DaaS) & How It Helps

Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.

Augustas Pelakauskas

2023-04-28

5 min read

Scrapy Splash Tutorial: How to Scrape JavaScript-Rendered Websites

An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.

Roberta Aukstikalnyte

2023-04-25

5 min read

Web Unblocker Quick Start Guide

Discover the essentials of Web Unblocker and learn how to get started with it.

Vytenis Kaubre

2023-04-06

5 min read

How to Bypass Any CAPTCHA in Web Scraping

If CAPTCHAs keep on interrupting your day-to-day scraping tasks, read this article presenting solutions that can help you go around them successfully.

Yelyzaveta Nechytailo

2023-04-05

4 min read

Crawlee Tutorial: Easy Web Scraping and Browser Automation

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

Yelyzaveta Nechytailo

2023-04-04

6 min read

Web Crawler: Where to Start & How It Works

Web Crawler allows you to explore and collect data quickly and efficiently using our maintenance-free infrastructure.

Augustas Pelakauskas

2023-03-13

3 min read

Scraping Product Information: Static vs Rotating Proxies

Learn all about static vs. rotating proxies, sticky IP addresses, and proxy implications in product information scraping at large scale in this blog post.

Gabija Fatenaite

2023-02-24

5 min read

How AI Is Changing the Web Scraping Landscape

This white paper provides a comprehensive overview of how AI and its subfield, machine learning, shape the current trends in web scraping.

Augustas Pelakauskas

2023-02-21

1 min read

HTTPX vs Requests vs AIOHTTP

Find out about the critical features of HTTPX, Requests, and AIOHTTP and how they differ from each other.

Danielius Radavicius

2023-02-20

5 min read

Puppeteer vs Selenium: Which to Choose

Dive deeper into the features, benefits, and drawbacks of Puppeteer and Selenium to make an informed decision on which tool fits you best.

Yelyzaveta Nechytailo

2023-02-07

5 min read

How to Parse HTML with PyQuery: Python Tutorial

Follow this tutorial to scrape and parse the HTML of a desired website. Learn about the PyQuery library, how to use it in Python, and how it differs from Beautiful Soup.

Vytenis Kaubre

2023-01-25

4 min read

Playwright vs Puppeteer: The Differences

Find out how Playwright and Puppeteer stack up against each other in particular scenarios, including web scraping.

Augustas Pelakauskas

2023-01-24

4 min read

Playwright vs Selenium: Which One to Choose

Let's discuss Playwright vs Selenium, their relevance to web scraping, and what to remember when picking one for your scraping task.

Enrika Pavlovskytė

2023-01-10

6 min read

Go vs Python: The Differences in 2023

Go is becoming increasingly popular due to its many strengths, but how does it compare to Python, the most common and widely used language in programming?

Danielius Radavicius

2023-01-07

6 min read

Top Antidetect Browsers of 2023

Learn how an antidetect browser helps with using several accounts for various digital initiatives.

Roberta Aukstikalnyte

2022-12-27

7 min read

How Does a Proxy Server Improve Security

Find out the numerous features of proxies and how they improve security.

Danielius Radavicius

2022-12-16

3 min read

Guide to Scraping Data from Websites to Excel with Web Query

Check this step-by-step tutorial to learn how to scrape data from websites into Excel. Find out Excel's capabilities of extracting information from various websites.

Iveta Vistorskyte

2022-11-10

5 min read

Guide to Using Google Sheets for Basic Web Scraping

In this guide, you will learn how to scrape websites using Google Sheets, and you will find out about the functions in use and how to fix common errors.

Vytenis Kaubre

2022-11-08

9 min read

What Is an ETL Pipeline?

ETL stands for extract, transform, and load. It’s an independent three-stage process that moves data from one source(s) to a database and is crucial for modern day anlysis.

Danielius Radavicius

2022-10-14

5 min read

Screen Scraping: What Is It and How Does It Work?

Find out what screen scraping is and how it works. Learn the difference between web scraping and screen scraping.

Vytenis Kaubre

2022-10-03

5 min read

6 Web Scraping Project Ideas to Sharpen Your Skills

Planning a project on web scraping and don’t know where to start? Learn how proxies come into play when project planning for web scraping in our most recent article.

Gabija Fatenaite

2022-08-31

8 min read

How to Continuously Yield High Quality Data | Interview with Glen De Cauwsemaecker

As part of the combined efforts of Oxylabs and OTA Insight to shed light on the developments in the web scraping industry, we sat down with Glen De Cauwsemaeker, the Lead Crawler Engineer at OTA Insight, to talk about the challenges when scaling data acquisition solutions.

Glen De Cauwsemaecker

2022-08-25

10 min read

Asynchronous Web Scraping With Python & AIOHTTP

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

Yelyzaveta Nechytailo

2022-08-25

6 min read

Web Scraping with Rust

In this practical tutorial, you'll learn how to create a web scraper using Rust and collect public product data from an e-commerce website.

Maryia Stsiopkina

2022-08-24

6 min read

Data Pipeline Architecture Explained

Learn what a data pipeline architecture is, why it's important for businesses and how to build one.

Roberta Aukstikalnyte

2022-08-11

5 min read

The Second Mover’s Advantage

Businesses are complex, and both first and second movers encounter unique difficulties and advantages. If you're interested in how these advantages relate to web scraping, check this out!

Julius Cerniauskas

2022-07-05

4 min read

Data Quality Metrics You Should Track and Measure

Learn more about how to effectively track and measure data quality with the help of this detailed blog post

Yelyzaveta Nechytailo

2022-06-27

5 min read

How to Estimate and Reduce Data Collection Costs

Let's take a look at the key factors influencing data acquisition costs, and discuss ways to reduce these expenses.

Maryia Stsiopkina

2022-06-22

7 min read

Real-Time Online Media Monitoring Infrastructure

This white paper will walk you through the critical stages of the online media monitoring process.

Maryia Stsiopkina

2022-06-15

1 min read

Web Scraping on a Large Scale for E-Commerce (Ultimate Guide)

This white paper aims to guide you through the process of large-scale data gathering with an emphasis on e-commerce.

Gabija Fatenaite

2022-06-13

1 min read

How to Make HTTP Requests in Node.js With Fetch API

A step-by-step tutorial on making HTTP requests in Node.js with Fetch API, detailing the actionable code and a comparison to Axios.

Augustas Pelakauskas

2022-06-02

4 min read

Free White Paper: Alternative Data Unlocks Key Decisions in the UK And US Finance Industries

Oxylabs, in cooperation with Censuswide, has surveyed over 1000 senior decision makers in the finance industry. Find out how alternative data and web scraping has changed finance.

Adomas Sulcas

2022-05-04

1 min read

Scaling: Overcoming Your Limits | OxyCast #4

At one point or another, any scaling or coding project will run into the issue of scaling and how to effectively do it. In the 4th episode of OxyCast, we will explore topics such as horizontal vs. vertical scaling, bottleneck avoidance, and many others!

Danielius Radavicius

2022-04-25

2 min read

Real-Time Price Monitoring System Architecture

This white paper provides an action chain for price monitoring, from collecting target URLs to data parsing, along with tips and explanations on the most important elements and processes.

Augustas Pelakauskas

2022-03-24

1 min read

Data Parsing: The Basic, the Easy, and the Difficult | OxyCast #3

Parsing is an integral part of any web scraping activity that helps businesses get the data they need in the right format. In the third episode of OxyCast, we will dig deeper into data parsing and discuss such topics as easy vs. hard parsing, selectors, parser failures, and the future of parsing.

Yelyzaveta Nechytailo

2022-03-23

2 min read

Choosing the Right Scraping Solution in 2022: Essentials You Need to Know

As public web data collection and analysis grow more integral to many companies across various industries, automated data gathering tools prove themselves as indispensable assistants in this challenging task. Check out this white paper to learn more!

Maryia Stsiopkina

2022-03-17

1 min read

Scraping Alternative Data: Technological Challenges to Keep in Mind

The role of alternative data becomes more and more prominent. However, its collection is tied to multiple technological challenges that can disturb your business's operations. This white paper provides a detailed explanation of these challenges and proposes solutions to deal with them.

Yelyzaveta Nechytailo

2022-03-10

1 min read

Web Scraping: Another Block In The Wall | OxyCast #2

If you’ve ever tried web scraping, you should be aware of the blocking issue. It’s a common challenge, especially if you gather public data on a large scale without a decent knowledge of using resources wisely. This is why we decided to cover this topic and share our knowledge and tips & tricks on how to avoid getting blocked.

Iveta Vistorskyte

2022-02-22

2 min read

The Importance of Having an Ethical Data Collection Policy

Read insights from an expert in the data collection field on implementing the ethical policy in your company.

Cornelius (Con) Conlon

2022-02-03

4 min read

Best Python Libraries for Web Scraping

This white paper will go through four most popular Python libraries and the basics on how to get started in web scraping.

Yelyzaveta Nechytailo

2022-01-12

1 min read

Comprehensive Guide on Data Collection

In this extensive white paper, we’ve gathered a variety of technical insights to help you begin web scraping with Python.

Yelyzaveta Nechytailo

2021-12-15

1 min read

What is Browser Fingerprinting?

Browser fingerprinting is being used as a new avenue of tracking. How does it work? Is it possible to reduce the likelihood of being tracked? Read on to find out more.

Adomas Sulcas

2021-12-02

4 min read

Poor Quality Data Might Cost You Too Much

Read a message on the importance of data quality from Allen O’Neill, one of the industry’s leading experts.

Allen O'Neill

2021-12-01

5 min read

Search Engine Scraping: What You Should Know

Want to find out which data sources from search engines are the most beneficial? Did you know that scraping SERPs comes with challenges that can complicate data gathering processes? Read this article and find out everything you need to know about scraping search engines.

Iveta Vistorskyte

2021-11-30

8 min read

How to Extract Data from A Website?

Making data-driven business decisions nowadays is the number one priority for many companies. If you are interested in this field, you should learn how to extract data from websites. Check out!

Iveta Vistorskyte

2021-11-29

8 min read

What Is a Web Session and How Is It Used in Web Scraping?

This article will give you a general overview of web sessions, their relation to cookies, and their use in web scraping.

Augustas Pelakauskas

2021-11-26

5 min read

News Scraping: Everything You Need to Know

This article discusses everything you need to know about news scraping, including the benefits and use cases of news scraping as well as how you can use Python to create an article scraper.

Iveta Vistorskyte

2021-10-18

7 min read

Free White Paper: Proxies Buying Guide for Enterprises

Learn more about use cases and challenges for which datacenter and residential proxies are best suitable. Find out the key points to consider when choosing a reliable proxy provider.

Monika Maslauskaite

2021-09-27

1 min read

Most Common HTTP Headers

HTTP headers enable to transfer further details within the request or response headers. Find out 5 key HTTP headers that are crucial to use and optimize in web scraping.

Vytautas Kirjazovas

2021-09-20

4 min read

Top News on Everything Data Gathering

Subscribe to our newsletter and get monthly scraping updates delivered right to your email.

No spam whatsoever, just pure data gathering news, trending topics and useful links. Unsubscribe anytime.

Scale up your business with Oxylabs®