Puppeteer Tutorial: Scraping With a Headless Browser

Web scraping and automation with JavaScript has evolved a lot in recent years. There are a few methods to accessing and parsing web pages, but in this tutorial we will be covering how to do it with Puppeteer.

Gabija Fatenaite

2025-07-30

8 min read

Web Scraper API Quick Start Guide

In this quick start guide, we introduce Web Scraper API and explain how it works. Explore integration methods, queries, their parameters, and response codes.

Augustas Pelakauskas

2025-07-29

4 min read

Python Cache: How to Speed Up Your Code with Effective Caching

Discover the functionalities of caching in Python and see how you can speed up large-scale web scraping tasks.

Vytenis Kaubrė

2025-07-24

10 min read

How to Use cURL PUT Requests

Learn how to use cURL PUT requests to update resources via the command line. In this guide, we cover syntax, headers, and real-world API examples.

Agnė Matusevičiūtė

2025-07-24

5 min read

Pricing Update: Feature-Based Billing for Web Scraper API

Discover feature-based billing for Oxylabs’ Web Scraper API: pay based on your target’s complexity, optimize costs, and get up to 2000 results with an unlimited free trial.

Yelyzaveta Hayrapetyan

2025-07-23

2 min read

Oxylabs Is Heading to Ai4 – Let’s Connect!

Join us at Ai4 2025 in Las Vegas! Visit Booth #414, catch live demos and a raffle game, and hear our expert speak on the future of AI in software engineering.

Yelyzaveta Hayrapetyan

2025-07-22

2 min read

6 Best SERP APIs for Real-Time Data

Find out the market's most reliable SERP API providers and learn why Google SERP scraping would be beneficial for your business.

Akvilė Lūžaitė

2025-07-22

8 min read

What is LLM (Large Language Model)?

Learn what are Large Language Models (LLMs) and how they're trained using web scraping, proxies, and diverse data sources.

Akvilė Lūžaitė

2025-07-21

6 min read

Guide to Using Google Sheets for Basic Web Scraping

In this guide, you will learn how to scrape websites using Google Sheets, and you will find out about the functions in use and how to fix common errors.

Vytenis Kaubrė

2025-07-18

10 min read

What is RAG (Retrieval-Augmented Generation)?

Discover what RAG (Retrieval-Augmented Generation) is, how it works, and why it's revolutionizing AI by combining real-time data collection and generation.

Dovydas Vėsa

2025-07-18

5 min read

How to Scrape Google Images With Python

See how you can scrape Google Images with this brief, step-by-step tutorial.

Danielius Radavicius

2025-07-17

4 min read

Practical Guide to Web Data Solutions for AI Workflows

On July 30, 2025, join our free webinar to discover how you can overcome the challenges of building and maintaining reliable web data extraction workflows.

Agnė Matusevičiūtė

2025-07-16

1 min read

What is a Headless Browser?

Find out what is a headless browser, what software engineers use it for, and what browsers are most popular in a headless environment. What limitations do headless browsers have? We cover it here, too.

Adelina Kiskyte

2025-07-15

5 min read

How to Send HTTP Requests in Java

Learn how to send Java HTTP requests using built-in and third-party clients, with examples of GET, POST, headers, and proxy support.

Yelyzaveta Hayrapetyan

2025-07-15

5 min read

Bringing Web Intelligence to the Next Level: Introducing AI Studio

Oxylabs AI Studio – a new suite of AI-powered tools that makes it easy to find, collect, and have ready-to-use web data using natural language.

Akvilė Lūžaitė

2025-07-09

3 min read

Static vs Rotating Proxies: Which Is Best for You?

Learn all about static vs. rotating proxies, sticky IP addresses, and proxy implications in product information scraping at large scale in this blog post.

Gabija Fatenaite

2025-07-08

5 min read

The Best Antidetect Browsers of 2025

Learn how an antidetect browser helps with using several accounts for various digital initiatives.

Roberta Aukstikalnyte

2025-07-01

12 min read

How to Bypass an IP Ban: Techniques & Tips

Got your IP banned from a website? This blog post will walk you through the best solutions on how to prevent IP bans from ever happening again.

Enrika Pavlovskytė

2025-06-30

6 min read

How to Scrape NASDAQ Data Using Python

Learn how to scrape NASDAQ stock data using Python for reliable, scalable access to new investment opportunities.

Akvilė Lūžaitė

2025-06-27

3 min read

Project 4beta Partners with The Data and Research Center

Oxylabs' pro bono initiative "Project 4β" partners with The Data and Research Center, an independent organization providing bespoke data and research services for investigative teams.

Gabija Birgile

2025-06-27

1 min read

How to Send HTTP Headers With cURL

This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.

Augustas Pelakauskas

2025-06-27

5 min read

How to Send POST Requests With cURL

cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.

Yelyzaveta Hayrapetyan

2025-06-27

3 min read

Oxylabs Shortlisted at DataIQ Awards 2025

Oxylabs has been nominated for the DataIQ Awards 2025 in the People and Teams – Best Place to Work in Data & AI (Vendor side) category.

Gabija Birgile

2025-06-20

1 min read

OxyCon® 2025: Power Up for the AI-Driven Era of Web Scraping

Join us on October 1, 2025 for a free online conference on all things web scraping.

Akvilė Lūžaitė

2025-06-18

2 min read

How to Scrape Best Buy Product Data: A Step-by-Step Tutorial

Learn how to extract data from Best Buy product pages at scale and in real time with Web Scraper API. The API automates the underlying processes and delivers ready-to-use data.

Augustas Pelakauskas

2025-06-18

5 min read

Project 4β Teams Up with the University of Chicago Researcher

Project 4β has partnered with Grace Shao, a Master’s student in Computational Social Science at the University of Chicago, to support her research with free access to Oxylabs' solutions.

Gabija Birgile

2025-06-16

2 min read

Let’s Meet at WeAreDevelopers World Congress in Berlin!

Join Oxylabs at WeAreDevelopers World Congress in Berlin this July. Explore AI-powered tech trends and connect with experts at our booth.

Yelyzaveta Hayrapetyan

2025-06-16

2 min read

How to Use cURL With Python

Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.

Roberta Aukstikalnyte

2025-06-13

5 min read

Migrating to Oxylabs Web Unblocker from Bright Data

Complete guide for switching from Bright Data's Web Unlocker to Oxylabs Web Unblocker: feature comparison, code samples, and migration checklist included.

Vytenis Kaubrė

2025-06-06

1 min read

MCP vs. A2A: AI Protocols Compared

Learn how MCP compares to A2A, how each protocol works, and what their features are. Understand each protocol through comprehensive MCP and A2A flow examples.

Vytenis Kaubrė

2025-06-05

4 min read

HTTPX vs Requests vs AIOHTTP

Find out about the critical features of HTTPX, Requests, and AIOHTTP and how they differ from each other.

Danielius Radavicius

2025-06-04

5 min read

How to Scrape YouTube Data: Step-by-Step Guide

Learn how to easily scrape YouTube videos and collect public video data, such as transcripts, titles, descriptions, total subscribers, comments, and search results.

Vytenis Kaubrė

2025-06-04

6 min read

SOCKS vs HTTP Proxy: What Is the Difference?

Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.

Vejune Tamuliunaite

2025-05-30

6 min read

How to Scrape Product Data From Wayfair: A Step-by-Step Guide

A step-by-step tutorial on extracting data from Wayfair’s product pages at scale and in real time. The guide details actionable code and considers various aspects before and during the scraping process.

Augustas Pelakauskas

2025-05-30

6 min read

How to Bypass CAPTCHA With Selenium & Python

See a detailed yet straightforward tutorial on bypassing CAPTCHA with Selenium & Python and learn how to use Oxylabs’ Web Unblocker for increased scalability.

Yelyzaveta Hayrapetyan

2025-05-28

4 min read

What Are Rotating Proxies? Setup, Pros, Cons

Learn everything you need to know about Oxylabs' Proxy Rotator and how to use it for your business.

Adelina Kiskyte

2025-05-27

5 min read

Puppeteer vs Selenium: Which to Choose

Dive deeper into the features, benefits, and drawbacks of Puppeteer and Selenium to make an informed decision on which tool fits you best.

Yelyzaveta Hayrapetyan

2025-05-27

6 min read

Scraping Baidu Search Results with Python: A Step-by-Step Guide

Check this article to learn scraping Baidu search results with Python.

Iveta Vistorskyte

2025-05-26

6 min read

Web Scraping With LangChain & Oxylabs API

Follow our quick guide on combining LangChain with Web Scraper API for hassle-free web scraping process and AI-driven analysis.

Roberta Aukstikalnyte

2025-05-21

5 min read

Meet us at Data + AI Summit 2025

Data + AI Summit is the world’s largest data and AI conference, and our Oxylabs team is excited to be among the participants – visit us at booth 661.

Akvilė Lūžaitė

2025-05-19

2 min read

14 Best Web Scraping Tools in 2025 (Pricing, Pros, Cons, Comparisons)

In this top web scraping tools list, we carefully evaluated most notable providers on the market to ensure that your web scraping efforts are optimized for accuracy and efficiency.

Akvilė Lūžaitė

2025-05-19

10 min read

Best Web Scraping Companies in 2025

Discover the top web scraping companies of 2025, comparing technology, ease of use, and scalability to help you find the best solution for your needs.

Enrika Pavlovskytė

2025-05-15

9 min read

Case Study: Tackling Online Environmental Violations with Web Crawling Technology

Oxylabs’ Project 4β teamed up with Lithuania’s Environmental Protection Department to tackle illegal environmental ads online. We're now sharing a case study on the solution’s impact and first results.

Gabija Birgile

2025-05-08

4 min read

Oxylabs Releases 2024 Impact Report with Focus on Ethical Data Practices

Oxylabs published its 2024 Impact Report, highlighting key environmental, social and governance initiatives.

Erika Jankevičė

2025-05-05

1 min read

Web Scraping Stock Market Data

We explain the basics of stock market data acquisition in this blog post. Find out how large amounts of stock market data is acquired.

Adomas Sulcas

2025-04-29

6 min read

How to Scrape Yandex Search Results: A Step-by-Step Guide

Follow this tutorial to learn how to scrape Yandex with Python. Find out more about Yandex SERPs and why it’s hard to scrape Yandex.

Vytenis Kaubrė

2025-04-29

5 min read

Oxylabs Web Scraper API Expands With 30 New Parametrized Sources

30 new parametrized sources for Web Scraper API are now available. The sources simplify data extraction from popular sites with automated URL handling and built-in scraping logic.

Augustas Pelakauskas

2025-04-25

2 min read

10 Best Proxy Providers in 2025

See a short overview of the market's most reliable proxy providers and find out what criteria to consider before making the final choice.

Yelyzaveta Hayrapetyan

2025-04-22

9 min read

How to Scrape Wikipedia Data: Ultimate Tutorial

Learn how to retrieve publicly available data from Wikipedia pages with Python and Web Scraper API.

Roberta Aukstikalnyte

2025-04-17

5 min read

Optimizing Open Source Tools for Better Web Scraping

On April 30th, 2025, join our free webinar to discover how you can get the most out of open source tools.

Akvilė Lūžaitė

2025-04-14

1 min read