Optimizing Open Source Tools for Better Web Scraping

On April 30th, 2025, join our free webinar to discover how you can get the most out of open source tools.

Akvilė Lūžaitė

2025-04-14

1 min read

BeautifulSoup Tutorial - How to Parse Web Data With Python

Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.

Adomas Sulcas

2025-04-11

9 min read

Python type() Function Tutorial With Examples

Learn to use the type() function in Python with concrete code examples. Find out best practices and common mistakes to improve your Python skills.

Vytenis Kaubrė

2025-04-11

3 min read

Undetected ChromeDriver: Bypass Anti-Bot Systems

Learn how to use Undetected ChromeDriver for web scraping, avoid detection, and integrate proxies to prevent IP blocks. Discover best practices and answers to common FAQs.

Roberta Aukstikalnyte

2025-04-10

4 min read

LangChain vs. LangGraph: Comparing AI Agent Frameworks

Compare LangChain and LangGraph frameworks to discover their features, use cases, and how proxies enhance web scraping and AI agent workflows in both.

Yelyzaveta Hayrapetyan

2025-04-09

5 min read

Most Common User Agents For Price Scraping

In a fast-changing business world, price scraping is highly recommended for every company to stay competitive. How do user agents help to reduce blocking while web scraping? Check out!

Iveta Vistorskyte

2025-04-04

4 min read

Oxylabs Nominated at the 29th Annual Webby Awards

Oxylabs has been nominated at the 29th Annual Webby Awards for its innovative solution, OxyCopilot – the industry’s first AI-driven scraping assistant.

Gabija Birgile

2025-04-04

2 min read

Playwright vs Puppeteer: The Differences

Find out how Playwright and Puppeteer stack up against each other in particular scenarios, including web scraping.

Augustas Pelakauskas

2025-04-04

8 min read

What Is a REST API? Definition & Use Cases

Learn what a REST API is, how it works, its key principles, best practices, and real-world use cases – from app development to web scraping.

Augustas Pelakauskas

2025-04-03

5 min read

Join Oxylabs at RSAC™ Conference in San Francisco

Meet Oxylabs team at RSAC™ 2025 Conference in San Francisco and learn how web data collection can help advance your cybersecurity solutions.

Akvilė Lūžaitė

2025-04-01

1 min read

Concurrency vs Parallelism: The Main Differences

This article explains in depth what concurrency and parallelism are. We'll also use a practical example to explore the concepts even more and show how using concurrency and parallelism can help speed up the web scraping process.

Iveta Vistorskyte

2025-04-01

6 min read

Python Web Scraping Tutorial: Step-By-Step

We take you through every step of building your first web scraper. Find out how to get started in data acquisition with Python.

Adomas Sulcas

2025-04-01

19 min read

CrewAI vs. AutoGen: Comparing AI Agent Frameworks

Dive deeper into the features, benefits, and drawbacks of Puppeteer and Selenium to make an informed decision on which tool fits you best.

Akvilė Lūžaitė

2025-03-31

5 min read

How to Scrape Amazon Prices With Python

Discover comprehensive techniques for scraping Amazon prices and product information, focusing on popular items, search results, special offers, and price trends.

Maryia Stsiopkina

2025-03-26

5 min read

How to Get Class Names in Python – Tutorial

Learn how to get class names in Python using __name__, type(), inspect, and other methods. Discover some best practices and common issues.

Yelyzaveta Hayrapetyan

2025-03-25

3 min read

How to Bypass Amazon Captcha When Scraping

If you've ever run into CATPCHA blocks while scraping Amazon, check out this step-by-step tutorial on making your scraping tasks block-free.

Danielius Radavicius

2025-03-25

2 min read

How to Bypass CAPTCHA With Puppeteer

Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.

Maryia Stsiopkina

2025-03-24

4 min read

6 Best AI Frameworks for Building AI Agents in 2025

Explore the top 6 AI agent frameworks of 2025. Compare features and capabilities to find the perfect solution for building intelligent, autonomous systems.

Maryia Stsiopkina

2025-03-24

6 min read

How to Scrape TripAdvisor with Python in 2025

A step-by-step guide to extracting public data from Tripadvisor using Python and Oxylabs Residential Proxies.

Augustas Pelakauskas

2025-03-21

4 min read

How to Get a Web Element from HTML Source With Selenium

Learn to extract web elements from HTML source code using Selenium with Python. Includes code examples, proxy setup, and locator methods.

Augustas Pelakauskas

2025-03-20

3 min read

How to Run Python Script in PowerShell

Learn to run Python scripts in PowerShell with this step-by-step tutorial covering installation, setup, and execution. Combine Python's versatility with PowerShell's capabilities.

Augustas Pelakauskas

2025-03-20

3 min read

How to Use a Proxy With HttpClient in C#

Learn how to set up and use HttpClient proxy in C# to improve anonymity, bypass restrictions, and ensure stable HTTP requests.

Roberta Aukstikalnyte

2025-03-18

5 min read

YouTube Downloader: The Ultimate Solution for AI-Ready Data

As part of Oxylabs’ commitment to pioneering web scraping solutions, YouTube Downloader takes video extraction to the next level.

Akvilė Lūžaitė

2025-03-18

2 min read

7 Best Python HTTP Clients

Discover the 7 best Python HTTP clients for APIs, web automation, and scraping. Learn their features, use cases, and how to integrate them with proxies.

Yelyzaveta Hayrapetyan

2025-03-18

4 min read

API for Dummies: Learn the Basics of API

Learn the basics of APIs, how they enable communication between different software systems, and their role in modern web development and integration.

Akvilė Lūžaitė

2025-03-18

8 min read

Datacenter Proxies vs. Residential Proxies

Datacenter vs residential proxies: what are the main differences? Get all the answers to your questions about these proxy types by reading this article.

Lukas Motiejunas

2025-03-18

5 min read

Public Data Acquisition Solutions for Enterprise: A 2025 Selection Guide

This extensive guide for businesses will help you navigate the modern data acquisition challenges and numerous solutions.

Maryia Stsiopkina

2025-03-18

1 min read

What is Browser Fingerprinting?

Browser fingerprinting is being used as a new avenue of tracking. How does it work? Is it possible to reduce the likelihood of being tracked? Read on to find out more.

Adomas Sulcas

2025-03-17

6 min read

How to Scrape Home Depot Data: Step-by-Step Guide

As results prove, pairing Python and Home Depot Scraper API is a seamless way to collect Home Depot data and avoid common web scraping-associated challenges.

Augustas Pelakauskas

2025-03-17

4 min read

How to Scrape IMDb Data: Step-by-Step Guide

Learn how to effortlessly scrape movie data from IMDb and get the freshest industry insights by following this step-by-step guide.

Enrika Pavlovskytė

2025-03-16

6 min read

OpenAI Agents SDK Integration With Oxylabs Web Scraper API

Learn how to build AI agents that scrape and analyze web content by combining OpenAI's Agents SDK with Oxylabs Web Scraper API for cost-effective web access.

Vytenis Kaubrė

2025-03-14

3 min read

Project 4β Partners with International Consortium of Investigative Journalists

Oxylabs' pro bono initiative "Project 4β" partners with The International Consortium of Investigative Journalists (ICIJ), a globally recognized network of investigative reporters.

Gabija Birgile

2025-03-14

2 min read

How to Send a POST with Python Requests?

Learn how to send POST requests in Python using the requests library. This guide covers sending data, handling responses, and using sessions.

Akvilė Lūžaitė

2025-03-13

3 min read

5 Cheerio Alternatives for Web Scraping

Looking for Cheerio alternatives for web scraping? Compare Puppeteer, Playwright, Selenium, JSDOM, and Scrapy to find the best fit for your data extraction needs.

Augustas Pelakauskas

2025-03-13

4 min read

How to Use cURL in Javascript? Use-Cases & Tutorial

Learn how to use cURL in JavaScript with multiple methods. Discover best practices, and proxy integration steps to enhance web scraping, API requests, and automation.

Yelyzaveta Hayrapetyan

2025-03-13

4 min read

What is a Residential Proxy & How it Works?

Learn all about residential proxies: their types, legality, and common use cases.

Roberta Aukstikalnyte

2025-03-12

7 min read

Markov Tarpits: An Evolving Strategy Against AI Crawlers

Are AI crawler traps a viable website defense or a lose-lose strategy? Read this post to learn about Markov tarpits and their potential successes and risks.

Vytenis Kaubrė

2025-03-12

2 min read

Leveraging AI for Large-Scale Scraping and Parsing

Watch this new webinar to explore how artificial intelligence is revolutionizing our approach to web scraping and parsing challenges.

Maryia Stsiopkina

2025-03-06

1 min read

Web Scraping With cURL Tutorial 2025

Learn how to scrape websites efficiently with cURL in 2025. This tutorial covers basic command line usage, authentication, proxies, dynamic content, and best practices.

Maryia Stsiopkina

2025-03-06

5 min read

ISP Proxies vs. Residential Proxies – Ultimate Guide

Discover what sets ISP proxies apart from residential proxies and how to choose one for your next project.

Enrika Pavlovskytė

2025-03-05

3 min read

Web Scraper API Now Supports Model Context Protocol

Boost your AI’s accuracy with Web Scraper API’s new Model Context Protocol (MCP) integration—deliver real-time, structured web data straight to LLMs.

Vytenis Kaubrė

2025-03-04

3 min read

How to Track an IP Address: Find Out Here

Learn all about IP address tracking: How it’s done, its ethicality, and how you can protect yourself.

Roberta Aukstikalnyte

2025-03-04

3 min read

What Is Rate Limiting & How to Avoid It

Learn about rate limiting algorithms, how they protect legitimate users, and implement effective strategies to manage request limits. Master web scraping while respecting server limits.

Roberta Aukstikalnyte

2025-03-03

4 min read

How to Make a Web Crawler With Python

Learn how to collect targets for web scraping with a custom-built Python web crawler, including handling duplicate URLs and managing pagination.

Augustas Pelakauskas

2025-03-03

3 min read

How to Scrape Google News: Step-by-Step Guide

Check out this straightforward, step-by-step guide on how to scrape Google News.

Danielius Radavicius

2025-02-28

6 min read

How to Scrape Walmart in 2025: A Step-by-Step Tutorial

Follow a detailed tutorial on how to easily extract public data from Walmart product pages without getting blocked.

Enrika Pavlovskytė

2025-02-27

6 min read

Scraping Data from Etsy: A Comprehensive Guide for Data Extraction

Follow this Python scraping guide to obtain Etsy product data with ease.

Vytenis Kaubrė

2025-02-27

5 min read

How to Scrape Google Maps Using Python

See this extensive guide on how to scrape Google Maps with an Oxylabs solution.

Danielius Radavicius

2025-02-25

6 min read

How to Show HTTP Response Headers in cURL?

Learn how to inspect HTTP response headers using cURL, from basic commands to advanced techniques. Master debugging, header extraction, and common issue resolution.

Yelyzaveta Hayrapetyan

2025-02-20

4 min read

9 Playwright Best Practices: Reliable and Easy Tests

Learn 9 essential Playwright best practices to create reliable automated tests. Improve your test stability, maintenance, and efficiency in web application testing.

Maryia Stsiopkina

2025-02-20

4 min read