Proxy locations

Europe

North America

South America

Asia

Africa

Oceania

See all locations

Network statusCareers

Back to blog

From Digital Marketing to Data Extraction: Navigating the Web Scraping Landscape

Alexander Lebedev, Software Engineer at Hotjar, shares his knowledge on web scraping, how to optimize for efficient data extraction, and what tools have served his journey extremely well, allowing the company to flourish.

Adomas Sulcas

2023-09-15

7 min read

How to Scrape Home Depot Data: Step-by-Step Guide

As results prove, pairing Python and Home Depot Scraper API is a seamless way to collect Home Depot data and avoid common web scraping-associated challenges.

Augustas Pelakauskas

2023-09-15

3 min read

13 Best Free and Paid Tools to Monitor Website Changes in 2023

Learn more about website change monitoring and discover the top 13 free and paid website change monitoring tools in 2023.

Enrika Pavlovskytė

2023-09-13

7 min read

Unlocking the Web with CapSolver: A Comprehensive Review

In this article, we comprehensively review a CapSolver, discuss this tool’s features, pricing, and use cases, and highlight what makes this tool different from other CAPTCHA-solving services.

Roberta Aukstikalnyte

2023-09-12

3 min read

How to Scrape YouTube Data: Step-by-Step Guide

Learn how to easily scrape YouTube videos and collect public video data, such as titles, descriptions, total subscribers, comments, and search results.

Vytenis Kaubre

2023-09-12

5 min read

Melding Machine Learning with Web Scraping: Interview with Andrius Kūkšta

Andrius Kūkšta, Data Engineer at Oxylabs, shares his thoughts and experiences with integrating machine learning to web scraping solutions and showcases the power of AI for the industry.

Adomas Sulcas

2023-09-11

8 min read

Introducing Datasets: Your Fast Path to Data-Driven Insights

Learn more about Datasets - collections of fresh, ready-to-use data that streamline the entire data acquisition process and let you focus on data analysis rather than data gathering.

Yelyzaveta Nechytailo

2023-09-07

2 min read

Introducing Oxylabs Scraper APIs Playground: A New Way to Test Out Our Scraper API Solutions

We're excited to announce Scraper APIs Playrgound, a brand new way to test out our Scraper API solutions for free.

Danielius Radavicius

2023-09-05

2 min read

How to Scrape Yellow Pages Data With Python

Explore this in-depth, step-by-step technical tutorial to scrape Yellow Pages data with Python efficiently.

Maryia Stsiopkina

2023-09-04

3 min read

Oxylabs Establishes AI and ML Advisory Board

We are proud to have launched the AI & ML Advisory Board in 2020, consisting of four industry-leading data science, machine learning and AI experts to bolster Oxylabs’ influence in the data industry.

Vytautas Kirjazovas

2023-09-01

2 min read

How to Scrape Google Trends Data With Python

The main steps for scraping Google Trends data with Python and SERP Scraper API are installing libraries, sending a request, and saving the retrieved data in CSV.

Augustas Pelakauskas

2023-08-30

3 min read

2 Weeks Until OxyCon – Your Last Chance to Register!

As the 2-week countdown begins and excitement for OxyCon 2023 surges through the air, we’re here to invite you to book your free spot.

Yelyzaveta Nechytailo

2023-08-30

2 min read

How Do PerimeterX Bypasses Work?

Learn about PerimeterX, how it works, and why bot traffic is still able to evade its defenses.

Vytenis Kaubre

2023-08-25

7 min read

How to Scrape Wikipedia Data: Ultimate Tutorial

Learn how to retrieve publicly available data from Wikipedia pages with Python and Web Scraper API.

Roberta Aukstikalnyte

2023-08-25

4 min read

How to Scrape Yelp Data: Tutorial

Read this article about web scraping Yelp data to learn what tools to use to get your needed business data.

Enrika Pavlovskytė

2023-08-24

5 min read

Join us at The Browser Conference on September 19, 2023!

Join The Browser Conference on the 19th of September, 2023 to see Oxylabs' Product Owner Aleksandras presentation "Large-Scale Web Data Collection Best Practices."

Roberta Aukstikalnyte

2023-08-16

1 min read

How to Bypass CAPTCHA With Playwright

Bypass CAPTCHAs with Playwright and Oxylabs’ Web Unblocker in Python. Crush web barriers, scrape freely, and automate successfully. Step-by-step tutorial.

Yelyzaveta Nechytailo

2023-08-14

4 min read

Continuous Scroll in Google Search: What It Is & How to Handle It in Web Scraping

Dynamic web pages like Google SERPs with continuous scroll require advanced web scraping solutions such as Oxylabs SERP Scraper API.

Augustas Pelakauskas

2023-08-10

2 min read

Web Scraping with Selenium and Python

Learn how the fundamentals of web scraping work by using Selenium, one of the better known tools for automating web browser interactions.

Gabija Fatenaite

2023-08-10

6 min read

Unleash Your Business Potential at DMEXCO!

Join Oxylabs at DMEXCO, Cologne and unleash untapped business potential for digital marketing.

Enrika Pavlovskytė

2023-08-08

2 min read

How to Scrape Google News: Step-by-Step Guide

Check out this straightforward, step-by-step guide on how to scrape Google News.

Danielius Radavicius

2023-08-07

3 min read

Oxylabs Web Scraping Solutions Enable Epicup to Provide Fresh SEO Data

Epicup is an SEO software provider. Using their services, the clients can get insights from search engines and boost their SEO performance. With Oxylabs web scraping solutions, Epicup was able to maintain a constant data flow and deliver the freshest SEO insights to their users.

Roberta Aukstikalnyte

2023-08-07

2 min read

Scrapy Cloud: How to Use, Manage & Maximize Spider Execution

Check this article to learn more about web scraping with Scrapy Cloud: how it works, how to set it up, and if there are any alternatives.

Maryia Stsiopkina

2023-08-03

5 min read

Agenda is live, why attend OxyCon 2023!

This year's OxyCon has already garnered attention from every corner of the data gathering industry. Now is the time to reveal what's in store during our virtual event on September 13th.

Danielius Radavicius

2023-08-02

2 min read

Serverless Web Scraping with Scrapy and AWS Lambda

Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.

Yelyzaveta Nechytailo

2023-08-02

5 min read

Free White Paper: Developing a Real Estate Data Monitoring Infrastructure

Discover how your real estate business can benefit from web scraping and learn how to build your own property data monitoring architecture.

Roberta Aukstikalnyte

2023-07-28

1 min read

How to Use ChatGPT for Web Scraping in 2023

ChatGPT web scraping is quickly gaining momentum. Let’s see how you can use ChatGPT to write code for web scraping, along with some tips and tricks.

Maryia Stsiopkina

2023-07-28

4 min read

Scrapy vs. Beautiful Soup: A Comparison of Web Scraping Tools

Delve deeper into the differences between Scrapy vs. Beautiful Soup and discover which one you need for your scraping project.

Enrika Pavlovskytė

2023-07-21

4 min read

Scrapy vs. Selenium: Which One is Better?

Find the ideal web scraping tool for your project by exploring the unique features and differences of Scrapy and Selenium.

Vytenis Kaubre

2023-07-12

5 min read

Web Scraping Together: Unleash Community Benefits

If you're wondering how to stay up-to-date in the ever-changing world of web scraping, make valuable connections, and improve your tech expertise, check out this blog post about the benefits of web scraping communities.

Maryia Stsiopkina

2023-07-10

2 min read

How to Create and Upload a Sitemap: A Step-By-Step Guide

Learn what sitemaps are and discover effective solutions for creating them.

Enrika Pavlovskytė

2023-07-07

6 min read

Oxylabs Launches Custom Parser

We're excited to introduce a new feature of Scraper APIs, Custom Parser. Check this blog post to learn how it can facilitate your parsing jobs.

Maryia Stsiopkina

2023-07-03

1 min read

Why Do Some People Bypass Queue-It?

Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.

Danielius Radavicius

2023-07-03

3 min read

Best No-Code Scrapers

Web scraping can get difficult but it doesn’t have to be with these no-code and low code web scrapers. Check out these no-code tools that could streamline your operations.

Enrika Pavlovskytė

2023-07-03

6 min read

5 Main Web Scraping Challenges & Solutions

Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.

Augustas Pelakauskas

2023-06-30

6 min read

Asynchronous Web Scraping With Python & AIOHTTP

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

Yelyzaveta Nechytailo

2023-06-27

6 min read

How to Bypass CAPTCHA With Puppeteer

Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.

Maryia Stsiopkina

2023-06-22

4 min read

Choosing Between SOCKS vs HTTP Proxy

Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.

Vejune Tamuliunaite

2023-06-21

5 min read

Open-Source Intelligence to Boost Your Business: ESPY's Guide

Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.

Maryia Stsiopkina

2023-06-20

2 min read

OxyCon 2023: Staying Ahead of the Game With Web Scraping

OxyCon is back for its fourth year with inspiring speakers and captivating presentations.

Enrika Pavlovskytė

2023-06-19

2 min read

How to Choose the Right Database for Storing Your Data

Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.

Danielius Radavicius

2023-06-15

7 min read

Scraping Experts: Building Real-Time E-Commerce Product Monitoring System in 5 Minutes

See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.

Vytenis Kaubre

2023-06-13

2 min read

How to Send POST Requests With cURL

cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.

Yelyzaveta Nechytailo

2023-06-09

3 min read

How to Scrape Google Maps: A Comprehensive Guide

See this extensive guide on how to scrape Google Maps with an Oxylabs solution.

Danielius Radavicius

2023-06-09

5 min read

How to Send GET Requests With cURL

Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.

Iveta Vistorskyte

2023-06-09

4 min read

Don't miss the chance to meet us at the Travel Tech Show

Join Oxylabs at Travel Tech Show, London, to discover the latest travel industry trends and innovations as well as connect with industry experts.

Iveta Vistorskyte

2023-06-08

2 min read

Beautiful Soup Tutorial - How to Parse Web Data With Python

Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.

Adomas Sulcas

2023-06-06

9 min read

Using Real-Time Public Data for Competitive Advantage in Travel Industry

An action chain of processes and solutions for public web data collection in the travel industry.

Augustas Pelakauskas

2023-06-02

1 min read

How to Parse XML in Python

Check this step-by-step tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.

Maryia Stsiopkina

2023-06-02

6 min read

How to Scrape Images from a Website With Python

In our second installment, we will be discussing how to scrape images from websites. We reuse code used in our older article so be sure to read that one as well!

Adomas Sulcas

2023-06-01

5 min read

Top News on Everything Data Gathering

Subscribe to our newsletter and get monthly scraping updates delivered right to your email.

No spam whatsoever, just pure data gathering news, trending topics and useful links. Unsubscribe anytime.

Scale up your business with Oxylabs®