Scrapers

Web Scraping on a Large Scale for E-Commerce (Ultimate Guide)

This white paper aims to guide you through the process of large-scale data gathering with an emphasis on e-commerce.

Gabija Fatenaite

2024-12-10

1 min read

How to Make HTTP Requests in Node.js With Fetch API

A step-by-step tutorial on making HTTP requests in Node.js with Fetch API, detailing the actionable code and a comparison to Axios.

Augustas Pelakauskas

2024-12-09

6 min read

Serverless Web Scraping with Scrapy and AWS Lambda

Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.

Yelyzaveta Nechytailo

2024-11-28

6 min read

Guide to Handling Python Requests Timeout

Learn how to manage Python requests timeout errors for smooth network operations. See comprehensive code samples and discover best practices.

Vytenis Kaubrė

2024-11-19

6 min read

Web Scraping With LangChain & Oxylabs API

Find out how you can set up a Python requests retry strategy using libraries and custom functions. See code examples for configuring proxies when retrying failed requests.

Roberta Aukstikalnyte

2024-11-19

4 min read

Building a Competitor Intelligence System for E-Commerce

The primary focus of the white paper is to provide an action chain for a competitor intelligence system, from data collection to parsing, with various tips, guidelines, and explanations of the most critical processes.

Danielius Radavicius

2024-11-15

1 min read

Free White Paper: The Ultimate Guide on Web Scraping for Brand Protection

Nowadays, public data is an answer to many issues, fighting with brand infringements online as well. Web scraping helps to monitor the web and search for the violations in terms of brand protection to fight against them. This article explains the key insights of successful web scraping for brand protection.

Iveta Vistorskyte

2024-11-06

1 min read

5 Best SERP APIs for Real-Time Data

Find out the market's most reliable SERP API providers and learn why Google SERP scraping would be beneficial for your business.

Akvilė Lūžaitė

2024-11-05

7 min read

How to Achieve Cost-Effective and Scalable Web Scraping for Product Listings

This white paper explores the benefits of web scraping for e-commerce product listings and guides companies in choosing between developing an in-house scraper or opting for a third-party solution.

Adomas Sulcas

2024-11-04

1 min read

Web Scraping in JavaScript With Node.js & Puppeteer

Learn practical web scraping techniques using JavaScript and Node.js. Discover popular libraries, best practices, and effective methods using Cheerio, Axios, & Puppeteer.

Adelina Kiskyte

2024-10-29

10 min read

How To Scrape Amazon ASIN with Python

Learn what Amazon ASIN is and how to build a fast and scalable Amazon ASIN scraper. See code samples for creating a custom ASIN scraper and using a maintenance-free API.

Vytenis Kaubrė

2024-10-29

6 min read

How to Scrape Google People Also Ask: Python Tutorial

Learn how to scrape Google's People Also Ask (PAA) with Python. Gather valuable SEO data using BeautifulSoup and store insights for content strategy optimization.

Maryia Stsiopkina

2024-10-23

3 min read

5 Best Web Scraping APIs for Data Gathering

Discover the 5 best scraping APIs for efficient data gathering, including Oxylabs, Smartproxy, Rayobyte, Zyte, and ScrapingBee. Find the right solution!

Maryia Stsiopkina

2024-10-21

13 min read

How To Scrape Amazon Best Sellers: Python tutorial

The Amazon Best Sellers sites are product pages that can help retailers perform market research by providing information on what's selling the best and can act like a guide for what products to stock in your own store. However, Amazon, among other big sites, have mechanisms in place that make it a challenge to access this publicly available data.

Akvilė Lūžaitė

2024-10-14

8 min read

How to Bypass CAPTCHA With Playwright

Bypass CAPTCHAs with Playwright and Oxylabs’ Web Unblocker in Python. Crush web barriers, scrape freely, and automate successfully. Step-by-step tutorial.

Yelyzaveta Nechytailo

2024-10-11

5 min read

What is Web Scraping & How to Scrape Data from a Website?

The concept of web scraping is becoming familiar to every modern company aiming to base its decisions on data. This article will explain web scraping and how to effectively incorporate it into your business.

Iveta Vistorskyte

2024-10-09

8 min read

Web Crawler vs Web Scraper: The Differences

Data scraping has become the ultimate tool for business development with a significant influence in nearly any business area. With this article, we're covering the intricacies of data scraping in greater detail.

Gabija Fatenaite

2024-10-04

6 min read

Enhance Your Data Workflow: All-In-One Web Scraper API and OxyCopilot

Today marks a major milestone for both Oxylabs and the web scraping industry: the launch of our unified Web Scraper API, now enhanced with the OxyCopilot feature.

Maryia Stsiopkina

2024-09-25

3 min read

Web Scraper API Quick Start Guide

In this quick start guide, we introduce Web Scraper API and explain how it works. Explore integration methods, queries, their parameters, and response codes.

Augustas Pelakauskas

2024-09-25

4 min read