Blog

Scrapers

Scrapers

Data utilization

Data acquisition

Scrapers

Data Quality Metrics You Should Track and Measure

Learn more about how to effectively track and measure data quality with the help of this detailed blog post

Yelyzaveta Nechytailo

2022-06-27

Proxies

Scrapers

Why You Shouldn't Use Free Proxies - Risks & Reasons

Free proxies are an attractive yet often unsafe solution. Its limitations, security issues, and recommendations are all discussed within the article.

Danielius Radavicius

2022-06-22

Data acquisition

Scrapers

Reducing the Cost of Data Collection

Let's take a look at the key factors influencing data acquisition costs, and discuss ways to reduce these expenses.

Maryia Stsiopkina

2022-06-22

Data acquisition

Scrapers

Data utilization

Real-Time Online Media Monitoring Infrastructure

This white paper will walk you through the critical stages of the online media monitoring process.

Maryia Stsiopkina

2022-06-15

Data utilization

Scrapers

Tutorials

Building a Competitor Intelligence System for E-Commerce

The primary focus of the white paper is to provide an action chain for a competitor intelligence system, from data collection to parsing, with various tips, guidelines, and explanations of the most critical processes.

Danielius Radavicius

2022-06-14

Data acquisition

Data utilization

Scrapers

Web Scraping on a Large-Scale for E-Commerce (Ultimate Guide)

This white paper aims to guide you through the process of large-scale data gathering with an emphasis on e-commerce.

Gabija Fatenaite

2022-06-13

OxyCon

Scrapers

Proxies

OxyCon 2022: Leading-Edge Conference in All Things Web Scraping

Don’t forget to save your seat at OxyCon 2022, September 7-8, to join discussions on the most relevant and recently encountered topics of public data gathering! Just like last year, the 2 day virtual event will feature discussions from a plethora of industry-leading guests.

Danielius Radavicius

2022-06-09

Tutorials

Scrapers

How to Make Web Scraping Faster – Python Tutorial

Read this article where we discuss a few useful ways of making public data collection faster as well as provide sample codes that you can implement in your scraping activities.

Yelyzaveta Nechytailo

2022-06-07

Tutorials

Data acquisition

Scrapers

How to Make HTTP Requests in Node.js With Fetch API

A step-by-step tutorial on making HTTP requests in Node.js with Fetch API, detailing the actionable code and a comparison to Axios.

Augustas Pelakauskas

2022-06-02

Tutorials

Scrapers

Web Scraping With RegEx

RegEx stands for Regular Expressions, a method to match specific patterns depending on the provided combinations, which can be used as filters to get the desired output.

Augustas Pelakauskas

2022-04-29

News

Data acquisition

Scrapers

Scaling: Overcoming Your Limits | OxyCast #4

At one point or another, any scaling or coding project will run into the issue of scaling and how to effectively do it. In the 4th episode of OxyCast, we will explore topics such as horizontal vs. vertical scaling, bottleneck avoidance, and many others!

Danielius Radavicius

2022-04-25

Data acquisition

Scrapers

Real-Time Price Monitoring System Architecture

This white paper provides an action chain for price monitoring, from collecting target URLs to data parsing, along with tips and explanations on the most important elements and processes.

Augustas Pelakauskas

2022-03-24

Tutorials

Scrapers

How to Build a Price Tracker With Python

This article explains how to build a scalable price tracker for immediate deployment to various eCommerce sites.

Augustas Pelakauskas

2022-03-23

Data acquisition

Scrapers

Choosing the Right Scraping Solution in 2022: Essentials You Need to Know

As public web data collection and analysis grow more integral to many companies across various industries, automated data gathering tools prove themselves as indispensable assistants in this challenging task. Check out this white paper to learn more!

Maryia Stsiopkina

2022-03-17

Data acquisition

Scrapers

Scraping Alternative Data: Technological Challenges to Keep in Mind

The role of alternative data becomes more and more prominent. However, its collection is tied to multiple technological challenges that can disturb your business's operations. This white paper provides a detailed explanation of these challenges and proposes solutions to deal with them.

Yelyzaveta Nechytailo

2022-03-10

Tutorials

Scrapers

Puppeteer Tutorial: Scraping With a Headless Browser

Web scraping and automation with JavaScript has evolved a lot in recent years. There are a few methods to accessing and parsing web pages, but in this tutorial we will be covering how to do it with Puppeteer.

Gabija Fatenaite

2022-03-09

Tutorials

Scrapers

Web Scraping for Machine Learning

This tutorial explores a real-life scenario where web scraping and machine learning work in tandem and how the step-by-step process should look like if you decide to do it on your own.

Danielius Radavicius

2022-02-22

News

Data acquisition

Scrapers

Web Scraping: Another Block In The Wall | OxyCast #2

If you’ve ever tried web scraping, you should be aware of the blocking issue. It’s a common challenge, especially if you gather public data on a large scale without a decent knowledge of using resources wisely. This is why we decided to cover this topic and share our knowledge and tips & tricks on how to avoid getting blocked.

Iveta Vistorskyte

2022-02-22

Data acquisition

Proxies

Scrapers

Proxies for Web Scraping: The Ultimate Guide for 2022

Managing proxy servers may consume more time than the web data extraction itself. It’s crucial to learn how to do it properly before you begin working on your next web scraping project.

Roberta Aukstikalnyte

2022-02-01

News

Scrapers

OxyCast: A New Podcast on Everything Web Scraping Related

Web scraping is such a broad topic, and there’s a lot of things to learn in order to collect the required public data efficiently. That’s why our team decided to start a new podcast on everything web scraping related – OxyCast!

Iveta Vistorskyte

2022-01-20

Scale up your business with Oxylabs®