Back to blog

Oxylabs Launches Custom Parser

We're excited to introduce a new feature of a Web Scraper API, Custom Parser. Check this blog post to learn how it can facilitate your parsing jobs.

Maryia Stsiopkina

2023-07-03

1 min read

Why Do Some People Bypass Queue-It?

Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.

Danielius Radavicius

2023-07-03

3 min read

5 Main Web Scraping Challenges & Solutions

Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.

Augustas Pelakauskas

2023-06-30

6 min read

Asynchronous Web Scraping With Python & AIOHTTP

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

Yelyzaveta Nechytailo

2023-06-27

6 min read

How to Bypass CAPTCHA With Puppeteer

Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.

Maryia Stsiopkina

2023-06-22

4 min read

Choosing Between SOCKS vs HTTP Proxy

Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.

Vejune Tamuliunaite

2023-06-21

5 min read

Open-Source Intelligence to Boost Your Business: ESPY's Guide

Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.

Maryia Stsiopkina

2023-06-20

2 min read

Oxycon2023

OxyCon 2023: Staying Ahead of the Game With Web Scraping

OxyCon is back for its fourth year with inspiring speakers and captivating presentations.

Enrika Pavlovskytė

2023-06-19

2 min read

How to Choose the Right Database for Storing Your Data

Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.

Danielius Radavicius

2023-06-15

7 min read

Scraping Experts: Building Real-Time E-Commerce Product Monitoring System in 5 Minutes

See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.

Vytenis Kaubrė

2023-06-13

2 min read

How to Send GET Requests With cURL

How to Send GET Requests With cURL

Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.

Iveta Vistorskyte

2023-06-09

4 min read

How to Send POST Requests With cURL

How to Send POST Requests With cURL

cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.

Yelyzaveta Nechytailo

2023-06-09

3 min read

Meet us at the Travel Tech Show

Don't miss the chance to meet us at the Travel Tech Show

Join Oxylabs at Travel Tech Show, London, to discover the latest travel industry trends and innovations as well as connect with industry experts.

Iveta Vistorskyte

2023-06-08

2 min read

Beautiful Soup Tutorial - How to Parse Web Data With Python

Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.

Adomas Sulcas

2023-06-06

9 min read

How to Parse XML in Python

How to Parse XML in Python

Check this step-by-step tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.

Maryia Stsiopkina

2023-06-02

6 min read

Using Real-Time Public Data for Competitive Advantage in Travel Industry

Using Real-Time Public Data for Competitive Advantage in Travel Industry

An action chain of processes and solutions for public web data collection in the travel industry.

Augustas Pelakauskas

2023-06-02

1 min read

Oxylabs Webinar: AI and Web Scraping - The Unstoppable Duo for Web Data Collection

Watch Oxylabs Webinar and find out how AI is becoming an essential part of web scraping.

Danielius Radavicius

2023-05-31

2 min read

Mobile Proxies in Self-Service

Mobile Proxies are Now in Self-Service!

Get Oxylabs Mobile Proxies in a hassle-free way and access new payment plans that fit your needs!

Danielius Radavicius

2023-05-31

3 min read

Mobile Proxies Quick Start Guide

Kickstart your journey with this Mobile Proxies guide. Learn about the features, pricing plans, query formation, and much more.

Vytenis Kaubrė

2023-05-31

3 min read

How to Send HTTP Headers With cURL

How to Send HTTP Headers With cURL

This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.

Augustas Pelakauskas

2023-05-25

5 min read

“Project 4β” Teams Up with a Nonprofit #SRNT

"4β" established a new partnership with #SRNT - a nonprofit Crisis Aide platform, that aims to can provide real-time support and assistance for individuals facing difficult life situations.

Gabija Birgile

2023-05-24

2 min read

Python Cache: How to Speed Up Your Code with Effective Caching

Python Cache: How to Speed Up Your Code with Effective Caching

Discover the functionalities of caching in Python and see how you can speed up large-scale web scraping tasks.

Vytenis Kaubrė

2023-05-17

9 min read

How to Use cURL With Python

How to Use cURL With Python

Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.

Roberta Aukstikalnyte

2023-05-17

4 min read

How to Use cURL with REST API

How to Use cURL with REST API

A detailed yet clear step-by-step tutorial on using cURL with REST API. Check it out and implement the gathered insights to future projects.

Yelyzaveta Nechytailo

2023-05-16

4 min read

"Project 4β" Partners With Debunk.org to Counter Disinformation

The partnership between "Project 4β"and Debunk.org will provide the organization with Oxylabs' cutting-edge web scraping technology and expertise to combat false information online on a pro-bono basis. 

Gabija Birgile

2023-05-10

2 min read

Oxylabs Webinar: Driving E-Commerce Success Through Pricing Data - Are You Getting It Right?

Watch Oxylabs webinar on-demand to make sure you get all the needed insights to step into the e-commerce data collection confidently.

Yelyzaveta Nechytailo

2023-05-10

2 min read

Python Syntax Errors: Common Mistakes and How to Fix Them

Python Syntax Errors: Common Mistakes and How to Fix Them

Learn how to understand, avoid, and solve Python syntax errors by following this in-depth guide.

Vytenis Kaubrė

2023-05-08

9 min read

What Are Web Snapshots and How Do They Work?

Explore web page snapshots, their functionalities, benefits, and various use cases.

Enrika Pavlovskytė

2023-05-05

4 min read

Proxy lists

Proxy Lists: What Are They and How Do They Work?

Discover the most popular types of proxy lists available and choose which one fits your scraping needs best.

Yelyzaveta Nechytailo

2023-05-04

4 min read

Meet us at AI & Big Data Expo

Meet Us At AI & Big Data Expo

Join Oxylabs at the heart of Silicon Valley for countless learning and networking opportunities at AI & Big Data Expo in Santa Clara.

Enrika Pavlovskytė

2023-05-04

2 min read

Best Integration Methods

Best Integration Methods Inside Out

Need help deciding what integration method to use? Check this article to learn about primary Web Scraper API integration methods, their key advantages, and some helpful tips.

Maryia Stsiopkina

2023-05-02

5 min read

Data as a Service (DaaS)

What Is Data as a Service (DaaS) & How It Helps

Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.

Augustas Pelakauskas

2023-04-28

5 min read

Scrapy Splash Tutorial: How to Scrape JavaScript-Rendered Websites

An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.

Roberta Aukstikalnyte

2023-04-25

5 min read

Structured vs. Unstructured Data: Definition, Characteristics, and Comparison

Structured vs. Unstructured Data: Definition, Characteristics, and Comparison

Read our in-depth guide, where we compare structured and unstructured data, identifying each types’ pros, cons, use cases, and more.

Roberta Aukstikalnyte

2023-04-13

5 min read

New Self-Service Pricing Plans

Oxylabs’ Web Scraper API and Web Unblocker Are Now in Self-Service!

Get access to Oxylabs’ top products using a quick self-checkout process – request and start using in just a few clicks!

Yelyzaveta Nechytailo

2023-04-06

3 min read

Web Unblocker Quick Start Guide

Discover the essentials of Web Unblocker and learn how to get started with it.

Vytenis Kaubrė

2023-04-06

2 min read

Python Requests Library: 2024 Guide

Check out our newest Python tutorial where we outline how to use the Requests library. Get some easy -o-use tips for GET and POST methods.

Adomas Sulcas

2023-04-06

11 min read

Crawlee Tutorial: Easy Web Scraping and Browser Automation

Crawlee Tutorial: Easy Web Scraping and Browser Automation

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

Yelyzaveta Nechytailo

2023-04-04

6 min read

Oxylabs Featured in Raconteur “Future of Data and AI” Special Report

Oxylabs has been featured in a special report, created by the Raconteur as an important asset to the global AI and data industry. Check out the post to read the report.

Adomas Sulcas

2023-04-04

1 min read

How to Scrape Product Data From Wayfair: A Step-by-Step Guide

How to Scrape Product Data From Wayfair: A Step-by-Step Guide

A step-by-step tutorial on extracting data from Wayfair’s product pages at scale and in real time. The guide details actionable code and considers various aspects before and during the scraping process.

Augustas Pelakauskas

2023-04-03

6 min read

How to Scrape Best Buy Product Data

How to Scrape Best Buy Product Data: A Step-by-Step Tutorial

Learn how to extract data from Best Buy product pages at scale and in real time with Best Buy Scraper API. The API automates the underlying processes and delivers ready-to-use data.

Augustas Pelakauskas

2023-04-02

3 min read

Best Programming Languages for Effective Web Scraping

See the various popular languages used in public web scraping operations and determine each's strengths and limitations.

Danielius Radavicius

2023-03-31

7 min read

Dedicated IP vs Shared IP

When it comes to hiding your identity online, using proxies is a great way to stay anonymous and keep your real IP address hidden. In this article, you’ll get an answer to the question, why dedicated proxies are usually better than shared ones.

Gabija Fatenaite

2023-03-29

4 min read

How to Make Web Scraping Faster – Python Tutorial

Read this article where we discuss a few useful ways of making public data collection faster as well as provide sample codes that you can implement in your scraping activities.

Yelyzaveta Nechytailo

2023-03-29

6 min read

Scraping experts anti-bot systems

Scraping Experts: Bypassing Sophisticated Anti-Bot Systems

The latest Scraping Experts lesson on sophisticated anti-bot systems and how to sucessfully bypass them.

Enrika Pavlovskytė

2023-03-27

2 min read

bypass IP bans

How to Bypass an IP Ban: Techniques & Tips

Got your IP banned from a website? This blog post will walk you through the best solutions on how to prevent IP bans from ever happening again.

Enrika Pavlovskytė

2023-03-24

5 min read

Web Scraping with Scrapy: Python Tutorial

This technical tutorial will walk you through the key steps of web scraping with Scrapy.

Maryia Stsiopkina

2023-03-23

5 min read

What is ELT, and How Does It Differ From ETL?

What is ELT, and How Does It Differ From ETL?

Read this article to learn the ins and outs of the Extract, Load, and Transform process.

Vytenis Kaubrė

2023-03-23

5 min read

scheduler

Automate Recurring Scraping and Parsing Jobs: Scheduler Overview

Automate Recurring Scraping and Parsing Jobs: Scheduler Overview

Roberta Aukstikalnyte

2023-03-20

3 min read

How to Scrape Data from eBay: A Step-by-Step Guide

Follow the steps in this detailed tutorial to learn how to scrape data from eBay while avoiding blocks.

Danielius Radavicius

2023-03-17

4 min read

Previous
12345
...
12Next

Top News on Everything Data Gathering

Subscribe to our newsletter and get monthly scraping updates delivered right to your email.

No spam whatsoever, just pure data gathering news, trending topics and useful links. Unsubscribe anytime.