What is Web Scraping & How to Scrape Data from a Website?

The concept of web scraping is becoming familiar to every modern company aiming to base its decisions on data. This article will explain web scraping and how to effectively incorporate it into your business.

Iveta Vistorskyte

2024-10-09

8 min read

What Is Parsing of Data?

In this article we’ll dig a little deeper on what is data parsing, and discuss whether building an in-house data parser is more beneficial to a business, or is it better to outsource a data parser.

Gabija Fatenaite

2024-10-04

6 min read

Web Crawler vs Web Scraper: The Differences

Data scraping has become the ultimate tool for business development with a significant influence in nearly any business area. With this article, we're covering the intricacies of data scraping in greater detail.

Gabija Fatenaite

2024-10-04

6 min read

How to Bypass CAPTCHA in Web Scraping Using Python

If CAPTCHAs keep on interrupting your day-to-day scraping tasks, read this article presenting solutions that can help you go around them successfully.

Yelyzaveta Hayrapetyan

2024-10-03

7 min read

OxyCon® 2024 On-Demand Videos Are Live!

Access the full range of expert talks from OxyCon 2024 at your convenience, anytime and anywhere.

Akvilė Lūžaitė

2024-10-01

2 min read

LLM Training Data: The 8 Main Public Data Sources

Find out the most beneficial public data sources you can web scrape for LLM training and fine-tuning. Moreover, get a general overview of LLM training data and training processes.

Vytenis Kaubrė

2024-09-27

5 min read

OxyCon® 2024: The Top Takeaways

We, the Oxylabs team, thank you for your enthusiasm in attending, watching, and asking so many questions. Whether you missed the live event or want to refresh your memory, here you’ll find highlights from each topic.

Augustas Pelakauskas

2024-09-26

6 min read

Enhance Your Data Workflow: All-In-One Web Scraper API and OxyCopilot

Today marks a major milestone for both Oxylabs and the web scraping industry: the launch of our unified Web Scraper API, now enhanced with the OxyCopilot feature.

Maryia Stsiopkina

2024-09-25

3 min read

Free White Paper: Guide to Threat Intelligence Data Acquisition

A general overview of threat intelligence processes, emphasizing web data collection to acquire material for threat analysis and risk assessment.

Iveta Vistorskyte

2024-09-23

1 min read

Pagination In Web Scraping: How Challenging It May Be

Dealing with pagination in web scraping might be challenging and result in missing data. Learn about different approaches when scraping multiple pages.

Akvilė Lūžaitė

2024-09-11

7 min read

Hurry! Just 2 Weeks Left to Register for OxyCon® 2024!

With just two weeks to go, now is the perfect time to secure your spot at OxyCon 2024!

Maryia Stsiopkina

2024-09-10

2 min read

How to Scrape Google Lens Results: Python Tutorial

Learn how to scrape Google Lens Results in Python with Oxylabs' Google Lens API. Find out how to set up the API, get structured data, and save it into a JSON file.

Vytenis Kaubrė

2024-09-10

2 min read

Block-Free Web Scraping: A Comprehensive Guide

The basics of avoiding blocks when web scraping: things to know before starting, actions to implement when scraping, and the complexities of anti-bot detection.

Augustas Pelakauskas

2024-08-30

1 min read

How to Web Scrape HTML Tables With Python: Step-by-Step

Learn to scrape and parse HTML tables in Python using three real table examples. This article covers the basics and the more advanced concepts.

Vytenis Kaubrė

2024-08-23

6 min read

Web Scraping SDK: Definition and Benefits at a Glance

Learn about Software Development Kits (SDKs) and their role in web scraping. Discover the main benefits of SDKs over APIs and see a code comparison of Oxylabs Python SDK vs. Oxylabs API.

Vytenis Kaubrė

2024-08-14

5 min read

Project 4beta Partners with Northwestern University Researchers to Explore Digital Redlining

"Project 4β" partners with researchers from Northwestern University to provides free access to Oxylabs' web intelligence collection solutions to investigate the phenomenon of digital redlining.

Gabija Birgile

2024-08-13

2 min read

Leveraging Web Scraping for Economic Research: A Collaboration with Researcher from Aston University

Oxylabs' pro bono initiative "Project 4β" partners with Dr. Ngoc Dieu Linh Vi, a lecturer in Economics at Aston University to provide free access to Oxylabs web scraping solutions.

Gabija Birgile

2024-08-12

2 min read

Don't Miss Out: OxyCon® 2024 Agenda Unveiled!

This year's OxyCon has captured the attention of the entire data gathering industry. The time has come to unveil what we have planned for our virtual event on September 25th.

Maryia Stsiopkina

2024-08-07

2 min read

Datacenter Proxies Quick Start Guide

Keen to find out all things about Oxylabs Datacenter Proxies? You’ve come to the right place. This quick start guide will provide all the information you need to get up and running. Let’s get started!

Augustas Pelakauskas

2024-07-31

4 min read

How to Read JSON Files in JavaScript: Tutorial

Find out how to load and read JSON files using JavaScript with practical code samples. Discover common errors, use cases, and advanced tips for your next project.

Vytenis Kaubrė

2024-07-26

5 min read

LLM Web Scraping: Integrate Assistants API with Scraped Data

Learn to develop AI-based assistants that use real-time website data to answer questions. Find out about the Assistants API and LLM web scraping for successful AI projects.

Vytenis Kaubrė

2024-07-24

6 min read

Web Scraping With Cheerio and Node.js: Step-by-Step Guide

Learn to scrape websites with Cheerio and Axios in Node.js. This guide covers setup, extracting data, and caching for efficient web scraping.

Maryia Stsiopkina

2024-07-23

5 min read

How to Find Proxy Server Address

Learn step-by-step instructions on finding a proxy server IP address on different browsers and mobile devices to enhance your online privacy and security.

Yelyzaveta Hayrapetyan

2024-07-16

3 min read

What are HTTP Headers: Examples and Most Common Types

In this article we will define HTTP headers, and discuss their purpose. What’s more, we will cover why using and optimizing HTTP headers are essential when web scraping.

Mantas Miksenas

2024-07-10

7 min read

Fingerprinting Tactics with Pyppeteer and Playwright

Make sure to secure a slot in your calendar on July 10, 2024, to join us for a value-packed webinar hosted by Paulius Stundžia, Senior Developer at Oxylabs.

Maryia Stsiopkina

2024-06-26

1 min read

How to Find Elements With Selenium in Python

Learn about the most effective techniques for finding elements using Selenium.

Enrika Pavlovskytė

2024-06-21

5 min read

Wget vs cURL for Downloading Files in Linux

Learn about the differences between cURL and Wget in terms of structure, use cases, functionalities, and more.

Enrika Pavlovskytė

2024-06-21

4 min read

OxyCon® 2024: Unlock the Power of Data With Web Scraping

Join us on September 25, 2024 to dive into the ever-changing landscape of web scraping.

Yelyzaveta Hayrapetyan

2024-06-19

2 min read

APIs Decoded: Simplify Data Extraction

Oxylabs hosted a webinar to discover how API endpoints can help uplift your scraping operations.

Enrika Pavlovskytė

2024-06-19

1 min read

ISP Proxies Quick Start Guide

Read this quick guide to easily start using ISP Proxies, purchased through the Oxylabs' dashboard.

Maryia Stsiopkina

2024-06-17

3 min read

Web Scraping with Selenium and Python

Learn how the fundamentals of web scraping work by using Selenium, one of the better known tools for automating web browser interactions.

Gabija Fatenaite

2024-06-13

8 min read

How to Ignore SSL Certificate With cURL

In this article, we talk about SSL certificates, why you might want to bypass them, and how to do it with curl.

Enrika Pavlovskytė

2024-05-30

3 min read

How to Download Files With cURL

Learn how to download files with cURL, including using essential parameters, handling redirects, and managing the process.

Augustas Pelakauskas

2024-05-30

5 min read

The Ferret Joins "Project 4β" to Boost Scottish Investigative Journalism

Oxylabs' pro bono initiative "Project 4β" partners with an award-winning Scottish investigative journalism platform "The Ferret".

Gabija Birgile

2024-05-17

1 min read

Driving Social Impact Through Web Intelligence: "Project 4β" Welcomes Global Witness

Oxylabs' pro bono initiative "Project 4β" partners with an independent, non-profit climate change organisation "Global Witness" to elevate environmental monitoring and research.

Gabija Birgile

2024-05-16

2 min read

Mastering SEO Monitoring Systems: Challenges & Solutions

Watch Oxylabs' webinar to learn the principles of building an SEO monitoring system for data-driven decision-making.

Augustas Pelakauskas

2024-05-14

2 min read

Automated Web Scraper With Python AutoScraper [Guide]

Learn how to use Python for building a web scraper that automatically acquires data at set periods.

Dovydas Vėsa

2024-05-06

6 min read

How to Overcome Anti-Bot Systems: Insights & Tactics

Join Fabien Vauchelles and Denis Zyk as they immerse in the world of anti-bot systems and share bypassing techniques you can implement in your scraping tasks.

Yelyzaveta Hayrapetyan

2024-04-22

1 min read

Optimization of Inventory Level Tracking in E-Commerce

This free white paper provides a general overview of inventory level tracking, its trends, usage scenarios, and the process of finding and getting relevant data.

Augustas Pelakauskas

2024-04-19

1 min read

"Project 4β" Invited Vilnius University Students to Compete for an Internship at Oxylabs

Oxylabs' pro bono initiative "Project 4β" partnered with Vilnius University and introduced a challenge for students enrolled in the Information Systems and Cyber Security program, offering the chance to secure a paid internship at Oxylabs.

Gabija Birgile

2024-04-18

1 min read

Top Web Scraping Discord Servers

Discover the best Discord servers and proxy solutions for web scraping - join our community!

Maryia Stsiopkina

2024-04-08

4 min read

The Oxylabs Team Goes to the RSA Conference 2024 in San Francisco

The Oxylabs team goes to the RSA Conference 2024 in San Francisco to network and share advanced solutions for web data collection in cybersecurity.

Augustas Pelakauskas

2024-04-08

1 min read

“Project 4β” Shares Expertise with Birmingham City University

Oxylabs' pro bono initiative "Project 4β" shared expertise with MA in Data Journalism students of the Birmingham School of Media and data journalists of BBC Shared Data Unit and BBC England Data Unit.

Gabija Birgile

2024-04-05

2 min read

Guide to Scraping Data from Websites to Excel with Web Query

Check this step-by-step tutorial to learn how to scrape data from websites into Excel. Find out Excel's capabilities of extracting information from various websites.

Iveta Vistorskyte

2024-04-05

6 min read

How to Scrape AliExpress With Python

Find out how to scrape AliExpress product data on a large scale without blocks. See Python code examples for scraping search results, products, reviews, and top-selling products.

Vytenis Kaubrė

2024-04-03

10 min read

How to Scrape Google Finance with Python

Follow our detailed walkthrough for scraping public data (stock titles, prices, and pricing changes in percentages) from Google Finance.

Dovydas Vėsa

2024-04-03

3 min read

Reading & Parsing JSON Data With Python: Tutorial

JSON is a common standard used by websites and APIs, and natively supported by modern databases such as PostgreSQL. In this guide, we explain how to handle JSON data with Python.

Monika Maslauskaite

2024-03-28

8 min read

How to Build a Scraper for Zillow Real Estate Data Using Python

A detailed guide on scraping public real estate data from Zillow.

Vytenis Kaubrė

2024-03-26

7 min read

Navigating Legal Landscapes in Web Scraping

Join Denas Grybauskas and Alex Reese on April 8th in our upcoming webinar as they unravel key legal factors.

Maryia Stsiopkina

2024-03-25

2 min read

What Is a Proxy Server & How Does It Work?

In this article, we'll answer the most commonly asked questions the web scraping community has on what is a proxy - the most powerful tool for data gathering.

Adomas Sulcas

2024-03-22

13 min read