Data acquisition

How to Scrape Google News: Step-by-Step Guide

Check out this straightforward, step-by-step guide on how to scrape Google News.

Danielius Radavicius

2024-09-06

3 min read

Block-Free Web Scraping: A Comprehensive Guide

The basics of avoiding blocks when web scraping: things to know before starting, actions to implement when scraping, and the complexities of anti-bot detection.

Augustas Pelakauskas

2024-08-30

1 min read

How to Web Scrape HTML Tables With Python: Step-by-Step

Learn to scrape and parse HTML tables in Python using three real table examples. This article covers the basics and the more advanced concepts.

Vytenis Kaubrė

2024-08-23

6 min read

Web Scraping SDK: Definition and Benefits at a Glance

Learn about Software Development Kits (SDKs) and their role in web scraping. Discover the main benefits of SDKs over APIs and see a code comparison of Oxylabs Python SDK vs. Oxylabs API.

Vytenis Kaubrė

2024-08-14

5 min read

10 Best Puppeteer Alternatives for Web Scraping in 2024

Discover some of the best Puppeteer alternatives for web scraping, highlighting key features, drawbacks, and prices.

Augustas Pelakauskas

2024-07-26

5 min read

BeautifulSoup Alternatives for Web Scraping in 2024

Discover 6 BeautifulSoup alternatives for parsing scraped data.

Roberta Aukstikalnyte

2024-07-16

4 min read

Wget vs cURL for Downloading Files in Linux

Learn about the differences between cURL and Wget in terms of structure, use cases, functionalities, and more.

Enrika Pavlovskytė

2024-06-21

4 min read

JavaScript vs Python for Web Scraping Compared in 2024

Explore JavaScript and Python, two of the most popular programming languages, in detail to understand which one fits your project best.

Yelyzaveta Nechytailo

2024-06-13

4 min read

How to Retry Failed Python Requests in 2024

Find out how you can set up a Python requests retry strategy using libraries and custom functions. See code examples for configuring proxies when retrying failed requests.

Vytenis Kaubrė

2024-06-06

7 min read

How to Ignore SSL Certificate With cURL

In this article, we talk about SSL certificates, why you might want to bypass them, and how to do it with curl.

Enrika Pavlovskytė

2024-05-30

2 min read

How to Download Files With cURL

Learn how to download files with cURL, including using essential parameters, handling redirects, and managing the process.

Augustas Pelakauskas

2024-05-30

4 min read

10 Best No-Code Scrapers in 2024

Web scraping can get difficult but it doesn’t have to be with no-code and low code web scrapers. Check out these no-code tools that could streamline your operations.

Enrika Pavlovskytė

2024-05-21

7 min read

Optimization of Inventory Level Tracking in E-Commerce

This free white paper provides a general overview of inventory level tracking, its trends, usage scenarios, and the process of finding and getting relevant data.

Augustas Pelakauskas

2024-04-19

1 min read

Guide to Scraping Data from Websites to Excel with Web Query

Check this step-by-step tutorial to learn how to scrape data from websites into Excel. Find out Excel's capabilities of extracting information from various websites.

Iveta Vistorskyte

2024-04-05

6 min read

How to Scrape Job Postings in 2024

No matter how you'll be using job search aggregation data, data gathering requires good scraping solutions. In this blog post, we'll go over where to start, and which solutions work best.

Gabija Fatenaite

2024-04-04

7 min read

How to Scrape Google Finance with Python

Follow our detailed walkthrough for scraping public data (stock titles, prices, and pricing changes in percentages) from Google Finance.

Roberta Aukstikalnyte

2024-04-03

3 min read

How to Scrape Google Flights with Python

Learn how to extract public pricing information, flight times, and airline names from Google Flights with Python and Oxylabs’ Google Flights API.

Yelyzaveta Nechytailo

2024-03-18

4 min read

15 Tips on How to Crawl a Website Without Getting Blocked

Web crawling and web scraping are essential for data gathering. Getting blacklisted while scraping data is a common issue for those who don’t know how to crawl a website without getting blocked. We gathered a list of actions to prevent getting blacklisted while scraping and crawling websites.

Adelina Kiskyte

2024-03-15

7 min read

How to Analyze Competitors’ Google Ads: 5 Methods

Find out the 5 ways to analyze your Google Ads competition. From simple SERP checks to automated web scraping that gathers Google ads data in real-time and at scale.

Augustas Pelakauskas

2024-03-01

7 min read

Is Web Scraping Legal?

Learn how various legal frameworks affect scraping today and what web scraping legal issues can one encounter when scraping certain websites.

Gabija Fatenaite

2024-02-29

8 min read