How to Scrape Google News: Step-by-Step Guide

Check out this straightforward, step-by-step guide on how to scrape Google News.

Danielius Radavicius

2023-08-07

3 min read

Scrapy Cloud: How to Use, Manage & Maximize Spider Execution

Check this article to learn more about web scraping with Scrapy Cloud: how it works, how to set it up, and if there are any alternatives.

Maryia Stsiopkina

2023-08-03

5 min read

Agenda is live, why attend OxyCon 2023!

This year's OxyCon has already garnered attention from every corner of the data gathering industry. Now is the time to reveal what's in store during our virtual event on September 13th.

Danielius Radavicius

2023-08-02

2 min read

Serverless Web Scraping with Scrapy and AWS Lambda

Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.

Yelyzaveta Nechytailo

2023-08-02

5 min read

How to Use ChatGPT for Web Scraping in 2024

ChatGPT web scraping is quickly gaining momentum. Let’s see how you can use ChatGPT to write code for web scraping, along with some tips and tricks.

Maryia Stsiopkina

2023-07-28

5 min read

Free White Paper: Developing a Real Estate Data Monitoring Infrastructure

Discover how your real estate business can benefit from web scraping and learn how to build your own property data monitoring architecture.

Roberta Aukstikalnyte

2023-07-28

1 min read

Scrapy vs. Beautiful Soup: A Comparison of Web Scraping Tools

Delve deeper into the differences between Scrapy vs. Beautiful Soup and discover which one you need for your scraping project.

Enrika Pavlovskytė

2023-07-21

4 min read

Scrapy vs. Selenium: Which One is Better?

Find the ideal web scraping tool for your project by exploring the unique features and differences of Scrapy and Selenium.

Vytenis Kaubrė

2023-07-12

5 min read

Web Scraping Together: Unleash Community Benefits

If you're wondering how to stay up-to-date in the ever-changing world of web scraping, make valuable connections, and improve your tech expertise, check out this blog post about the benefits of web scraping communities.

Maryia Stsiopkina

2023-07-10

2 min read

How to Create and Upload a Sitemap: A Step-By-Step Guide

Learn what sitemaps are and discover effective solutions for creating them.

Enrika Pavlovskytė

2023-07-07

6 min read

Oxylabs Launches Custom Parser

We're excited to introduce a new feature of Scraper APIs, Custom Parser. Check this blog post to learn how it can facilitate your parsing jobs.

Maryia Stsiopkina

2023-07-03

1 min read

Why Do Some People Bypass Queue-It?

Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.

Danielius Radavicius

2023-07-03

3 min read

5 Main Web Scraping Challenges & Solutions

Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.

Augustas Pelakauskas

2023-06-30

6 min read

Asynchronous Web Scraping With Python & AIOHTTP

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

Yelyzaveta Nechytailo

2023-06-27

6 min read

How to Bypass CAPTCHA With Puppeteer

Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.

Maryia Stsiopkina

2023-06-22

4 min read

Choosing Between SOCKS vs HTTP Proxy

Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.

Vejune Tamuliunaite

2023-06-21

5 min read

Open-Source Intelligence to Boost Your Business: ESPY's Guide

Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.

Maryia Stsiopkina

2023-06-20

2 min read

OxyCon 2023: Staying Ahead of the Game With Web Scraping

OxyCon is back for its fourth year with inspiring speakers and captivating presentations.

Enrika Pavlovskytė

2023-06-19

2 min read

How to Choose the Right Database for Storing Your Data

Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.

Danielius Radavicius

2023-06-15

7 min read

Scraping Experts: Building Real-Time E-Commerce Product Monitoring System in 5 Minutes

See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.

Vytenis Kaubrė

2023-06-13

2 min read

How to Send POST Requests With cURL

cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.

Yelyzaveta Nechytailo

2023-06-09

3 min read

How to Send GET Requests With cURL

Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.

Iveta Vistorskyte

2023-06-09

4 min read

How to Scrape Google Maps: A Comprehensive Guide

See this extensive guide on how to scrape Google Maps with an Oxylabs solution.

Danielius Radavicius

2023-06-09

5 min read

Don't miss the chance to meet us at the Travel Tech Show

Join Oxylabs at Travel Tech Show, London, to discover the latest travel industry trends and innovations as well as connect with industry experts.

Iveta Vistorskyte

2023-06-08

2 min read

Beautiful Soup Tutorial - How to Parse Web Data With Python

Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.

Adomas Sulcas

2023-06-06

9 min read

Using Real-Time Public Data for Competitive Advantage in Travel Industry

An action chain of processes and solutions for public web data collection in the travel industry.

Augustas Pelakauskas

2023-06-02

1 min read

How to Parse XML in Python

Check this step-by-step tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.

Maryia Stsiopkina

2023-06-02

6 min read

Mobile Proxies are Now in Self-Service!

Get Oxylabs Mobile Proxies in a hassle-free way and access new payment plans that fit your needs!

Danielius Radavicius

2023-05-31

3 min read

Oxylabs Webinar: AI and Web Scraping - The Unstoppable Duo for Web Data Collection

Watch Oxylabs Webinar and find out how AI is becoming an essential part of web scraping.

Danielius Radavicius

2023-05-31

2 min read

Mobile Proxies Quick Start Guide

Kickstart your journey with this Mobile Proxies guide. Learn about the features, pricing plans, query formation, and much more.

Vytenis Kaubrė

2023-05-31

3 min read

How to Send HTTP Headers With cURL

This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.

Augustas Pelakauskas

2023-05-25

5 min read

“Project 4β” Teams Up with a Nonprofit #SRNT

"4β" established a new partnership with #SRNT - a nonprofit Crisis Aide platform, that aims to can provide real-time support and assistance for individuals facing difficult life situations.

Gabija Birgile

2023-05-24

2 min read

How to Use cURL With Python

Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.

Roberta Aukstikalnyte

2023-05-17

4 min read

Python Cache: How to Speed Up Your Code with Effective Caching

Discover the functionalities of caching in Python and see how you can speed up large-scale web scraping tasks.

Vytenis Kaubrė

2023-05-17

9 min read

How to Use cURL with REST API

A detailed yet clear step-by-step tutorial on using cURL with REST API. Check it out and implement the gathered insights to future projects.

Yelyzaveta Nechytailo

2023-05-16

4 min read

"Project 4β" Partners With Debunk.org to Counter Disinformation

The partnership between "Project 4β"and Debunk.org will provide the organization with Oxylabs' cutting-edge web scraping technology and expertise to combat false information online on a pro-bono basis. 

Gabija Birgile

2023-05-10

2 min read

Oxylabs Webinar: Driving E-Commerce Success Through Pricing Data - Are You Getting It Right?

Watch Oxylabs webinar on-demand to make sure you get all the needed insights to step into the e-commerce data collection confidently.

Yelyzaveta Nechytailo

2023-05-10

2 min read

Python Syntax Errors: Common Mistakes and How to Fix Them

Learn how to understand, avoid, and solve Python syntax errors by following this in-depth guide.

Vytenis Kaubrė

2023-05-08

9 min read

What Are Web Snapshots and How Do They Work?

Explore web page snapshots, their functionalities, benefits, and various use cases.

Enrika Pavlovskytė

2023-05-05

4 min read

Meet Us At AI & Big Data Expo

Join Oxylabs at the heart of Silicon Valley for countless learning and networking opportunities at AI & Big Data Expo in Santa Clara.

Enrika Pavlovskytė

2023-05-04

2 min read

Proxy Lists: What Are They and How Do They Work?

Discover the most popular types of proxy lists available and choose which one fits your scraping needs best.

Yelyzaveta Nechytailo

2023-05-04

4 min read

Best Integration Methods Inside Out

Need help deciding what integration method to use? Check this article to learn about primary Scraper APIs integration methods, their key advantages, and some helpful tips.

Maryia Stsiopkina

2023-05-02

5 min read

What Is Data as a Service (DaaS) & How It Helps

Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.

Augustas Pelakauskas

2023-04-28

5 min read

Scrapy Splash Tutorial: How to Scrape JavaScript-Rendered Websites

An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.

Roberta Aukstikalnyte

2023-04-25

5 min read

Structured vs. Unstructured Data: Definition, Characteristics, and Comparison

Read our in-depth guide, where we compare structured and unstructured data, identifying each types’ pros, cons, use cases, and more.

Roberta Aukstikalnyte

2023-04-13

5 min read

Oxylabs’ Scraper APIs and Web Unblocker Are Now in Self-Service!

Get access to Oxylabs’ top products using a quick self-checkout process – request and start using in just a few clicks!

Yelyzaveta Nechytailo

2023-04-06

3 min read

Web Unblocker Quick Start Guide

Discover the essentials of Web Unblocker and learn how to get started with it.

Vytenis Kaubrė

2023-04-06

2 min read

Python Requests Library: 2024 Guide

Check out our newest Python tutorial where we outline how to use the Requests library. Get some easy -o-use tips for GET and POST methods.

Adomas Sulcas

2023-04-06

11 min read

Crawlee Tutorial: Easy Web Scraping and Browser Automation

This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.

Yelyzaveta Nechytailo

2023-04-04

6 min read

Oxylabs Featured in Raconteur “Future of Data and AI” Special Report

Oxylabs has been featured in a special report, created by the Raconteur as an important asset to the global AI and data industry. Check out the post to read the report.

Adomas Sulcas

2023-04-04

1 min read