How to Make Web Scraping Faster – Python Tutorial

Read this article where we discuss a few useful ways of making public data collection faster as well as provide sample codes that you can implement in your scraping activities.

Yelyzaveta Hayrapetyan

2023-03-29

6 min read

Dedicated IP vs Shared IP

When it comes to hiding your identity online, using proxies is a great way to stay anonymous and keep your real IP address hidden. In this article, you’ll get an answer to the question, why dedicated proxies are usually better than shared ones.

Gabija Fatenaite

2023-03-29

4 min read

Scraping Experts: Bypassing Sophisticated Anti-Bot Systems

The latest Scraping Experts lesson on sophisticated anti-bot systems and how to sucessfully bypass them.

Enrika Pavlovskytė

2023-03-27

2 min read

Web Scraping with Scrapy: Python Tutorial

This technical tutorial will walk you through the key steps of web scraping with Scrapy.

Maryia Stsiopkina

2023-03-23

5 min read

What is ELT, and How Does It Differ From ETL?

Read this article to learn the ins and outs of the Extract, Load, and Transform process.

Vytenis Kaubrė

2023-03-23

5 min read

Automate Recurring Scraping and Parsing Jobs: Scheduler Overview

Automate Recurring Scraping and Parsing Jobs: Scheduler Overview

Vytenis Kaubrė

2023-03-20

3 min read

Meet us at the Shoptalk in Las Vegas!

Anticipation is growing as Oxylabs is preparing to attend one of the most significant retail industry events – Shoptalk 2023.

Enrika Pavlovskytė

2023-03-15

2 min read

Web Unblocker Vs Self-Managed Proxies

We gathered great minds and put hundreds of hours to create an advanced AI-powered proxy solution – Web Unblocker! Learn more in this blog post where we compare it with self-managed proxies.

Gabija Fatenaite

2023-03-14

4 min read

Oxylabs’ “Project 4β” Partners with The Environmental Protection Department

Oxylabs partners with the Environmental Protection Department of Lithuania through its pro bono initiative “Project 4β”. The Oxylabs team will help tackle the problem of illegal classified ads on Lithuanian websites.

Gabija Birgile

2023-03-10

2 min read

How to Scrape Bing Search Results using Python

See the detailed step-by-step process of how to scrape Bing.

Danielius Radavicius

2023-03-03

4 min read

Oxylabs Co-Founds The Ethical Web Data Collection Initiative to Promote Industry Best Practices

Oxylabs becomes one of the co-founding members of The Ethical Web Data Collection Initiative, which seeks to establish industry-wide best practices and dialogue

Adomas Sulcas

2023-02-28

2 min read

How AI Is Changing the Web Scraping Landscape

This white paper provides a comprehensive overview of how AI and its subfield, machine learning, shape the current trends in web scraping.

Augustas Pelakauskas

2023-02-21

1 min read

Oxylabs Attends Big Data & AI World in London

The beginning of the year is always filled with anticipation and excitement, and this year is no different as we look forward Oxylabs attending Big Data & AI World with a booth and a speaker.

Enrika Pavlovskytė

2023-02-01

2 min read

How to Parse HTML with PyQuery: Python Tutorial

Follow this tutorial to scrape and parse the HTML of a desired website. Learn about the PyQuery library, how to use it in Python, and how it differs from Beautiful Soup.

Vytenis Kaubrė

2023-01-25

4 min read

The Future of Web Scraping and Alternative Data - Predictions for 2023

As 2022 comes to a close, Oxylabs industry experts predict what the future for web scraping and alternative data will look like in the year 2023.

Adomas Sulcas

2023-01-17

2 min read

Playwright vs Selenium: Which One to Choose

Let's discuss Playwright vs Selenium, their relevance to web scraping, and what to remember when picking one for your scraping task.

Enrika Pavlovskytė

2023-01-10

6 min read

AI-Driven Web Scraping Companion: Introducing Web Unblocker

Next-Gen Residential Proxies has evolved into Web Unblocker. Find out the core features and functionalities of our newly updated proxy solution.

Augustas Pelakauskas

2023-01-03

2 min read

What is a Private Proxy? [Quick Guide 2024]

A private proxy, also known as dedicated, is a proxy that is used only by one user. It’s not shared with anyone else, so you have full control over how and when this proxy is used.

Lukas Motiejunas

2023-01-01

4 min read

Oxylabs Webinar: Large-Scale Web Scraping - Never Get Blocked Again

Oxylabs hosted a webinar to share the most efficient techniques to unblock public content from the most complex targets. Additionally, we presented how our new proxy solution works.

Maryia Stsiopkina

2022-12-22

1 min read

How Does a Proxy Server Improve Security

Find out the numerous features of proxies and how they improve security.

Danielius Radavicius

2022-12-16

4 min read

What is Browser Automation? Definition and Examples

From routine task automation to web testing, the range of uses is vast. Read all about browser automation, its everyday use cases, its challenges, and how to get started with it.

Vytenis Kaubrė

2022-12-15

6 min read

Scraping Experts: Making the Right Move with Real Estate Monitoring

Scraping Experts share invaluable advice on collecting fresh, robust, and verifiable real estate data.

Enrika Pavlovskytė

2022-12-12

2 min read

Oxylabs Recognized with the 2022 Baltic Sustainability Award

Oxylabs was announced a winner at the Baltic Sustainability Awards for its joint pro bono project with the CRA to detect illegal content online with a unique AI-powered web scraping solution.

Gabija Birgile

2022-12-07

2 min read

What Is an Anonymous Proxy?

Have you ever wondered if all proxies are anonymous? Let's find out in this article on different levels of proxy anonymity and anonymous proxy use cases.

Enrika Pavlovskytė

2022-12-01

4 min read

Oxylabs AI-driven Solution Listed as Baltic Sustainability Awards Finalist

Oxylabs has been recognized in the “Impact” category and is a finalist in the “Social Initiatives” subcategory for its work in fighting illegal content (incl. child sexual abuse and pornography) online.

Gabija Birgile

2022-11-23

2 min read

What Is a Distorting Proxy & How Does It Work?

Discover all the basics about distorting proxies. Use cases, advantages and drawbacks, and risks of using free distorting proxies.

Yelyzaveta Hayrapetyan

2022-11-23

5 min read

Scraping Experts: SEO Monitoring for a Thriving Business

New Scraping Experts video lesson on hassle-free SEO monitoring with Python, Celery, and Web Scraper API.

Enrika Pavlovskytė

2022-11-16

2 min read

What Is an ETL Pipeline?

ETL stands for extract, transform, and load. It’s an independent three-stage process that moves data from one source(s) to a database and is crucial for modern day anlysis.

Danielius Radavicius

2022-10-14

5 min read

Free White Paper: Alternative Data Defines Competition in the US & UK Ecommerce Sectors

Read our whitepaper that outlines the results of a US & UK decision maker survey on the usage of alternative data and web scraping in their daily operations

Adomas Sulcas

2022-10-11

1 min read

Screen Scraping: What Is It and How Does It Work?

Find out what screen scraping is and how it works. Learn the difference between web scraping and screen scraping.

Vytenis Kaubrė

2022-10-03

5 min read

How to Run Python Script as a Service (Windows & Linux)

From Linux daemons to Windows services, this guide will detail the process of setting up Python script as a service in a few simple steps.

Augustas Pelakauskas

2022-09-26

5 min read

Oxylabs Attends Current 2022: The Next Generation of Kafka Summit

We're excited to sponsor and participate live in the Current 2022: The Next Generation of Kafka Summit. Don't miss out and participate in one of the largest data-focused conferences worldwide!

Danielius Radavicius

2022-09-21

2 min read

Oxylabs Acquires Webshare Software Company

Oxylabs furthers industry leadership by acquiring US-based Webshare Software Company.

Adomas Sulcas

2022-09-20

1 min read

OxyCon 2022: The Top Takeaways From Day Two

See what the second day of the conference was all about and take note of all the important highlights you might have missed.

Yelyzaveta Hayrapetyan

2022-09-09

4 min read

OxyCon® 2022: The Top Takeaways From Day One

Find out the core talking points during the first day of our annual 2022 OxyCon conference and see in more detail what topics were covered.

Danielius Radavicius

2022-09-07

7 min read

6 Web Scraping Project Ideas to Sharpen Your Skills

Planning a project on web scraping and don’t know where to start? Learn how proxies come into play when project planning for web scraping in our most recent article.

Gabija Fatenaite

2022-08-31

8 min read

How to Continuously Yield High Quality Data | Interview with Glen De Cauwsemaecker

As part of the combined efforts of Oxylabs and OTA Insight to shed light on the developments in the web scraping industry, we sat down with Glen De Cauwsemaeker, the Lead Crawler Engineer at OTA Insight, to talk about the challenges when scaling data acquisition solutions.

Glen De Cauwsemaecker

2022-08-25

10 min read

Web Scraping with Rust

In this practical tutorial, you'll learn how to create a web scraper using Rust and collect public product data from an e-commerce website.

Maryia Stsiopkina

2022-08-24

6 min read

2 Weeks Until OxyCon® So Hurry Up and Register!

Only two weeks left up until, OxyCon, the two-day virtual event, starts. Find out more about what awaits within the conference and don't hesitate to register, there isn't much time left!

Danielius Radavicius

2022-08-24

2 min read

Data Pipeline Architecture Explained

Learn what a data pipeline architecture is, why it's important for businesses and how to build one.

Vytenis Kaubrė

2022-08-11

5 min read

Automated Web Scraper With Python & Windows Task Scheduler

In this article, you’ll learn how to set up Windows Task Scheduler to schedule a Python web scraping script automatically & periodically.

Augustas Pelakauskas

2022-08-04

5 min read

Automating Web Scraping With Python and Cron

If you're curious about how to automate your web scraping projects with Python and cron, then check out this dedicated tutorial for more information.

Danielius Radavicius

2022-07-29

6 min read

OxyCon® 2022 Agenda is Live - How to Get the Most Out of the Event

This year's OxyCon has already garnered attention from every corner of the data gathering industry. Now is the time to reveal what's in store during our two-day event on September 7-8th.

Danielius Radavicius

2022-07-28

2 min read

Marketplace SEO: How to Improve Your SERP Rankings with Data

The success of your SEO strategy will likely depend entirely on how accurately you follow a specific marketplace’s regulations and in what ways you stand out.

Danielius Radavicius

2022-07-26

7 min read

Machine Learning: The Driving Force of Web Scraping | OxyCast #6

A brand new episode of OxyCast is live! This time, our favorite host Augustinas Kalvis (Software Developer), and a special guest Jurijus Gorskovas (Machine Learning Engineer), delve deeper into the world of Machine Learning! Watch it to understand the details of machine learning and how it can make web scraping processes more efficient.

Iveta Vistorskyte

2022-07-13

3 min read

The Second Mover’s Advantage

Businesses are complex, and both first and second movers encounter unique difficulties and advantages. If you're interested in how these advantages relate to web scraping, check this out!

Julius Cerniauskas

2022-07-05

4 min read

Data Quality Metrics You Should Track and Measure

Learn more about how to effectively track and measure data quality with the help of this detailed blog post

Yelyzaveta Hayrapetyan

2022-06-27

5 min read

Brand New Lessons on Everything Data Gathering

Data gathering is a rather tricky field; therefore, getting advice and lessons from people who have worked at the top of the industry for years is unparalleled.

Danielius Radavicius

2022-06-22

2 min read