Proxy locations

Europe

North America

South America

Asia

Africa

Oceania

See all locations

Network statusCareers

Back to blog

Data Wrangling: What Is It and Why Is It Important?

This article discusses what data wrangling is, the key steps of data wrangling, and why it’s crucial for businesses.

Iveta Vistorskyte

Iveta Vistorskyte

2021-09-23

4 min read

Most Common HTTP Headers

HTTP headers enable to transfer further details within the request or response headers. Find out 5 key HTTP headers that are crucial to use and optimize in web scraping.

Vytautas Kirjazovas

Vytautas Kirjazovas

2021-09-20

4 min read

HTTP vs. HTTPS: What Is the Difference?

This article discusses the differences between HTTP and HTTPS protocols, their security parameters, and the steps you should take to switch from HTTP to HTTPS.

Maryia Stsiopkina

Maryia Stsiopkina

2021-09-17

5 min read

Rotating ISP Proxies: Be in Control of Your Scraping Sessions

We at Oxylabs couldn’t wait to share the good news with you - our new product Rotating ISP Proxies is now released! Read this article to learn what makes Rotating ISP Proxies stand out from the rest proxies and how your web scraping projects can benefit from this product by Oxylabs.

Maryia Stsiopkina

Maryia Stsiopkina

2021-09-17

2 min read

13 Tips on How to Crawl a Website Without Getting Blocked

Web crawling and web scraping are essential for data gathering. Getting blacklisted while scraping data is a common issue for those who don’t know how to crawl a website without getting blocked. We gathered a list of actions to prevent getting blacklisted while scraping and crawling websites.

Adelina Kiskyte

Adelina Kiskyte

2021-09-16

6 min read

Introducing Mobile Proxies: Harness the Power of Mobile IPs

We’re excited to introduce Mobile Proxies with an extensive list of locations, as well as country, state, city, coordinate, and ASN targeting with no extra fees.

Iveta Vistorskyte

Iveta Vistorskyte

2021-09-15

2 min read

What is Firmographic Data? Everything You Need to Know

Firmographic data can provide valuable insight for business-to-business marketers. Read this article to learn what benefits it brings and how it can be acquired.

Maryia Stsiopkina

Maryia Stsiopkina

2021-09-14

6 min read

What Is Parsing of Data?

In this article we’ll dig a little deeper on what is data parsing, and discuss whether building an in-house data parser is more beneficial to a business, or is it better to outsource a data parser.

Gabija Fatenaite

2021-09-13

5 min read

Data-Driven Marketing: How Big Data Helps Make Business Decisions

This article discusses how big data is changing marketing and the process of decision-making. Learn what data-driven marketing is and its main benefits and use cases.

Maryia Stsiopkina

Maryia Stsiopkina

2021-09-02

5 min read

How to Read HTML Tables With Pandas

Read this article to learn everything about pandas library and how useful the pandas read_html function can be, especially when combined with other helpful functions.

Iveta Vistorskyte

Iveta Vistorskyte

2021-09-01

7 min read

Reading & Parsing JSON Data With Python: Tutorial

JSON is a common standard used by websites and APIs, and natively supported by modern databases such as PostgreSQL. In this guide, we explain how to handle JSON data with Python.

Monika Maslauskaite

Monika Maslauskaite

2021-08-30

8 min read

The Role of Web Scraping in Data-Driven Investing

Data gathering has become an integral part of most, if not all, modern businesses. The degree of importance may vary from business to business, yet in areas such as data-driven investing, it’s the core foundation upon which the entire industry is built.

Iveta Vistorskyte

Iveta Vistorskyte

2021-08-30

1 min read

lxml Tutorial: XML Processing and Web Scraping With lxml

Go through the basics of creating XML documents and jump onto processing XML and HTML documents in this Python lxml tutorial.

Gabija Fatenaite

2021-08-30

6 min read

OxyCon 2021: The Top Takeaways From Day Two

The OxyCon 2021 web scraping conference has come to an end but provided us with good food for thought. Read this article summarising the top takeaways from Day Two.

Maryia Stsiopkina

Maryia Stsiopkina

2021-08-27

6 min read

OxyCon 2021: The Top Takeaways From Day One

The first day of OxyCon 2021 has passed. We had some amazing presentations and learned a lot about the world of web scraping. Here are the top key takeaways from day one.

Monika Maslauskaite

Monika Maslauskaite

2021-08-25

5 min read

WebSocket vs HTTP: The Differences

This article discusses the differences between WebSocket and HTTP and their use cases.

Maryia Stsiopkina

Maryia Stsiopkina

2021-08-18

6 min read

What Is Financial Data?

This article will discuss different types of financial data, their use cases, and financial data management and analysis tools.

Maryia Stsiopkina

Maryia Stsiopkina

2021-08-18

6 min read

Free White Paper: Web Scraping in the Travel Industry: Main Challenges and Use Cases

Download this free white paper and get all the information on how you can benefit from web scraping in the travel industry and deal with challenges when gathering the required public data.

Iveta Vistorskyte

Iveta Vistorskyte

2021-08-18

1 min read

How to Test Proxy

This article discusses the tools that can be used to test a proxy's performance.

Maryia Stsiopkina

Maryia Stsiopkina

2021-08-13

5 min read

Free White Paper: How to Build a Successful Competitive Intelligence Process?

Download our free white paper and get all the information on competitive intelligence and how to solve the main issues that may arise when building competitive intelligence process in your organization.

Iveta Vistorskyte

Iveta Vistorskyte

2021-08-11

1 min read

How to Use cURL With Proxy

How to Use cURL With Proxy?

In this step-by-step guide, you will go through the basics of how to use cURL with proxy. Also, you will get bonus tips on smooth and easy proxy usage.

Iveta Vistorskyte

Iveta Vistorskyte

2021-08-09

6 min read

OxyCon Agenda Announced - How to Make the Most of It?

OxyCon 2021, a virtual two-day web scraping conference, has already attracted a lot of attention from industry leaders and the web scraping community. It’s time to reveal what engaging presentations and discussions are waiting for you on 25 and 26 August.

Adelina Kiskyte

Adelina Kiskyte

2021-08-06

2 min read

ML-Based Adaptive Parser Is Now In Production

Oxylabs is happy to announce that Adaptive Parser is now at full blast! With AI-powered Adaptive Parser, our clients can unlock structured data from any e-commerce page. Read more!

Maryia Stsiopkina

Maryia Stsiopkina

2021-07-23

2 min read

What is API (Application Programming Interface)?

In this article, you'll learn what exactly an API is and how an API works. Simply put, an API is a tool that delivers your request to the provider that you're requesting and then responds to you. Some websites (or apps) even provide APIs to give access for developers to receive specific data.

Iveta Vistorskyte

Iveta Vistorskyte

2021-07-19

6 min read

What Is Bot and How Does It Work?

Bots are everywhere and we hardly notice them: from malicious bots to so-called good bots. What is a bot? How do they work? How do websites detect bots? Read more in this article.

Vejune Tamuliunaite

Vejune Tamuliunaite

2021-07-13

5 min read

XPath vs CSS Selectors

Read this article to learn what XPath and CSS selectors are and how to create them. Find out the differences between XPath vs CSS, and know which option to choose.

Monika Maslauskaite

Monika Maslauskaite

2021-07-13

10 min read

The Driving Force of Search Engine Ad Intelligence

This article is intended to offer a 360-degree view of search engine ad intelligence: what it is and how to collect it using proxies alongside in-house web scrapers or ready-to-use tools.

Iveta Vistorskyte

Iveta Vistorskyte

2021-07-13

6 min read

Business Leads Scraper: What Do You Need To Know?

Building your tools to generate leads can be a lot more cost-efficient, and using web scraping is one of the most optimal ways to generate leads for your business. In this article, we'll go through the process of web scraping for lead generation and where to start.

Gabija Fatenaite

2021-07-13

3 min read

Proxy vs VPN

In this article, we will go over both Proxy and VPN terms, explore their similarities and differences in order to establish when one should be picked over another.

Vytautas Kirjazovas

Vytautas Kirjazovas

2021-07-13

6 min read

Free White Paper: Why Is Alternative Data Playing an Increasingly Larger Role in Financial Markets

Read why collecting alternative data is essential for applications in financial markets. Find out the main challenges while scraping alternative data and learn the solutions that can help make the best out of alternative data in the financial industry.

Monika Maslauskaite

Monika Maslauskaite

2021-07-09

1 min read

Sources of Competitive Intelligence and Best Practices

If you’re interested in learning everything about competitive intelligence, this article is for you. Read this article to understand what competitive intelligence is and learn more about competitive intelligence sources, its challenges, and best practices.

Iveta Vistorskyte

Iveta Vistorskyte

2021-07-09

6 min read

Reverse Proxy vs. Forward Proxy: The Differences

In this article, we explained what the main differences between forward and reverse proxies are. We also provided the prominent use cases of each proxy type.

Iveta Vistorskyte

Iveta Vistorskyte

2021-07-08

5 min read

Is Web Scraping Legal?

During OxyCon, Oxylabs' legal councils presented landmark scraping cases that set the tone for future scraping legal claims such as copyright, CFAA, etc. Learn how it affects scraping today and what web scraping legal issues can one encounter when scraping certain websites.

Gabija Fatenaite

2021-07-06

8 min read

Pagination In Web Scraping: How Challenging It May Be

Dealing with pagination in web scraping might be challenging and result in missing data. Learn about different approaches when scraping multiple pages.

Vejune Tamuliunaite

Vejune Tamuliunaite

2021-07-06

7 min read

What Is an IP Address?

What is an IP address? What are the main types of IP addresses? What are the challenges in IP management? Read this article and find out!

Vejune Tamuliunaite

Vejune Tamuliunaite

2021-07-04

8 min read

Concurrency vs Parallelism: The Main Differences

This article explains in depth what concurrency and parallelism are. We'll also use a practical example to explore the concepts even more and show how using concurrency and parallelism can help speed up the web scraping process.

Iveta Vistorskyte

Iveta Vistorskyte

2021-07-01

6 min read

Datacenter Proxies vs. Residential Proxies

A question might have arisen whilst scrolling through the infinite pools of proxy information - “what’s the difference between data center and residential proxies?” Well, this article aims to tackle this question. Let’s dive in.

Lukas Motiejunas

Lukas Motiejunas

2021-07-01

4 min read

Free White Paper: Alternative Data Brings Opportunities to The Financial Sector

Read how we, in cooperation with Censuswide, have surveyed senior data decision makers in the UK finance sector! Get all the details they shared on how alternative data is being used in their industry.

Adomas Sulcas

Adomas Sulcas

2021-06-29

1 min read

Oxylabs Webinar: Web Scraping for Business - Why Every Company Should Do It

Where to start with web scraping? What tools to choose? Get your questions answered by web scraping experts and watch a live demonstration of a powerful web scraper!

Vejune Tamuliunaite

Vejune Tamuliunaite

2021-06-23

2 min read

Manage Your Datacenter Proxies Via Datacenter Proxy API

From now on, you can access and manage your Datacenter Proxies via our Datacenter Proxy API! With it, you can replace your IPs from a specific subnet in your existing proxy list.

Gabija Fatenaite

2021-06-22

1 min read

Free Webinar: Why Ethically Sourced Proxies Should Be The Only Proxies

Join this webinar to learn why ethical proxy acquisition should be important to businesses that use proxy services as much as the services themselves.

Iveta Vistorskyte

Iveta Vistorskyte

2021-06-17

2 min read

What is Jupyter Notebook: Introduction

Find out what Jupyter Notebook is, its use cases, how to set it up, and whether it’s ideal for beginners. Importantly, this article discusses the application of Jupyter Notebook for web scraping.

Iveta Vistorskyte

Iveta Vistorskyte

2021-06-16

10 min read

OxyCon 2021: Web Scraping Conference You Don't Want To Miss

Save your seat at OxyCon 2021 on August 25–26, and join the discussion on the most relevant topics in the world of web scraping! The two-day virtual event will bring global business leaders and Oxylabs' experienced team together for in-depth, engaging talks and workshops.

Iveta Vistorskyte

Iveta Vistorskyte

2021-06-02

2 min read

What Is A Honeypot and How Does It Work?

A honeypot is a security system designed to attract malicious activity from cybercriminals. Read this article to understand how honeypot traps affect web scraping.

Iveta Vistorskyte

Iveta Vistorskyte

2021-06-01

5 min read

Residential Proxy Sourcing: Risks

Proxy-reliant companies have long been familiar with the benefits of residential proxies. However, very little is known about the risks of using unethical or even illegal proxies. Lack of knowledge on this matter is dangerous both for proxy network participants and companies using residential proxies. Read this article to learn more about proxy sourcing risks and how to avoid them.

Jurgita Tuzikaite

Jurgita Tuzikaite

2021-05-27

2 min read

Pricing Intelligence: Focus on Data-Driven Decision Making

If you are interested in starting to make data-driven decisions, this white paper is for you! Learn everything about pricing intelligence and how third-party data gathering solutions help you forget web scraping challenges.

Iveta Vistorskyte

Iveta Vistorskyte

2021-05-21

1 min read

Top News on Everything Data Gathering

Subscribe to our newsletter and get monthly scraping updates delivered right to your email.

No spam whatsoever, just pure data gathering news, trending topics and useful links. Unsubscribe anytime.

Scale up your business with Oxylabs®