Free White Paper: Commercial Data as Alternative Data for Financial Industry

More and more data gets created every day, and asset management companies and hedge funds can leverage this data for analysis to reveal trends, patterns, and risks. However, traditional data has not been covering the needs of the competitive investment market. Meanwhile, alternative data enables investors to make better, informed predictions.

Adelina Kiskyte

2024-12-10

1 min read

Oxylabs’ Research on Fake Discounts: Are Shopping Events Worth the Deal?

Discover how Oxylabs’ advanced data collection infrastructure was leveraged to analyze the prevalence of fake discounts in major US marketplaces during Black Friday 2024. Explore key insights from this in-depth case study.

Vytautas Kirjazovas

2024-12-10

7 min read

What Is Fetch API in JavaScript? Definition, Use Cases, & Examples

A straightforward description of Fetch API in JavaScript and its use cases. Learn how it simplifies HTTP requests, enhances data retrieval, and benefits from proxies for secure, efficient access.

Yelyzaveta Hayrapetyan

2024-12-09

3 min read

How to Make HTTP Requests in Node.js With Fetch API

A step-by-step tutorial on making HTTP requests in Node.js with Fetch API, detailing the actionable code and a comparison to Axios.

Augustas Pelakauskas

2024-12-09

6 min read

Project 4β Partners with The Pulitzer Center

Oxylabs' pro bono initiative "Project 4β" partners with The Pulitzer Center, a renowned non-profit organization known for advancing in-depth, high-impact journalism on underreported global issues.

Gabija Birgile

2024-12-05

1 min read

What is Playwright? Tutorial, Use Cases, Definition

Learn what Playwright is, how to set up tests, and integrate proxies in our comprehensive guide to enhance your end-to-end testing strategy

Akvilė Lūžaitė

2024-12-03

6 min read

Serverless Web Scraping with Scrapy and AWS Lambda

Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.

Yelyzaveta Hayrapetyan

2024-11-28

6 min read

Guide to Handling Python Requests Timeout

Learn how to manage Python requests timeout errors for smooth network operations. See comprehensive code samples and discover best practices.

Vytenis Kaubrė

2024-11-19

6 min read

Free White Paper: Acquiring High-Quality Web Data for LLM Fine-Tuning

Get a free, in-depth guide on data acquisition processes for LLM fine-tuning. Discover data categories, large-scale scraping strategies, and cost optimization tips for fine-tuning your AI models.

Dovydas Vėsa

2024-11-19

1 min read

Free Datacenter Proxies Quick Start Guide

Claim your free Datacenter Proxies and set them up for your projects by following this quick guide.

Vytenis Kaubrė

2024-11-19

3 min read

What is cURL Command and How to Use It?

Discover the power of cURL. Learn how this versatile command-line tool simplifies data transfers, API testing, and more for developers and system admins.

Yelyzaveta Hayrapetyan

2024-11-18

4 min read

Building a Competitor Intelligence System for E-Commerce

The primary focus of the white paper is to provide an action chain for a competitor intelligence system, from data collection to parsing, with various tips, guidelines, and explanations of the most critical processes.

Danielius Radavicius

2024-11-15

1 min read

How to Scrape Google Hotels: Python Tutorial

Learn how to scrape Google Hotels data using Python. This step-by-step tutorial covers Selenium, BeautifulSoup, and CSV output to extract prices, ratings, and locations.

Maryia Stsiopkina

2024-11-15

5 min read

What is a Rotating IP Address and How to Rotate it?

Rotating IP addresses is a widely used practice where assigned IP addresses are distributed to a device at random or at scheduled intervals. Learn more about rotating IP addresses and how it can benefit you and your business when web scraping.

Lukas Motiejunas

2024-11-07

5 min read

Free White Paper: The Ultimate Guide on Web Scraping for Brand Protection

Nowadays, public data is an answer to many issues, fighting with brand infringements online as well. Web scraping helps to monitor the web and search for the violations in terms of brand protection to fight against them. This article explains the key insights of successful web scraping for brand protection.

Iveta Liupševičė

2024-11-06

1 min read

How to Rotate Proxies in Python: Building a Rotating Proxy Scraper with Requests and AIOHTTP

Learn to rotate proxies in Python using sync and async methods. See how to use Requests and AIOHTTP combined with Asyncio libraries to rotate a proxy list.

Dovydas Vėsa

2024-11-06

6 min read

Scalable Web Data Extraction With a Single Tool for Any Website

An overview of self-managed proxies versus an all-in-one proxy solution for extracting data on a large scale from any website, even the most complex one.

Vytenis Kaubrė

2024-11-05

1 min read

How to Achieve Cost-Effective and Scalable Web Scraping for Product Listings

This white paper explores the benefits of web scraping for e-commerce product listings and guides companies in choosing between developing an in-house scraper or opting for a third-party solution.

Adomas Sulcas

2024-11-04

1 min read

How Scraped Data Can Help Train LLMs and AI Tools

Watch our new webinar to learn how high-quality scraped data fuels LLMs and AI tools. Expert insights, challenges, and live demos await!

Maryia Stsiopkina

2024-11-04

1 min read

How To Scrape Amazon ASIN with Python

Learn what Amazon ASIN is and how to build a fast and scalable Amazon ASIN scraper. See code samples for creating a custom ASIN scraper and using a maintenance-free API.

Vytenis Kaubrė

2024-10-29

6 min read

What is Dynamic Pricing?

Dynamic pricing is not a new concept but in the competitive online market, it is more relevant than ever. Find out what is dynamic pricing strategy, what companies use it, and learn about the benefits and challenges of real time pricing.

Adelina Kiskyte

2024-10-25

4 min read

How to Scrape Google People Also Ask: Python Tutorial

Learn how to scrape Google's People Also Ask (PAA) with Python. Gather valuable SEO data using BeautifulSoup and store insights for content strategy optimization.

Maryia Stsiopkina

2024-10-23

3 min read

Introducing Oxy Parser, an Open-Source Data Parsing Tool

Oxy Parser is an open-source data parsing tool that automates HTML structurization using Pydantic models and automated XPaths.

Augustas Pelakauskas

2024-10-15

2 min read

How To Scrape Amazon Best Sellers: Python tutorial

The Amazon Best Sellers sites are product pages that can help retailers perform market research by providing information on what's selling the best and can act like a guide for what products to stock in your own store. However, Amazon, among other big sites, have mechanisms in place that make it a challenge to access this publicly available data.

Akvilė Lūžaitė

2024-10-14

8 min read

What Is Parsing of Data?

In this article we’ll dig a little deeper on what is data parsing, and discuss whether building an in-house data parser is more beneficial to a business, or is it better to outsource a data parser.

Gabija Fatėnaitė

2024-10-04

6 min read

Web Crawler vs Web Scraper: The Differences

Data scraping has become the ultimate tool for business development with a significant influence in nearly any business area. With this article, we're covering the intricacies of data scraping in greater detail.

Gabija Fatėnaitė

2024-10-04

6 min read

How to Bypass CAPTCHA in Web Scraping Using Python

If CAPTCHAs keep on interrupting your day-to-day scraping tasks, read this article presenting solutions that can help you go around them successfully.

Yelyzaveta Hayrapetyan

2024-10-03

7 min read

OxyCon® 2024 On-Demand Videos Are Live!

Access the full range of expert talks from OxyCon 2024 at your convenience, anytime and anywhere.

Akvilė Lūžaitė

2024-10-01

2 min read

LLM Training Data: The 8 Main Public Data Sources

Find out the most beneficial public data sources you can web scrape for LLM training and fine-tuning. Moreover, get a general overview of LLM training data and training processes.

Vytenis Kaubrė

2024-09-27

5 min read

OxyCon® 2024: The Top Takeaways

We, the Oxylabs team, thank you for your enthusiasm in attending, watching, and asking so many questions. Whether you missed the live event or want to refresh your memory, here you’ll find highlights from each topic.

Augustas Pelakauskas

2024-09-26

6 min read

Enhance Your Data Workflow: All-In-One Web Scraper API and OxyCopilot

Today marks a major milestone for both Oxylabs and the web scraping industry: the launch of our unified Web Scraper API, now enhanced with the OxyCopilot feature.

Maryia Stsiopkina

2024-09-25

3 min read

Free White Paper: Guide to Threat Intelligence Data Acquisition

A general overview of threat intelligence processes, emphasizing web data collection to acquire material for threat analysis and risk assessment.

Iveta Liupševičė

2024-09-23

1 min read

Pagination In Web Scraping: How Challenging It May Be

Dealing with pagination in web scraping might be challenging and result in missing data. Learn about different approaches when scraping multiple pages.

Akvilė Lūžaitė

2024-09-11

7 min read

Hurry! Just 2 Weeks Left to Register for OxyCon® 2024!

With just two weeks to go, now is the perfect time to secure your spot at OxyCon 2024!

Maryia Stsiopkina

2024-09-10

2 min read

How to Scrape Google Lens Results: Python Tutorial

Learn how to scrape Google Lens Results in Python with Oxylabs' Google Lens API. Find out how to set up the API, get structured data, and save it into a JSON file.

Vytenis Kaubrė

2024-09-10

2 min read

Block-Free Web Scraping: A Comprehensive Guide

The basics of avoiding blocks when web scraping: things to know before starting, actions to implement when scraping, and the complexities of anti-bot detection.

Augustas Pelakauskas

2024-08-30

1 min read

How to Web Scrape HTML Tables With Python: Step-by-Step

Learn to scrape and parse HTML tables in Python using three real table examples. This article covers the basics and the more advanced concepts.

Vytenis Kaubrė

2024-08-23

6 min read

Web Scraping SDK: Definition and Benefits at a Glance

Learn about Software Development Kits (SDKs) and their role in web scraping. Discover the main benefits of SDKs over APIs and see a code comparison of Oxylabs Python SDK vs. Oxylabs API.

Vytenis Kaubrė

2024-08-14

5 min read

Project 4beta Partners with Northwestern University Researchers to Explore Digital Redlining

"Project 4β" partners with researchers from Northwestern University to provides free access to Oxylabs' web intelligence collection solutions to investigate the phenomenon of digital redlining.

Gabija Birgile

2024-08-13

2 min read

Leveraging Web Scraping for Economic Research: A Collaboration with Researcher from Aston University

Oxylabs' pro bono initiative "Project 4β" partners with Dr. Ngoc Dieu Linh Vi, a lecturer in Economics at Aston University to provide free access to Oxylabs web scraping solutions.

Gabija Birgile

2024-08-12

2 min read

Don't Miss Out: OxyCon® 2024 Agenda Unveiled!

This year's OxyCon has captured the attention of the entire data gathering industry. The time has come to unveil what we have planned for our virtual event on September 25th.

Maryia Stsiopkina

2024-08-07

2 min read

Datacenter Proxies Quick Start Guide

Keen to find out all things about Oxylabs Datacenter Proxies? You’ve come to the right place. This quick start guide will provide all the information you need to get up and running. Let’s get started!

Augustas Pelakauskas

2024-07-31

4 min read

How to Read JSON Files in JavaScript: Tutorial

Find out how to load and read JSON files using JavaScript with practical code samples. Discover common errors, use cases, and advanced tips for your next project.

Vytenis Kaubrė

2024-07-26

5 min read

LLM Web Scraping: Integrate Assistants API with Scraped Data

Learn to develop AI-based assistants that use real-time website data to answer questions. Find out about the Assistants API and LLM web scraping for successful AI projects.

Vytenis Kaubrė

2024-07-24

6 min read

Web Scraping With Cheerio and Node.js: Step-by-Step Guide

Learn to scrape websites with Cheerio and Axios in Node.js. This guide covers setup, extracting data, and caching for efficient web scraping.

Maryia Stsiopkina

2024-07-23

5 min read

How to Find Proxy Server Address

Learn step-by-step instructions on finding a proxy server IP address on different browsers and mobile devices to enhance your online privacy and security.

Yelyzaveta Hayrapetyan

2024-07-16

3 min read

What are HTTP Headers: Examples and Most Common Types

In this article we will define HTTP headers, and discuss their purpose. What’s more, we will cover why using and optimizing HTTP headers are essential when web scraping.

Mantas Miksenas

2024-07-10

7 min read

Fingerprinting Tactics with Pyppeteer and Playwright

Make sure to secure a slot in your calendar on July 10, 2024, to join us for a value-packed webinar hosted by Paulius Stundžia, Senior Developer at Oxylabs.

Maryia Stsiopkina

2024-06-26

1 min read

How to Find Elements With Selenium in Python

Learn about the most effective techniques for finding elements using Selenium.

Enrika Pavlovskytė

2024-06-21

5 min read

Wget vs cURL for Downloading Files in Linux

Learn about the differences between cURL and Wget in terms of structure, use cases, functionalities, and more.

Enrika Pavlovskytė

2024-06-21

4 min read