Back to blog
Project 4β Partners with Stanford University Researcher
Oxylabs' pro bono initiative, Project 4β, has partnered with Olivia Martin, a PhD student in Economics at Stanford University's School of Humanities and Sciences to enhance research with data collection solutions.
Gabija Birgile
2024-12-12
2 min read
How to Change My IP Address with Proxies
Learn simple ways to change your IP address, including using proxy servers, and compare the different methods of masking your IP address.
Akvilė Lūžaitė
2024-12-12
7 min read
Oxylabs’ Research on Fake Discounts: Are Shopping Events Worth the Deal?
Discover how Oxylabs’ advanced data collection infrastructure was leveraged to analyze the prevalence of fake discounts in major US marketplaces during Black Friday 2024. Explore key insights from this in-depth case study.
Vytautas Kirjazovas
2024-12-10
7 min read
Web Scraping on a Large Scale for E-Commerce (Ultimate Guide)
This white paper aims to guide you through the process of large-scale data gathering with an emphasis on e-commerce.
Gabija Fatenaite
2024-12-10
1 min read
Free White Paper: Commercial Data as Alternative Data for Financial Industry
More and more data gets created every day, and asset management companies and hedge funds can leverage this data for analysis to reveal trends, patterns, and risks. However, traditional data has not been covering the needs of the competitive investment market. Meanwhile, alternative data enables investors to make better, informed predictions.
Adelina Kiskyte
2024-12-10
1 min read
Carnegie Mellon University Researcher Joins Project 4β
Oxylabs' pro bono initiative, Project 4β, has partnered with Liying Qiu, a PhD student in Business Technologies at Carnegie Mellon University's Tepper School of Business to advance research with data collection solutions.
Gabija Birgile
2024-12-10
1 min read
What Is Fetch API in JavaScript? Definition, Use Cases, & Examples
A straightforward description of Fetch API in JavaScript and its use cases. Learn how it simplifies HTTP requests, enhances data retrieval, and benefits from proxies for secure, efficient access.
Yelyzaveta Nechytailo
2024-12-09
3 min read
How to Make HTTP Requests in Node.js With Fetch API
A step-by-step tutorial on making HTTP requests in Node.js with Fetch API, detailing the actionable code and a comparison to Axios.
Augustas Pelakauskas
2024-12-09
6 min read
How to Use a SOCKS5 Proxy Server
Discover how SOCKS5 proxy servers enhance privacy, bypass restrictions, and improve performance. Get setup guides, use cases, and key benefits explained.
Maryia Stsiopkina
2024-12-05
6 min read
Project 4β Partners with The Pulitzer Center
Oxylabs' pro bono initiative "Project 4β" partners with The Pulitzer Center, a renowned non-profit organization known for advancing in-depth, high-impact journalism on underreported global issues.
Gabija Birgile
2024-12-05
1 min read
What is Playwright? Tutorial, Use Cases, Definition
Learn what Playwright is, how to set up tests, and integrate proxies in our comprehensive guide to enhance your end-to-end testing strategy
Akvilė Lūžaitė
2024-12-03
6 min read
Serverless Web Scraping with Scrapy and AWS Lambda
Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.
Yelyzaveta Nechytailo
2024-11-28
6 min read
10 Best Rotating Proxy Service for Data Scraping in 2024
Explore the 10 best rotating proxies for data scraping in 2024 – reliable IP rotation, geo-targeting, and seamless access to bypass blocks and CAPTCHAs effortlessly.
Yelyzaveta Nechytailo
2024-11-20
10 min read
Guide to Handling Python Requests Timeout
Learn how to manage Python requests timeout errors for smooth network operations. See comprehensive code samples and discover best practices.
Vytenis Kaubrė
2024-11-19
6 min read
Free Whitepaper: Acquiring High-Quality Web Data for LLM Fine-Tuning
Get a free, in-depth guide on data acquisition processes for LLM fine-tuning. Discover data categories, large-scale scraping strategies, and cost optimization tips for fine-tuning your AI models.
Roberta Aukstikalnyte
2024-11-19
1 min read
Web Scraping With LangChain & Oxylabs API
Find out how you can set up a Python requests retry strategy using libraries and custom functions. See code examples for configuring proxies when retrying failed requests.
Roberta Aukstikalnyte
2024-11-19
4 min read
What is cURL Command and How to Use It?
Discover the power of cURL. Learn how this versatile command-line tool simplifies data transfers, API testing, and more for developers and system admins.
Yelyzaveta Nechytailo
2024-11-18
3 min read
How to Scrape Google Hotels: Python Tutorial
Learn how to scrape Google Hotels data using Python. This step-by-step tutorial covers Selenium, BeautifulSoup, and CSV output to extract prices, ratings, and locations.
Maryia Stsiopkina
2024-11-15
5 min read
Building a Competitor Intelligence System for E-Commerce
The primary focus of the white paper is to provide an action chain for a competitor intelligence system, from data collection to parsing, with various tips, guidelines, and explanations of the most critical processes.
Danielius Radavicius
2024-11-15
1 min read
Free White Paper: Addressing the Main Challenges of Public Web Data Gathering
New research conducted by Oxylabs in partnership with Censuswide has surveyed scraping professionals to uncover the key issues they face when gathering public web data and the role of artificial intelligence (AI) in addressing them.
Gabija Birgile
2024-11-11
2 min read
What is a Rotating IP Address and How to Rotate it?
Rotating IP addresses is a widely used practice where assigned IP addresses are distributed to a device at random or at scheduled intervals. Learn more about rotating IP addresses and how it can benefit you and your business when web scraping.
Lukas Motiejunas
2024-11-07
5 min read
Free White Paper: The Ultimate Guide on Web Scraping for Brand Protection
Nowadays, public data is an answer to many issues, fighting with brand infringements online as well. Web scraping helps to monitor the web and search for the violations in terms of brand protection to fight against them. This article explains the key insights of successful web scraping for brand protection.
Iveta Vistorskyte
2024-11-06
1 min read
How to Rotate Proxies in Python Using Requests and AIOHTTP
Learn to rotate proxies in Python using sync and async methods. See how to use Requests and AIOHTTP combined with Asyncio libraries to rotate a proxy list.
Roberta Aukstikalnyte
2024-11-06
6 min read
Scalable Web Data Extraction With a Single Tool for Any Website
An overview of self-managed proxies versus an all-in-one proxy solution for extracting data on a large scale from any website, even the most complex one.
Vytenis Kaubrė
2024-11-05
1 min read
5 Best SERP APIs for Real-Time Data
Find out the market's most reliable SERP API providers and learn why Google SERP scraping would be beneficial for your business.
Akvilė Lūžaitė
2024-11-05
7 min read
How to Achieve Cost-Effective and Scalable Web Scraping for Product Listings
This white paper explores the benefits of web scraping for e-commerce product listings and guides companies in choosing between developing an in-house scraper or opting for a third-party solution.
Adomas Sulcas
2024-11-04
1 min read
How Scraped Data Can Help Train LLMs and AI Tools
Watch our new webinar to learn how high-quality scraped data fuels LLMs and AI tools. Expert insights, challenges, and live demos await!
Maryia Stsiopkina
2024-11-04
1 min read
Web Scraping in JavaScript With Node.js & Puppeteer
Learn practical web scraping techniques using JavaScript and Node.js. Discover popular libraries, best practices, and effective methods using Cheerio, Axios, & Puppeteer.
Adelina Kiskyte
2024-10-29
10 min read
How To Scrape Amazon ASIN with Python
Learn what Amazon ASIN is and how to build a fast and scalable Amazon ASIN scraper. See code samples for creating a custom ASIN scraper and using a maintenance-free API.
Vytenis Kaubrė
2024-10-29
6 min read
Dynamic pricing is not a new concept but in the competitive online market, it is more relevant than ever. Find out what is dynamic pricing strategy, what companies use it, and learn about the benefits and challenges of real time pricing.
Adelina Kiskyte
2024-10-25
4 min read
How to Scrape Google People Also Ask: Python Tutorial
Learn how to scrape Google's People Also Ask (PAA) with Python. Gather valuable SEO data using BeautifulSoup and store insights for content strategy optimization.
Maryia Stsiopkina
2024-10-23
3 min read
5 Best Web Scraping APIs for Data Gathering
Discover the 5 best scraping APIs for efficient data gathering, including Oxylabs, Smartproxy, Rayobyte, Zyte, and ScrapingBee. Find the right solution!
Maryia Stsiopkina
2024-10-21
13 min read
Introducing Oxy Parser, an Open-Source Data Parsing Tool
Oxy Parser is an open-source data parsing tool that automates HTML structurization using Pydantic models and automated XPaths.
Augustas Pelakauskas
2024-10-15
2 min read
How To Scrape Amazon Best Sellers: Python tutorial
The Amazon Best Sellers sites are product pages that can help retailers perform market research by providing information on what's selling the best and can act like a guide for what products to stock in your own store. However, Amazon, among other big sites, have mechanisms in place that make it a challenge to access this publicly available data.
Akvilė Lūžaitė
2024-10-14
8 min read
How to Bypass CAPTCHA With Playwright
Bypass CAPTCHAs with Playwright and Oxylabs’ Web Unblocker in Python. Crush web barriers, scrape freely, and automate successfully. Step-by-step tutorial.
Yelyzaveta Nechytailo
2024-10-11
5 min read
How to Hide My IP Address in 2024: 5 Easy Ways
This article aims to broaden one’s knowledge of what an IP address can reveal, and how to hide an IP address. Also, we discuss whether an online business hide their IP address.
Lukas Motiejunas
2024-10-11
7 min read
What is Web Scraping & How to Scrape Data from a Website?
The concept of web scraping is becoming familiar to every modern company aiming to base its decisions on data. This article will explain web scraping and how to effectively incorporate it into your business.
Iveta Vistorskyte
2024-10-09
8 min read
Web Crawler vs Web Scraper: The Differences
Data scraping has become the ultimate tool for business development with a significant influence in nearly any business area. With this article, we're covering the intricacies of data scraping in greater detail.
Gabija Fatenaite
2024-10-04
6 min read
In this article we’ll dig a little deeper on what is data parsing, and discuss whether building an in-house data parser is more beneficial to a business, or is it better to outsource a data parser.
Gabija Fatenaite
2024-10-04
6 min read
The Best Antidetect Browsers of 2024
Learn how an antidetect browser helps with using several accounts for various digital initiatives.
Roberta Aukstikalnyte
2024-10-03
12 min read
How to Bypass CAPTCHA in Web Scraping Using Python
If CAPTCHAs keep on interrupting your day-to-day scraping tasks, read this article presenting solutions that can help you go around them successfully.
Yelyzaveta Nechytailo
2024-10-03
7 min read
OxyCon 2024 On-Demand Videos Are Live!
Access the full range of expert talks from OxyCon 2024 at your convenience, anytime and anywhere.
Akvilė Lūžaitė
2024-10-01
2 min read
LLM Training Data: The 8 Main Public Data Sources
Find out the most beneficial public data sources you can web scrape for LLM training and fine-tuning. Moreover, get a general overview of LLM training data and training processes.
Vytenis Kaubrė
2024-09-27
5 min read
10 Best Proxy Providers in 2024
See a short overview of the market's most reliable proxy providers and find out what criteria to consider before making the final choice.
Yelyzaveta Nechytailo
2024-09-27
9 min read
OxyCon 2024: The Top Takeaways
We, the Oxylabs team, thank you for your enthusiasm in attending, watching, and asking so many questions. Whether you missed the live event or want to refresh your memory, here you’ll find highlights from each topic.
Augustas Pelakauskas
2024-09-26
6 min read
How to Scrape Google Maps Using Python
See this extensive guide on how to scrape Google Maps with an Oxylabs solution.
Danielius Radavicius
2024-09-25
6 min read
Enhance Your Data Workflow: All-In-One Web Scraper API and OxyCopilot
Today marks a major milestone for both Oxylabs and the web scraping industry: the launch of our unified Web Scraper API, now enhanced with the OxyCopilot feature.
Maryia Stsiopkina
2024-09-25
3 min read
Web Scraper API Quick Start Guide
In this quick start guide, we introduce Web Scraper API and explain how it works. Explore integration methods, queries, their parameters, and response codes.
Augustas Pelakauskas
2024-09-25
4 min read
Free White Paper: Guide to Threat Intelligence Data Acquisition
A general overview of threat intelligence processes, emphasizing web data collection to acquire material for threat analysis and risk assessment.
Iveta Vistorskyte
2024-09-23
1 min read
10 Best Datacenter Proxy Providers for Data Scraping
An overview of some of the best datacenter proxy providers, covering the main criteria relevant to all users, to help understand market positionings when choosing a proxy solution.
Augustas Pelakauskas
2024-09-13
6 min read
Scale up your business with Oxylabs®