Back to blog
Join us at The Browser Conference on September 19, 2023!
Join The Browser Conference on the 19th of September, 2023 to see Oxylabs' Product Owner Aleksandras presentation "Large-Scale Web Data Collection Best Practices."
Roberta Aukstikalnyte
2023-08-16
1 min read
Continuous Scroll in Google Search: What It Is & How to Handle It in Web Scraping
Dynamic web pages like Google SERPs with continuous scroll require advanced web scraping solutions such as Oxylabs Web Scraper API.
Augustas Pelakauskas
2023-08-10
2 min read
Unleash Your Business Potential at DMEXCO!
Join Oxylabs at DMEXCO, Cologne and unleash untapped business potential for digital marketing.
Enrika Pavlovskytė
2023-08-08
2 min read
Scrapy Cloud: How to Use, Manage & Maximize Spider Execution
Check this article to learn more about web scraping with Scrapy Cloud: how it works, how to set it up, and if there are any alternatives.
Maryia Stsiopkina
2023-08-03
5 min read
Agenda is live, why attend OxyCon 2023!
This year's OxyCon has already garnered attention from every corner of the data gathering industry. Now is the time to reveal what's in store during our virtual event on September 13th.
Danielius Radavicius
2023-08-02
2 min read
Free White Paper: Developing a Real Estate Data Monitoring Infrastructure
Discover how your real estate business can benefit from web scraping and learn how to build your own property data monitoring architecture.
Roberta Aukstikalnyte
2023-07-28
1 min read
How to Use ChatGPT for Web Scraping in 2024
ChatGPT web scraping is quickly gaining momentum. Let’s see how you can use ChatGPT to write code for web scraping, along with some tips and tricks.
Maryia Stsiopkina
2023-07-28
5 min read
Scrapy vs. Beautiful Soup: A Comparison of Web Scraping Tools
Delve deeper into the differences between Scrapy vs. Beautiful Soup and discover which one you need for your scraping project.
Enrika Pavlovskytė
2023-07-21
4 min read
Scrapy vs. Selenium: Which One is Better?
Find the ideal web scraping tool for your project by exploring the unique features and differences of Scrapy and Selenium.
Vytenis Kaubrė
2023-07-12
5 min read
Web Scraping Together: Unleash Community Benefits
If you're wondering how to stay up-to-date in the ever-changing world of web scraping, make valuable connections, and improve your tech expertise, check out this blog post about the benefits of web scraping communities.
Maryia Stsiopkina
2023-07-10
2 min read
How to Create and Upload a Sitemap: A Step-By-Step Guide
Learn what sitemaps are and discover effective solutions for creating them.
Enrika Pavlovskytė
2023-07-07
6 min read
Oxylabs Launches Custom Parser
We're excited to introduce a new feature of a Web Scraper API, Custom Parser. Check this blog post to learn how it can facilitate your parsing jobs.
Maryia Stsiopkina
2023-07-03
1 min read
Why Do Some People Bypass Queue-It?
Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.
Danielius Radavicius
2023-07-03
3 min read
5 Main Web Scraping Challenges & Solutions
Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.
Augustas Pelakauskas
2023-06-30
6 min read
Asynchronous Web Scraping With Python & AIOHTTP
In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.
Yelyzaveta Nechytailo
2023-06-27
6 min read
How to Bypass CAPTCHA With Puppeteer
Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.
Maryia Stsiopkina
2023-06-22
4 min read
Choosing Between SOCKS vs HTTP Proxy
Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.
Vejune Tamuliunaite
2023-06-21
5 min read
Open-Source Intelligence to Boost Your Business: ESPY's Guide
Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.
Maryia Stsiopkina
2023-06-20
2 min read
OxyCon 2023: Staying Ahead of the Game With Web Scraping
OxyCon is back for its fourth year with inspiring speakers and captivating presentations.
Enrika Pavlovskytė
2023-06-19
2 min read
How to Choose the Right Database for Storing Your Data
Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.
Danielius Radavicius
2023-06-15
7 min read
Scraping Experts: Building Real-Time E-Commerce Product Monitoring System in 5 Minutes
See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.
Vytenis Kaubrė
2023-06-13
2 min read
How to Send POST Requests With cURL
cURL is a lightweight yet powerful tool for sending POST requests from CLI. Read this tutorial for detailed instructions on sending POST requests with cURL.
Yelyzaveta Nechytailo
2023-06-09
3 min read
How to Send GET Requests With cURL
Read this article to learn sending simple cURL GET requests or with parameters effortlessly. Find out how to retrieve JSON data and the main request arguments.
Iveta Vistorskyte
2023-06-09
4 min read
Don't miss the chance to meet us at the Travel Tech Show
Join Oxylabs at Travel Tech Show, London, to discover the latest travel industry trends and innovations as well as connect with industry experts.
Iveta Vistorskyte
2023-06-08
2 min read
Beautiful Soup Tutorial - How to Parse Web Data With Python
Even if you've never heard of it, this tutorial will help you learn the basics of parsing data with Beautiful Soup.
Adomas Sulcas
2023-06-06
9 min read
Check this step-by-step tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.
Maryia Stsiopkina
2023-06-02
6 min read
Using Real-Time Public Data for Competitive Advantage in Travel Industry
An action chain of processes and solutions for public web data collection in the travel industry.
Augustas Pelakauskas
2023-06-02
1 min read
Mobile Proxies are Now in Self-Service!
Get Oxylabs Mobile Proxies in a hassle-free way and access new payment plans that fit your needs!
Danielius Radavicius
2023-05-31
3 min read
Oxylabs Webinar: AI and Web Scraping - The Unstoppable Duo for Web Data Collection
Watch Oxylabs Webinar and find out how AI is becoming an essential part of web scraping.
Danielius Radavicius
2023-05-31
2 min read
Mobile Proxies Quick Start Guide
Kickstart your journey with this Mobile Proxies guide. Learn about the features, pricing plans, query formation, and much more.
Vytenis Kaubrė
2023-05-31
3 min read
How to Send HTTP Headers With cURL
This guide covers various aspects of sending and receiving HTTP headers using cURL. The content discloses tips for use cases and discusses troubleshooting cURL header issues.
Augustas Pelakauskas
2023-05-25
5 min read
“Project 4β” Teams Up with a Nonprofit #SRNT
"4β" established a new partnership with #SRNT - a nonprofit Crisis Aide platform, that aims to can provide real-time support and assistance for individuals facing difficult life situations.
Gabija Birgile
2023-05-24
2 min read
Python Cache: How to Speed Up Your Code with Effective Caching
Discover the functionalities of caching in Python and see how you can speed up large-scale web scraping tasks.
Vytenis Kaubrė
2023-05-17
9 min read
Follow this detailed tutorial and learn how to combine cURL with Python for effective data transfer processes.
Roberta Aukstikalnyte
2023-05-17
4 min read
A detailed yet clear step-by-step tutorial on using cURL with REST API. Check it out and implement the gathered insights to future projects.
Yelyzaveta Nechytailo
2023-05-16
4 min read
"Project 4β" Partners With Debunk.org to Counter Disinformation
The partnership between "Project 4β"and Debunk.org will provide the organization with Oxylabs' cutting-edge web scraping technology and expertise to combat false information online on a pro-bono basis.
Gabija Birgile
2023-05-10
2 min read
Oxylabs Webinar: Driving E-Commerce Success Through Pricing Data - Are You Getting It Right?
Watch Oxylabs webinar on-demand to make sure you get all the needed insights to step into the e-commerce data collection confidently.
Yelyzaveta Nechytailo
2023-05-10
2 min read
Python Syntax Errors: Common Mistakes and How to Fix Them
Learn how to understand, avoid, and solve Python syntax errors by following this in-depth guide.
Vytenis Kaubrė
2023-05-08
9 min read
What Are Web Snapshots and How Do They Work?
Explore web page snapshots, their functionalities, benefits, and various use cases.
Enrika Pavlovskytė
2023-05-05
4 min read
Proxy Lists: What Are They and How Do They Work?
Discover the most popular types of proxy lists available and choose which one fits your scraping needs best.
Yelyzaveta Nechytailo
2023-05-04
4 min read
Join Oxylabs at the heart of Silicon Valley for countless learning and networking opportunities at AI & Big Data Expo in Santa Clara.
Enrika Pavlovskytė
2023-05-04
2 min read
Best Integration Methods Inside Out
Need help deciding what integration method to use? Check this article to learn about primary Web Scraper API integration methods, their key advantages, and some helpful tips.
Maryia Stsiopkina
2023-05-02
5 min read
What Is Data as a Service (DaaS) & How It Helps
Learn what Data as a Service (DaaS) is, how it works, what role it plays in business development, and what to consider when choosing your own DaaS provider.
Augustas Pelakauskas
2023-04-28
5 min read
Scrapy Splash Tutorial: How to Scrape JavaScript-Rendered Websites
An extensive Scrapy Splash tutorial on scraping public web data from JavaScript-rendered websites.
Roberta Aukstikalnyte
2023-04-25
5 min read
Structured vs. Unstructured Data: Definition, Characteristics, and Comparison
Read our in-depth guide, where we compare structured and unstructured data, identifying each types’ pros, cons, use cases, and more.
Roberta Aukstikalnyte
2023-04-13
5 min read
Python Requests Library: 2024 Guide
Check out our newest Python tutorial where we outline how to use the Requests library. Get some easy -o-use tips for GET and POST methods.
Adomas Sulcas
2023-04-06
11 min read
Web Unblocker Quick Start Guide
Discover the essentials of Web Unblocker and learn how to get started with it.
Vytenis Kaubrė
2023-04-06
2 min read
Oxylabs’ Web Scraper API and Web Unblocker Are Now in Self-Service!
Get access to Oxylabs’ top products using a quick self-checkout process – request and start using in just a few clicks!
Yelyzaveta Nechytailo
2023-04-06
3 min read
Crawlee Tutorial: Easy Web Scraping and Browser Automation
This article covers everything you need to get started with Crawlee. Learn more about its benefits and see a working example of scraping a website with Crawlee.
Yelyzaveta Nechytailo
2023-04-04
6 min read
Scale up your business with Oxylabs®