Web Scraping With Java

In this article, you will learn how to use the Java programming language for web scraping and create a web scraper using this language.

Maryia Stsiopkina

2023-09-28

8 min read

Scrapy Playwright Tutorial: How to Scrape JavaScript Websites

Follow this in-depth tutorial for scraping dynamic websites with proxies and Scrapy Playwright.

Roberta Aukstikalnyte

2023-09-28

4 min read

24 Best Website Testing Tools To Use In 2024

Find out which is the best for you by reading this in-depth overview of top website testing tools and how they differ in usability and pricing.

Vytenis Kaubrė

2023-09-28

12 min read

Scraping Made Easy: Unlock the Full Potential of Scraper APIs

Watch Oxylabs webinar and learn valuable insights on simplifying your web scraping operations.

Enrika Pavlovskytė

2023-09-27

2 min read

Meet Us at the Travel Tech Asia Conference in Singapore!

Meet us at the Travel Tech Asia conference in Singapore on October 25-27 to see Oxylabs CSO Lauris Lietavieti deliver a C-Suite talk titled “Real-Time Public Data for Competitive Advantage in the Travel Industry.”

Maryia Stsiopkina

2023-09-27

1 min read

OxyCon 2023 On-Demand Is Live!

OxyCon 2023 is over but you can still watch all the valuable content on demand.

Enrika Pavlovskytė

2023-09-25

2 min read

The Role of Competitive Intelligence in Business Development

This free white paper provides a general overview of competitive intelligence processes, application scenarios, and their impact on business development.

Augustas Pelakauskas

2023-09-21

1 min read

OxyCon 2023: The Top Takeaways

If you couldn’t make it to the conference or want to experience the thrill again, let’s revisit its best moments in a brief event summary.

Maryia Stsiopkina

2023-09-15

5 min read

From Digital Marketing to Data Extraction: Navigating the Web Scraping Landscape

Alexander Lebedev, Software Engineer at Hotjar, shares his knowledge on web scraping, how to optimize for efficient data extraction, and what tools have served his journey extremely well, allowing the company to flourish.

Adomas Sulcas

2023-09-15

7 min read

How to Scrape Home Depot Data: Step-by-Step Guide

As results prove, pairing Python and Home Depot Scraper API is a seamless way to collect Home Depot data and avoid common web scraping-associated challenges.

Augustas Pelakauskas

2023-09-15

3 min read

14 Best Free and Paid Tools to Monitor Website Changes in 2024

Learn more about website change monitoring and discover the top 14 free and paid website change monitoring tools in 2024.

Enrika Pavlovskytė

2023-09-13

7 min read

Unlocking the Web with CapSolver: A Comprehensive Review

In this article, we comprehensively review a CapSolver, discuss this tool’s features, pricing, and use cases, and highlight what makes this tool different from other CAPTCHA-solving services.

Roberta Aukstikalnyte

2023-09-12

3 min read

How to Scrape YouTube Data: Step-by-Step Guide

Learn how to easily scrape YouTube videos and collect public video data, such as titles, descriptions, total subscribers, comments, and search results.

Vytenis Kaubrė

2023-09-12

5 min read

Melding Machine Learning with Web Scraping: Interview with Andrius Kūkšta

Andrius Kūkšta, Data Engineer at Oxylabs, shares his thoughts and experiences with integrating machine learning to web scraping solutions and showcases the power of AI for the industry.

Adomas Sulcas

2023-09-11

8 min read

Introducing Datasets: Your Fast Path to Data-Driven Insights

Learn more about Datasets - collections of fresh, ready-to-use data that streamline the entire data acquisition process and let you focus on data analysis rather than data gathering.

Yelyzaveta Nechytailo

2023-09-07

2 min read

Introducing Oxylabs Scraper APIs Playground: A New Way to Test Out Our Scraper API Solutions

We're excited to announce Scraper APIs Playrgound, a brand new way to test out our Scraper API solutions for free.

Danielius Radavicius

2023-09-05

2 min read

How to Scrape Yellow Pages Data With Python

Explore this in-depth, step-by-step technical tutorial to scrape Yellow Pages data with Python efficiently.

Maryia Stsiopkina

2023-09-04

3 min read

Oxylabs Establishes AI and ML Advisory Board

We are proud to have launched the AI & ML Advisory Board in 2020, consisting of four industry-leading data science, machine learning and AI experts to bolster Oxylabs’ influence in the data industry.

Vytautas Kirjazovas

2023-09-01

2 min read

2 Weeks Until OxyCon – Your Last Chance to Register!

As the 2-week countdown begins and excitement for OxyCon 2023 surges through the air, we’re here to invite you to book your free spot.

Yelyzaveta Nechytailo

2023-08-30

2 min read

How to Scrape Google Trends Data With Python

Learn step-by-step how to scrape Google Trends data using Python. Extract keywords, their popularity, breakdown by region, related queries, and more.

Augustas Pelakauskas

2023-08-30

4 min read

How Do PerimeterX Bypasses Work?

Learn about PerimeterX, how it works, and why bot traffic is still able to evade its defenses.

Vytenis Kaubrė

2023-08-25

7 min read

How to Scrape Wikipedia Data: Ultimate Tutorial

Learn how to retrieve publicly available data from Wikipedia pages with Python and Web Scraper API.

Roberta Aukstikalnyte

2023-08-25

4 min read

Join us at The Browser Conference on September 19, 2023!

Join The Browser Conference on the 19th of September, 2023 to see Oxylabs' Product Owner Aleksandras presentation "Large-Scale Web Data Collection Best Practices."

Roberta Aukstikalnyte

2023-08-16

1 min read

How to Bypass CAPTCHA With Playwright

Bypass CAPTCHAs with Playwright and Oxylabs’ Web Unblocker in Python. Crush web barriers, scrape freely, and automate successfully. Step-by-step tutorial.

Yelyzaveta Nechytailo

2023-08-14

4 min read

Continuous Scroll in Google Search: What It Is & How to Handle It in Web Scraping

Dynamic web pages like Google SERPs with continuous scroll require advanced web scraping solutions such as Oxylabs SERP Scraper API.

Augustas Pelakauskas

2023-08-10

2 min read

Web Scraping with Selenium and Python

Learn how the fundamentals of web scraping work by using Selenium, one of the better known tools for automating web browser interactions.

Gabija Fatenaite

2023-08-10

7 min read

Unleash Your Business Potential at DMEXCO!

Join Oxylabs at DMEXCO, Cologne and unleash untapped business potential for digital marketing.

Enrika Pavlovskytė

2023-08-08

2 min read

How to Scrape Google News: Step-by-Step Guide

Check out this straightforward, step-by-step guide on how to scrape Google News.

Danielius Radavicius

2023-08-07

3 min read

Scrapy Cloud: How to Use, Manage & Maximize Spider Execution

Check this article to learn more about web scraping with Scrapy Cloud: how it works, how to set it up, and if there are any alternatives.

Maryia Stsiopkina

2023-08-03

5 min read

Agenda is live, why attend OxyCon 2023!

This year's OxyCon has already garnered attention from every corner of the data gathering industry. Now is the time to reveal what's in store during our virtual event on September 13th.

Danielius Radavicius

2023-08-02

2 min read

Serverless Web Scraping with Scrapy and AWS Lambda

Explore serverless web scraping with Scrapy and AWS Lambda. Unleash the power of serverless computing and efficient web scraping to simplify data extraction.

Yelyzaveta Nechytailo

2023-08-02

5 min read

Free White Paper: Developing a Real Estate Data Monitoring Infrastructure

Discover how your real estate business can benefit from web scraping and learn how to build your own property data monitoring architecture.

Roberta Aukstikalnyte

2023-07-28

1 min read

How to Use ChatGPT for Web Scraping in 2024

ChatGPT web scraping is quickly gaining momentum. Let’s see how you can use ChatGPT to write code for web scraping, along with some tips and tricks.

Maryia Stsiopkina

2023-07-28

4 min read

Scrapy vs. Beautiful Soup: A Comparison of Web Scraping Tools

Delve deeper into the differences between Scrapy vs. Beautiful Soup and discover which one you need for your scraping project.

Enrika Pavlovskytė

2023-07-21

4 min read

Scrapy vs. Selenium: Which One is Better?

Find the ideal web scraping tool for your project by exploring the unique features and differences of Scrapy and Selenium.

Vytenis Kaubrė

2023-07-12

5 min read

Web Scraping Together: Unleash Community Benefits

If you're wondering how to stay up-to-date in the ever-changing world of web scraping, make valuable connections, and improve your tech expertise, check out this blog post about the benefits of web scraping communities.

Maryia Stsiopkina

2023-07-10

2 min read

How to Create and Upload a Sitemap: A Step-By-Step Guide

Learn what sitemaps are and discover effective solutions for creating them.

Enrika Pavlovskytė

2023-07-07

6 min read

Oxylabs Launches Custom Parser

We're excited to introduce a new feature of Scraper APIs, Custom Parser. Check this blog post to learn how it can facilitate your parsing jobs.

Maryia Stsiopkina

2023-07-03

1 min read

Why Do Some People Bypass Queue-It?

Queue-it systems are popular among numerous websites that deal with high traffic. Interestingly, some people try and bypass Queue-it, and we'll discuss why in this article.

Danielius Radavicius

2023-07-03

3 min read

Best No-Code Scrapers

Web scraping can get difficult but it doesn’t have to be with these no-code and low code web scrapers. Check out these no-code tools that could streamline your operations.

Enrika Pavlovskytė

2023-07-03

6 min read

5 Main Web Scraping Challenges & Solutions

Web scraping presents plenty of challenges. Thankfully, solutions are abundant with various data extraction libraries, proxies, custom approaches, and all-inclusive third-party services.

Augustas Pelakauskas

2023-06-30

6 min read

Asynchronous Web Scraping With Python & AIOHTTP

In this tutorial, we will focus on describing the asynchronous approach to scraping multiple URLs and by comparing it to the synchronous one, demonstrate why it can be more beneficial.

Yelyzaveta Nechytailo

2023-06-27

6 min read

How to Bypass CAPTCHA With Puppeteer

Check this technical tutorial to learn how to bypass CAPTCHA with Puppeteer and an advanced AI-based tool, Web Unblocker.

Maryia Stsiopkina

2023-06-22

4 min read

Choosing Between SOCKS vs HTTP Proxy

Choosing between a SOCKS vs HTTP proxy requires a thorough understanding of how each type works and what configurations they convey. Only then you will be able to efficiently juggle between different types of proxies and find the best option for your specific use case. Continue reading this article to learn more about SOCKS and HTTP proxies.

Vejune Tamuliunaite

2023-06-21

5 min read

Open-Source Intelligence to Boost Your Business: ESPY's Guide

Check this step-by-step guide where Oxylabs' affiliate partner ESPY shares how to leverage open-source intelligence to grow your business.

Maryia Stsiopkina

2023-06-20

2 min read

OxyCon 2023: Staying Ahead of the Game With Web Scraping

OxyCon is back for its fourth year with inspiring speakers and captivating presentations.

Enrika Pavlovskytė

2023-06-19

2 min read

How to Choose the Right Database for Storing Your Data

Read about the key differences between SQL and NoSQL databases and determine which type may be more relevant for your projects.

Danielius Radavicius

2023-06-15

7 min read

Scraping Experts: Building Real-Time E-Commerce Product Monitoring System in 5 Minutes

See the latest Scraping Experts video lesson for insights on product monitoring systems, including their importance, initial challenges, and effective solutions.

Vytenis Kaubrė

2023-06-13

2 min read