Pay only per successfully delivered results
Noticeably fewer CAPTCHAs and IP blocks
Accurate and timely data
Regardless of where you are, access data localized in almost any place on earth. Web Scraper API allows you to gather localized search results from 195 countries.
No need to develop or maintain your own scrapers
Auto-retry system for failed scraping attempts
"Scraper APIs (formerly Real-Time Crawler) really helped our company. At first, it was kind of complicated to get a hold of it, but our account manager Gabriele was very patient and helped us a lot."
"Our company started using Oxylabs services few years ago and since that we are really happy with proxy services they are providing. Recently they recommended us trying their Scraper APIs (formerly Real-Time Crawler) and to be fair we are very happy with results."
"Glad we chose Oxylabs to partner with and were eager to start using their (formerly Real-Time Crawler) tool. It really helped our business and we are looking for more solutions from them."
Try Web Scraper API with free 5k results
The integration process of our API is quick and easy! Visit our documentation for code examples or see Web Scraper API in action right away.
Put together a query
Add your endpoint URL, payload and API user credentials.
Send your query to our API
We will take it from here - you do not need to do anything.
Receive the result
Retrieve results via an API or get them delivered to your cloud storage bucket.
Use Crawler – a Web Scraper API feature to explore pages on the website and get only the data you need. Crawler quickly spiders any website based on your criteria, and seamlessly returns the complete data to you.
Why try Crawler?
Quickly collect only relevant data from websites, easily control crawling scope and which results are included in the end result, get reliable results as HTML documents or a list of URLs.
How does it work?
You simply select a starting URL, set crawling and processing filters, define scraping parameters, and receive results to your chosen cloud storage bucket.
Benefit from our 102M+ proxy pool without worrying about its management.
Scrape multiple pages at once with up to 1000 URLs per batch.
Retrieve results via an API or to your cloud storage bucket (AWS S3 or GCS).
Schedule recurring scraping and parsing jobs through our Scheduler.
Get timely answers and support whenever you need them.
Scan countless web pages worldwide to stay on top of the market trends and ahead of competitors.
Set up automatic page scraping to scan malicious content from any website and multiple locations.
Pay only for successful results
Gather country-level data
Receive scraping know-how
1 week trial
Limited to 1 user
$1.30 / 1K requests
$99 +VAT billed monthly
$1.00 / 1K requests
$399 +VAT billed monthly
$0.60 / 1K requests
$999 +VAT billed monthly
Custom price per request
Get a quote
We accept these payment methods:
What type of data can I extract with Web Scraper API?
Can I automate recurring scraping jobs with Web Scraper API?
Yes, we offer a free Scheduler feature for all Scraper APIs. You can automate your recurring scraping jobs by scheduling them. Simply put, you don't need to send new requests with identical parameters to receive regular updates of the same public data. Also, there's no need to create or maintain your scheduling scripts. Check our documentation to learn more about a Scheduler feature.
How long does Web Scraper API take to give the results back?
Web Scraper API can deliver real-time results from almost any website worldwide. The delivery time highly depends on a requested target. For more details regarding specific targets, please get in touch with your Account Manager or contact our support team.
Is it legal to scrape a website?
Web scraping services may be legal in cases where it is done without breaching any laws regarding the source targets or data itself. We have explored this subject in one of our blog posts, and we highly recommend that you read it and consult with your legal advisor before any scraping project to avoid any potential risks.
Get the latest news from data gathering world
Scale up your business with Oxylabs®
GET IN TOUCH
Certified data centers and upstream providers
Connect with us