Web Scraper API for various business use cases

Collect product data from eStores

  • Track product data in real-time

  • Implement dynamic pricing strategies

  • Monitor reviews to build brand reputation

  • Conduct market research

Amazon Walmart Best Buy Etsy

Acquire search engine results

  • Get data from Google page types like search and images

  • Extract SERP elements like featured snippet and local pack

  • Keep track of your brand and competitor SERP rankings

  • Optimize SEO strategies

Google Bing Baidu Yandex

Collect multimodal data for AI

  • Bypass anti-bot measures

  • Get AI-optimized, structured outputs

  • Collect multimodal web data at scale

  • Enjoy fully automated, maintenance-free performance

YouTube Search YouTube Downloader YouTube Transcript YouTube Metadata

Scrape real estate data

  • Explore real-time property prices across various platforms

  • Compare prices for trend analysis

  • Analyze rental rates in high-demand zones

  • Make precise property value estimations

Idealista Redfin Zillow Zoopla

Extract travel industry data

  • Gather real-time prices for flights and accommodations

  • Compare data across various platforms for strategy refinement

  • Track and analyze accommodation availability

  • Analyze customer reviews for insights

Booking

Collect B2B intelligence data

  • Leverage company profiles for B2B lead generation

  • Scrape essential business details and job postings

  • Identify potential partners for collaboration

  • Strengthen business development efforts

ZoomInfo Product Hunt

Scrape entertainment websites

  • Uncover audience preferences through content trend analysis

  • Explore user engagement across different websites

  • Diligently monitor media for copyright infringement prevention

  • Preserve the integrity of intellectual property

Netflix Youtube

Get a maintenance-free scraping infrastructure

Benefit from our top-tier web data collection infrastructure that is ready-to-use straight away. No more worrying about JavaScript-heavy websites, IP blocks or other challenges – we have it all covered for you.

  • No need to develop or maintain your own scrapers

  • JavaScript rendering for complex websites

  • Auto-retry system for failed scraping attempts

Simple integration

Step 1: Enter your endpoint URL, API user credentials, and data payload into a single request.

Step 2: Send this request to our API. We’ll take it from there – you don’t need to take any other actions. 

Step 3: Retrieve the result directly from the API or store it in your chosen cloud storage bucket.

API reference
import requests
from pprint import pprint

username = "USERNAME"
password = "PASSWORD"

payload = {
    "source": "universal",
    "url": "https://sandbox.oxylabs.io/products/",
    "geo_location": "United States",
}

response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=(username, password),
    json=payload,
)

pprint(response.json())
No geo-restrictions

Bypass geo-restrictions effortlessly

Regardless of where you are, access data localized in almost any place on earth. Web Scraper API allows you to gather localized search results from 195 countries.

  • 195 countries

  • Country-specific targeting

Dive into code samples

Accessing data from challenging websites has never been easier. Explore the capabilities of Web Scraper API with practical code samples.

Input parameters

source

Scraper

Set the scraper to 'amazon_product' to get product data. (Other sources: 'amazon_search', 'amazon_pricing', 'amazon_reviews', 'amazon_questions', 'amazon_bestsellers', 'amazon_sellers')

query

ASIN

Input 10-symbol ASIN code of the product you want to scrape.

geo_location

Localization

Specify the 'Deliver to' location.

domain

Amazon domain

Specify Amazon marketplace you want to scrape.

locale

Interface language

Set the interface language.

render

JavaScript rendering

Enable to load JavaScript-based content.

parse

Structured data

Enable to get structured product data.

Input

Output

Output preview

import requests
from pprint import pprint

# Structure payload.
payload = {
    'source': 'amazon_product',
    'query': 'B0BGYWPWNC',
    'geo_location': '90210',
    'domain': 'com',
    'parse': True
}

# Take a free trial or buy the product on our dashboard to create an API user.
# Replace 'USERNAME' and 'PASSWORD' with your API credentials to run this request.

# Get response by using real-time endpoint.
response = requests.request(
    'POST',
'https://realtime.oxylabs.io/v1/queries',
    auth=('USERNAME', 'PASSWORD'),
    json=payload,
)

# Print prettified response to stdout.
pprint(response.json())

See full code

...
"product_details": {
    "os": "iOS 16",
    "ram": "1024 GB",
    "asin": "B0BGYWPWNC",
    "color": "Silver",
    "batteries": "1 Lithium Ion batteries required. (included)",
    "form_factor": "Slate",
    "item_weight": "15.5 ounces",
    "manufacturer": "Apple Computer",
    "customer_reviews": "4.2 4.2 out of 5 stars 1,444 ratings 4.2 out of 5 stars",
    "whats_in_the_box": "iPhone, Charger, Mfi cable, SIM Pin ejector",
    "best_sellers_rank": "#139 in Amazon Renewed (See Top 100 in Amazon Renewed) #49 in Renewed Smartphones #1,003 in Climate Pledge Friendly: Electronics",
    "country_of_origin": "China",
    "item_model_number": "A2483",
    "product_dimensions": "0.28 x 2.8 x 5.75 inches",
    "battery_power_rating": "3095",
    "date_first_available": "September 30, 2022",
    "other_display_features": "Wireless",
    "memory_storage_capacity": "1024 GB",
    "connectivity_technologies": "Wi-Fi",
    "ram_memory_installed_size": "1 TB",
    "standing_screen_display_size": "6.1 Inches"
},
...
Output preview image

Try out Web Scraper API for yourself

Discover Scraper API Playground on Oxylabs dashboard for a firsthand interaction with Web Scraper API, and explore technical documentation for all the information you need.

What do others say?

"Building and maintaining your own scraping and parsing solution is expensive. That’s why we turned to Oxylabs. They offered one of the best price-to-value combinations in the market and helped us save our total web scraping costs."

Conductor company face

Wei Zheng

Chief Product Officer at Conductor

Read full story
Conductor company image
More customer stories

Web Scraper API pricing

Regular
Enterprise

Pay only for successful results

Avoid CAPTCHAs and IP blocks

Save time and development costs

Don’t miss out

Free trial

No credit card required

0

Amazon: $0.50/1K results

Google: $1.00/1K results

Other: $1.15/1K results

 Successful results without JS rendering

$1.35 / 1K results

 Successful results with JS

10 requests / s

 Rate limit

Premium proxies

AI-powered web scraping

Up to 2,000 results

Micro

 

49

Amazon: $0.50/1K results

Google: $1.00/1K results

Other: $1.15/1K results

 Successful results without JS rendering

$1.35 / 1K results

 Successful results with JS

From $20 to $249

 Available top-up
50 requests / s  Rate limit

Premium proxies

AI-powered web scraping

Up to 98,000 results

Starter

 

99

Amazon: $0.45/1K results

Google: $0.90/1K results

Other: $1.10/1K results

 Successful results without JS rendering

$1.30 / 1K results

 Successful results with JS

From $20 to $499

 Available top-up
50 requests / s  Rate limit

Premium proxies

AI-powered web scraping

Up to 220,000 results

Advanced

 

249

Amazon: $0.40/1K results

Google: $0.80/1K results

Other: $0.95/1K results

 Successful results without JS rendering

$1.25 / 1K results

 Successful results with JS

From $20 to $499

 Available top-up
50 requests / s  Rate limit

Premium proxies

AI-powered web scraping

Up to 622,500 results

10% off

Yearly plans discount

For all our plans by paying yearly. Contact sales team to learn more.

We accept these payment methods:

24/7 support and handy features

In-depth tutorials

Use the Oxylabs documentation and GitHub repository for a smooth start.

Proxy management

Benefit from our 175M+ proxy pool without worrying about its management.

Bulk scraping

Scrape multiple pages at once with up to 1000 URLs per batch.

Multiple delivery options

Retrieve results via an API or to your cloud storage bucket (AWS S3 or GCS).

Highly scalable

Easy to integrate and customize, supports high volume of requests.

24/7 support

Get timely answers and support whenever you need them.