Web Scraping Services From $49/Month

Scalable real-time data collection from search engines, AI-driven search interfaces, e-commerce marketplaces, and any other target of your choice.

Success-based payment

24/7 support

CAPTCHA bypass

JavaScript rendering

Dive into code samples

Extracting data from complex websites has never been simpler. Discover the potential of our Web Scraper API with practical code samples.

Input parameters

source

Scraper

Set the scraper to 'google_search' to get web, image, or news search results. (Other sources: 'google', 'google_ads', 'google_lens', 'google_travel_hotels', 'google_suggest', 'google_trends_explore')

query

Search query

Input UTF-encoded search query.

geo_location

Localization

Specify the UULE-based geographic location value. (State name, Country name, Coordinates and Radius, Criteria ID)

domain

Google domain

Specify Google domain you want to scrape.

locale

Interface language

Set the interface language.

results_language

Results language

Set the results language.

render

JavaScript rendering

Enable to load JavaScript-based content.

parse

Structured data

Enable to get structured data.

Input

Output

Output preview

import requests
from pprint import pprint
username = "USERNAME"
password = "PASSWORD"
# Structure payload.
payload = {
    "source": "google_search",
    "query": "adidas",
    "domain": "com",
    "geo_location": "California,United States",
    "parse": True
}
# Take a free trial or buy the product on our dashboard to create an API user.
# Replace 'USERNAME' and 'PASSWORD' with your API credentials to run this request.
# Get response by using real-time endpoint.
response = requests.request(
    'POST',
'https://realtime.oxylabs.io/v1/queries',
    auth=(username, password),
    json=payload,
)
# Print prettified response to stdout.
pprint(response.json())

"content": {
    "url": "https://www.google.com/search?q=adidas&filter=1&safe=off&uule=w+CAIQICIYQ2FsaWZvcm5pYSxVbml0ZWQgU3RhdGVz&gl=us&hl=en",
    "page": 1,
    "results": {
        "paid": [
            {
                "pos": 1,
                "url": "https://www.adidas.com/us",
                "desc": "Sign Up For adiClub To Get Free Standard Shipping And Start Earning Points On Every Order. Shop The adidas® Official Site. Join Our adiClub Loyalty Program. Sign Up & Get 15% Off. Gift Cards Available. View Size Charts. Free Shipping Available.",
                "title": "adidas® Official Website | Place Your Order Today | adidas US",
                "data_rw": "https://www.google.com/aclk?sa=l&ai=DChcSEwjJ_POllYCGAxW_VEgAHe29DH0YABAAGgJjZQ&ae=2&gclid=EAIaIQobChMIyfzzpZWAhgMVv1RIAB3tvQx9EAAYASAAEgKwcfD_BwE&sig=AOD64_2LcoUnvekUgtnHdwRH-W1AE5U96g&q&adurl",
                "sitelinks": {
                    "expanded": [
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men"
                        },
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men's Collection"
                        }
                    ]
                },
                "url_shown": "https://www.adidas.com",
                "pos_overall": 1
            }
        ],
        "images": {
            "items": [
                {
                    "alt": "adidas Superstar Shoes - Black | Unisex Lifestyle | adidas US",
                    "pos": 1,
                    "url": "https://www.adidas.com/us/superstar-shoes/EG4959.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/superstar-shoes/EG4959.html"
                },
                {
                    "alt": "adidas Superstar Shoes - White | Unisex Lifestyle | adidas US",
                    "pos": 2,
                    "url": "https://www.adidas.com/us/superstar-shoes/EG4958.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/superstar-shoes/EG4958.html"
                },
                {
                    "alt": "Adidas Campus 00S Shoes - unisex - Better Scarlet Red / Clear Pink / Cloud White - M 14 / W 15",
                    "pos": 3,
                    "url": "https://www.adidas.com/us/campus-00s-shoes/H03477.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/campus-00s-shoes/H03477.html"
                }
            ],
            "pos_overall": 9
        },
        "organic": [
            {
                "pos": 1,
                "url": "https://www.adidas.com/us",
                "desc": "adidas is about more than sportswear and workout clothes. We partner with the best in the industry to co-create. This way we offer our fans the sporting goods, ...",
                "title": "adidas Official Website | adidas US",
                "sitelinks": {
                    "expanded": [
                        {
                            "url": "https://www.adidas.com/us/women",
                            "title": "Women's Shoes, Clothing and ..."
                        },
                        {
                            "url": "https://www.adidas.com/us/men-shoes",
                            "title": "Men's Shoes"
                        },
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men's Shoes, Clothing and ..."
                        },
                        {
                            "url": "https://www.adidas.com/us/kids",
                            "title": "Kids' Shoes and Clothing"
                        },
                        {
                            "url": "https://www.adidas.com/us/originals",
                            "title": "Originals Sneakers & Clothing"
                        }
                    ]
                },
                "url_shown": "https://www.adidas.com› ...",
                "pos_overall": 2
            },
...

Try Web Scraper API out for yourself

Discover Web Scraper API Playground on the dashboard for a firsthand interaction with our solution, and explore technical documentation for all the information you need.

Simple integration

Step 1: Put your endpoint URL, API user credentials, and data payload into a single request.

Step 2: Send the request to our API. We'll take care of everything from there – you don't need to do anything else.

Step 3: Get the result either directly from the API or to your chosen cloud storage bucket in HTML, JSON, PNG, XHR, or Markdown.

See more examples

import requests
from pprint import pprint

username = "USERNAME"
password = "PASSWORD"

payload = {
    "source": "universal",
    "url": "https://sandbox.oxylabs.io/products/",
    "geo_location": "United States",
}

response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=(username, password),
    json=payload,
)

pprint(response.json())

Custom browser instructions

Render JavaScript-based pages with a single line of code, eliminating the need for complex browser development or automated third-party tools. Set up custom browser instructions to execute mouse clicks, input text, scroll pages, wait for elements to appear, and more.

Effortless JavaScript rendering
Browser instructions execution
Seamless data collection

Learn more

Custom browser instructions example visuals

Advanced features

Leverage Web Scraper API smart features for collecting real-time data.

Proxy management

ML-driven proxy selection and rotation using our premium proxy pool from 195 countries.

Custom parameters

Boost your scraping control with custom headers and cookies at no extra cost.

AI-driven fingerprinting

Unique HTTP headers, JavaScript, and browser fingerprints ensure resilience to dynamic content.

CAPTCHA bypass

Automatic retries and CAPTCHA bypassing for uninterrupted data retrieval.

Response recognition

ML-based recognition and adaptation to various responses, optimizing scraping efficiency.

Continuous scroll support

Set the amount of Google organic search results per SERP to suit your needs.

Scheduler

Automate recurring scraping jobs with desired frequency and receive data to AWS S3 or GCS.

Custom Parser

Define your own parsing logic using XPath or CSS selectors for structured data collection.

What do others say?

"Building and maintaining your own scraping and parsing solution is expensive. That’s why we turned to Oxylabs. They offered one of the best price-to-value combinations in the market and helped us save our total web scraping costs."

Wei Zheng

Chief Product Officer at Conductor

Read full story

Play

Oxylabs products fuel top industries with public web data

Harness public data for e-commerce success

Access valuable e-commerce data, such as pricing, product information, or reviews, on a large scale.
Price monitoring Dynamic pricing Monitor product information Identify MAP policy violations Learn more

Boost cybersecurity operations with public data

Gather critical data while staying unnoticed by threat actors to make proactive security decisions. Threat intelligence Email protection Prevent phishing attacks Learn more

Secure brands with top-tier public data collection solutions

Retrieve public data on a large scale to stop copyright infringement and counterfeiting. Copyright infringement monitoring Anti-counterfeit tracking Domain squatting detection Learn more

Unleash SEO potential with real-time public SERP data

Extract highly localized search engine data to monitor rankings and brand visibility.
Monitor SERP results Backlink intelligence Ad intelligence Learn more

Discover new opportunities with public travel data

Leverage real-time flight and hotel data to shape your travel business strategy with evidence-based insights.

Real-time ticket pricing data
Hotel pricing trends

Learn more

Collect multimodal data for AI

Bypass anti-bot measures
Get AI-optimized, structured outputs
Collect multimodal web data at scale
Enjoy fully automated, maintenance-free performance

ChatGPT Perplexity Google AI Mode

Acquire search engine & LLM results

Keep track of your brand and competitor SERP rankings and LLM presence
Get data from Google page types, e.g., search and images
Extract SERP elements like featured snippet and local pack
Optimize SEO & GEO strategies

Google Bing Baidu Yandex ChatGPT Perplexity Google AI Mode

Useful resources

Documentation

Technical API documentation

Discover available scraping parameters and explore code examples for specific targets.

Github

Oxylabs GitHub repositories

Learn how to scrape websites, use our tools, integrate products, and more.

Quick Start Guide

Setup guide for Web Scraper API

Quickly integrate our Web Scraper API into your infrastructure.

Target library

Pre-configured Web Scraper API endpoints that collect web data and simplify delivery. Each target supports customizable request parameters like location, language, and more.

View documentation

Categories

Universal Source

Other

Universal Source

Parsing available with Oxy Parser

Raw HTML

See how your requests would look with the universal source.

universal

86.9K

Publix

E-Commerce

Publix: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Publix search result pages by providing a search term.

publix_search

25.7K

Publix

E-Commerce

Publix: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Publix product pages by product ID.

publix_product

25.7K

Publix

E-Commerce

Publix: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Publix URL of your choice.

publix

25.7K

Grainger

E-Commerce

Grainger: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Grainger search result pages by keyword.

grainger_search

25.7K

Grainger

E-Commerce

Grainger: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Grainger product pages by product ID, with support for domain localization across Grainger...

grainger_product

25.7K

Grainger

E-Commerce

Grainger: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Grainger page by providing a direct URL.

grainger

25.7K

Allegro

E-Commerce

Allegro: Search

Parsing available with Oxy Parser

Raw HTML

See how you should formulate your request to scrape Allegro search result pages.

allegro_search

25.7K

Allegro

E-Commerce

Allegro: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Allegro product pages by product ID.

allegro_product

25.7K

Tokopedia

E-Commerce

Tokopedia: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Tokopedia search result pages by keyword, with support for pagination.

tokopedia_search

25.7K

Tokopedia

E-Commerce

Tokopedia: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Tokopedia page by providing a direct URL.

tokopedia

25.7K

Mercado Livre

E-Commerce

Mercado Livre: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Mercado Livre search results using Web Scraper API. Retrieve product listings with simple ...

mercadolivre_search

25.7K

Mercado Livre

E-Commerce

Mercado Livre: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Mercado Livre product pages by product ID.

mercadolivre_product

25.7K

Dcard

Other

Dcard

Parsing available with Oxy Parser

Raw HTML

Retrieve Dcard search results using Web Scraper API. Simple integration with code examples for mu...

dcard_search

25.7K

Amazon

E-Commerce

Amazon: Product

Parsed JSON

129 Data Points

Extract Amazon product data effortlessly with Web Scraper API. Access titles, prices, reviews, an...

amazon_product

15.0K

Amazon

E-Commerce

Amazon: Search

Parsed JSON

88 Data Points

Scrape Amazon search results with Web Scraper API. Retrieve product titles, prices, ratings & mor...

amazon_search

15.0K

Amazon

E-Commerce

Amazon: Pricing

Parsed JSON

23 Data Points

Access Amazon product pricing data with Web Scraper API. Retrieve price listings, discounts, and ...

amazon_pricing

15.0K

Amazon

E-Commerce

Amazon: Sellers

Parsed JSON

22 Data Points

Scrape Amazon seller pages with Oxylabs Web Scraper API. Get ratings, feedback, profile data & mo...

amazon_sellers

15.0K

Amazon

E-Commerce

Amazon: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Amazon pages by URL with Web Scraper API. Request examples, parsed output, JS rendering, g...

amazon

15.0K

Google

Google: Web Search

Parsed JSON

269 Data Points

Comprehensive Google Search scraper with parsed data for organic results, ads, snippets, knowledg...

google_search

10.8K

Google

Google: Local Search

Parsing available with Oxy Parser

Raw HTML

Google Local Search API retrieves location-based results for restaurants, hotels, and services wi...

google_maps

10.8K

Google

Google: AI Overviews

Parsed JSON

44 Data Points

Extract Google AI Overviews from search results with parsed data for answer text, bullet lists, p...

google_search

10.8K

Google

Google: URL

Parsing available with Oxy Parser

Raw HTML

Google URL scraper retrieves content from any Google page with ease. Simple integration with code...

google

10.8K

Universal Source

Real Estate

Redfin: URL

Parsing available with Oxy Parser

Raw HTML

Extract Redfin data by URL, including property listings, pricing, home sizes, locations, and more...

universal

2.6K

Walmart

E-Commerce

Walmart: Search

Parsed JSON

58 Data Points

Extract Walmart search results with parsed data, including pricing, ratings, seller info, variant...

walmart_search

2.6K

Walmart

E-Commerce

Walmart: Product

Parsed JSON

59 Data Points

Extract Walmart product pages by product ID with parsed data including pricing, ratings, seller i...

walmart_product

2.6K

Walmart

E-Commerce

Walmart: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Walmart URL of your choice.

walmart

2.6K

eBay

E-Commerce

eBay: Search

Parsing available with Oxy Parser

Raw HTML

Scrape eBay search results by keyword, with support for pagination and domain localization across...

ebay_search

2.4K

eBay

E-Commerce

eBay: Product

Parsing available with Oxy Parser

Raw HTML

Get eBay product pages by product ID, with support for domain localization across multiple eBay r...

ebay_product

2.4K

eBay

E-Commerce

eBay: URL

Parsing available with Oxy Parser

Raw HTML

See how to scrape any eBay URL of your choice.

ebay

2.4K

Universal Source

E-Commerce

Temu: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Temu product and search data by URL, including pricing, descriptions, images, inventory le...

universal

2.3K

Google

Google: Lens

Parsed JSON

15 Data Points

Google Lens API extracts visual search results from provided image URLs. Returns visually matchin...

google_lens

2.3K

Aliexpress

E-Commerce

Aliexpress: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Aliexpress search result pages by providing a search term.

aliexpress_search

2.2K

Aliexpress

E-Commerce

Aliexpress: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Aliexpress product pages by product ID.

aliexpress_product

2.2K

Aliexpress

E-Commerce

Aliexpress: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Aliexpress URL of your choice.

aliexpress

2.2K

Zillow

Real Estate

Zillow: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Zillow page by providing a direct URL.

zillow

2.2K

Amazon

E-Commerce

Amazon ASIN: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Amazon product pages by ASIN, including pricing, product details, reviews, seller informat...

amazon

2.1K

Universal Source

Other

Product Hunt: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Product Hunt data by URL, including product listings, descriptions, upvotes, reviews, and ...

universal

1.7K

Google

Google: Image Search

Parsed JSON

19 Data Points

Extract Google Image Search results with parsed data, including organic image listings, image URL...

google_search

1.7K

Google

Google: News Search

Parsed JSON

25 Data Points

Scrape Google News results on a large scale and get completely parsed data. Extract articles with...

google_search

1.7K

ChatGPT

Parsed JSON

17 Data Points

Extract ChatGPT responses by submitting prompts, with parsed data including response text, Markdo...

chatgpt

1.6K

Universal Source

E-Commerce

1688: URL

Parsing available with Oxy Parser

Raw HTML

Scrape 1688 data by URL, including pricing, product images, collection details, and more.

universal

1.6K

Etsy

E-Commerce

Etsy: Search

Parsing available with Oxy Parser

Raw HTML

See how you should formulate your request to scrape Etsy search result pages.

etsy_search

1.5K

Etsy

E-Commerce

Etsy: Product

Parsed JSON

29 Data Points

Extract Etsy product page data by product ID, including pricing, images, seller details, reviews,...

etsy_product

1.5K

Etsy

E-Commerce

Etsy: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Etsy page by providing a direct URL.

etsy

1.5K

Google

Google: Trends: Explore

Parsing available with Oxy Parser

Raw HTML

Extract Google Trends data by keyword, date range, and category. API supports multiple search typ...

google_trends_explore

1.5K

Universal Source

Yandex: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Yandex search results by URL, including organic listings, ads, snippets, and more.

universal

1.5K

Universal Source

E-Commerce

Home Depot: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Home Depot data by URL, including product details, pricing, search results, and more.

universal

1.4K

Universal Source

Google Play: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Google Play data by URL, including app titles, pricing, version numbers, download rates, r...

universal

1.4K

Google

Google: Ads Max

Parsed JSON

17 Data Points

Scrape Google Search results optimized for maximum paid ad visibility, with parsed data for paid ...

google_ads

1.3K

Lowe's

E-Commerce

Lowe's: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Lowe's search results by keyword, with support for store and delivery ZIP localization, an...

lowes_search

1.1K

Lowe's

E-Commerce

Lowe's: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Lowe's product pages by product ID, with support for store and delivery ZIP localization.

lowes_product

1.1K

Lowe's

E-Commerce

Lowe's: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Lowe's page using a direct URL, with support for store and delivery ZIP code localizat...

lowes

1.1K

Target

E-Commerce

Target: Search

Parsed JSON

24 Data Points

Extract Target search results with parsed data for organic listings, including pricing, ratings, ...

target_search

1.1K

Target

E-Commerce

Target: Product

Parsed JSON

16 Data Points

Extract Target product pages by product ID with parsed data including pricing, brand, category, d...

target_product

1.1K

Target

E-Commerce

Target: Category

Parsing available with Oxy Parser

Raw HTML

Scrape Target category pages by taxonomy node ID, with support for store, fulfillment type, and d...

target_category

1.1K

Best Buy

E-Commerce

Best Buy: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Best Buy search results with domain, store, and fulfillment filtering using Web Scraper AP...

bestbuy_search

1.1K

Best Buy

E-Commerce

Best Buy: Product

Parsed JSON

17 Data Points

Get Best Buy product details including pricing, ratings, and specifications. Extract parsed or HT...

bestbuy_product

1.1K

Google

Google Scholar: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Scholar results by URL, including organic results, author citations, cited-by coun...

google

1.1K

Universal Source

Travel

Skyscanner: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Skyscanner data by URL, including flight, hotel, and car rental details, pricing, and more...

universal

987

Universal Source

Real Estate

MLS: URL

Parsing available with Oxy Parser

Raw HTML

Scrape MLS data by URL, including property listings, pricing, home details, locations, and more.

universal

969

Universal Source

Other

Indeed: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Indeed data by URL, including job titles, locations, salaries, company reviews, and more.

universal

949

Universal Source

E-Commerce

Shein: URL

Parsing available with Oxy Parser

Raw HTML

Scrape SHEIN data by URL, including pricing, product images, descriptions, inventory levels, and ...

universal

940

Universal Source

E-Commerce

Wayfair: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Wayfair data by URL, including product details, pricing, reviews, specifications, and more...

universal

936

Costco

E-Commerce

Costco: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Costco search result pages by keyword, with support for pagination and domain localization...

costco_search

859

Costco

E-Commerce

Costco: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Costco product pages by product ID, with support for domain localization across multiple C...

costco_product

859

Costco

E-Commerce

Costco: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Costco page by providing a direct URL.

costco

859

Alibaba

E-Commerce

Alibaba: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Alibaba search result pages by providing a search term.

alibaba_search

851

Alibaba

E-Commerce

Alibaba: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Alibaba product pages by product ID.

alibaba_product

851

Alibaba

E-Commerce

Alibaba: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Alibaba URL of your choice.

alibaba

851

Universal Source

E-Commerce

Taobao: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Taobao data by URL, including product listings, titles, descriptions, pricing, and more.

universal

824

Universal Source

Travel

Expedia: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Expedia data by URL, including flight, hotel, and car rental details, pricing, availabilit...

universal

824

Universal Source

E-Commerce

Adidas: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Adidas data by URL, including product details, pricing, sizes, availability, reviews, and ...

universal

811

Google

Google Jobs: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Jobs results by URL, including job titles, locations, salaries, and more.

google

770

Universal Source

Other

ZoomInfo: URL

Parsing available with Oxy Parser

Raw HTML

Extract ZoomInfo data by URL, including company profiles, contact details, industry information, ...

universal

766

Universal Source

E-Commerce

Chewy: URL

Parsing available with Oxy Parser

Raw HTML

Extract Chewy data by URL, including product descriptions, pricing, search results, and more.

universal

743

Bing

Bing: Search

Parsed JSON

22 Data Points

Extract Bing Search results with parsed data for paid ads and organic listings, with support for ...

bing_search

709

Bing

Bing: URL

Parsing available with Oxy Parser

Raw HTML

See how you can start scraping Bing URLs.

bing

709

Universal Source

Baidu: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Baidu search results by URL, including organic listings, ads, snippets, and more.

universal

683

Universal Source

Real Estate

Zoopla: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Zoopla data by URL, including property listings, pricing, locations, home specifications, ...

universal

680

Universal Source

Other

Craigslist: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Craigslist data by URL, including classified listings, pricing, descriptions, locations, a...

universal

628

Universal Source

E-Commerce

Trendyol: URL

Parsing available with Oxy Parser

Raw HTML

Extract Trendyol data by URL, including product availability, pricing, descriptions, and more.

universal

598

Amazon

E-Commerce

Amazon Books: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Amazon Books data by URL, including titles, authors, pricing, ratings, reviews, and more.

amazon

587

Google

Google: AI Mode

Parsed JSON

12 Data Points

Extract Google AI Mode responses by submitting prompts, including the full response text, referen...

google_ai_mode

545

Flipkart

E-Commerce

Flipkart: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Flipkart search results by keyword, with support for pagination and JavaScript rendering.

flipkart_search

500

Flipkart

E-Commerce

Flipkart: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Flipkart product pages by product ID.

flipkart_product

500

Flipkart

E-Commerce

Flipkart: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Flipkart page by providing a direct URL.

flipkart

500

Universal Source

E-Commerce

Depop: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Depop data by URL, including product listings, pricing, seller profiles, descriptions, and...

universal

476

Google

Google Autocomplete: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Autocomplete suggestions by URL, including keyword predictions and search trends.

google

469

Universal Source

Travel

Trivago: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Trivago data by URL, including hotel listings, pricing, ratings, availability, and more.

universal

439

Lazada

E-Commerce

Lazada: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Lazada search result pages by keyword, with support for pagination and domain localization...

lazada_search

438

Lazada

E-Commerce

Lazada: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Lazada product pages by product ID.

lazada_product

438

Lazada

E-Commerce

Lazada: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Lazada URL of your choice.

lazada

438

Universal Source

Travel

Hotels.com: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Hotels.com data by URL, including hotel listings, pricing, ratings, availability, and more...

universal

425

Google

Google Finance: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Finance data by URL, including stock prices, market trends, company financials, an...

google

421

Universal Source

E-Commerce

Sephora: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Sephora data by URL, including product details, pricing, delivery info, ingredients, and m...

universal

418

Universal Source

Other

Wikipedia: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Wikipedia data by URL, including article content, references, categories, and more.

universal

410

Amazon

E-Commerce

Amazon: Best Sellers

Parsed JSON

22 Data Points

Discover Amazon Best Sellers data with Web Scraper API. Collect top-ranking product details, cate...

amazon_bestsellers

400

Universal Source

Travel

Booking: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Booking data by URL, including hotel listings, pricing, ratings, availability, amenities, ...

universal

390

Universal Source

Real Estate

Idealista: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Idealista data by URL, including property listings, pricing, sizes, locations, description...

universal

382

Universal Source

Other

OpenSea: URL

Parsing available with Oxy Parser

Raw HTML

Scrape OpenSea data by URL, including NFT listings, pricing, collection details, ownership histor...

universal

376

Google

Travel

Google: Travel: Hotels

Parsing available with Oxy Parser

Raw HTML

Scrape Google Travel: Hotels results with guest count, dates, and star rating filters. Flexible A...

google_travel_hotels

328

Perplexity

Parsed JSON

24 Data Points

Extract Perplexity responses by submitting prompts, with parsed data including answer text, Markd...

perplexity

327

Universal Source

E-Commerce

Newegg: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Newegg data by URL, including product specifications, pricing, ratings, reviews, and more.

universal

322

Google

Google Events: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Events data by URL, including event titles, dates, locations, venues, and more.

google

307

Mercado Libre

E-Commerce

Mercado Libre: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Mercado Libre search results by keyword.

mercadolibre_search

261

Mercado Libre

E-Commerce

Mercado Libre: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Mercado Libre product pages by product ID, with support for domain localization across mul...

mercadolibre_product

261

Mercado Libre

E-Commerce

Mercado Libre: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Mercado Libre page by providing a direct URL.

mercadolibre

261

Universal Source

E-Commerce

Milanuncios: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Milanuncios by URL, including search listings, product data, price points, and other infor...

universal

260

Universal Source

E-Commerce

Mercari: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Mercari data by URL, including product listings, pricing, item conditions, seller details,...

universal

254

Kroger

E-Commerce

Kroger: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Kroger product page data including pricing, availability, and fulfillment options using pr...

kroger_product

253

Kroger

E-Commerce

Kroger: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Kroger search pages with filters for price range, brand, and store location. Retrieve orga...

kroger_search

253

Kroger

E-Commerce

Kroger: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Kroger page via a direct URL, supporting store-specific results, delivery ZIP codes, a...

kroger

253

MediaMarkt

E-Commerce

MediaMarkt: Search

Parsing available with Oxy Parser

Raw HTML

See how you should formulate your request to scrape MediaMarkt search results.

mediamarkt_search

235

MediaMarkt

E-Commerce

MediaMarkt: Product

Parsing available with Oxy Parser

Raw HTML

Scrape MediaMarkt product pages by product ID.

mediamarkt_product

235

MediaMarkt

E-Commerce

MediaMarkt: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any MediaMarkt URL of your choice.

mediamarkt

235

Universal Source

Other

GitHub: URL

Parsing available with Oxy Parser

Raw HTML

Scrape GitHub data by URL, including search results, topics, trends, repositories, profiles, cont...

universal

222

Universal Source

E-Commerce

Macy's: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Macy's data by URL, including product details, pricing, reviews, sizes, colors, and more.

universal

214

Google

Google Recipes: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Recipes results by URL, including recipe titles, ingredients, cook times, ratings,...

google

195

Google

Google Knowledge Graph: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Knowledge Graph panel data by URL, including entity details, descriptions, key fac...

google

182

Universal Source

Travel

Priceline: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Priceline data by URL, including hotel, flight, and car rental details, pricing, availabil...

universal

181

TikTok

E-Commerce

TikTok: Shop Search

Parsing available with Oxy Parser

Raw HTML

Scrape TikTok Shop search result pages by keyword.

tiktok_shop_search

166

TikTok

E-Commerce

TikTok: Shop Product

Parsing available with Oxy Parser

Raw HTML

Get TikTok Shop product pages by product ID.

tiktok_shop_product

166

TikTok

E-Commerce

TikTok: Shop URL

Parsing available with Oxy Parser

Raw HTML

Scrape any TikTok Shop page by providing a direct URL.

tiktok

166

Google

Google Books: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Books results by URL, including book titles, authors, publishers, ratings, and mor...

google

143

Google

Google Local Pack: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Local Pack results by URL, including business names, ratings, addresses, phone num...

google

125

Google

Google Product Listing Ads: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Product Listing Ads data by URL, including product titles, pricing, seller names, ...

google

124

Universal Source

E-Commerce

Worten: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Worten data by URL, including product details, pricing, specifications, availability, and ...

universal

118

Google

Google Featured Snippet: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Featured Snippet data by URL, including the answer text, source URL, and related s...

google

117

Google

Google Carousel: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Carousel data by URL, including listed items, images, titles, and associated detai...

google

101

Google

Google Spell Check: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Spell Check suggestions by URL, including corrected queries and alternative search...

google

Universal Source

Other

YellowBook

Parsing available with Oxy Parser

Raw HTML

Scrape YellowBook data by URL, including business listings, contact details, categories, and more...

universal

Google

Google Video Results: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Video Results data by URL, including video titles, sources, durations, thumbnails,...

google

Google

Google Related Questions: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Related Questions (People Also Ask) data by URL, including questions, answer snipp...

google

Google

Google Top Stories: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Top Stories data by URL, including article headlines, publishers, timestamps, and ...

google

Google

Google Related Searches: URL

Parsing available with Oxy Parser

Raw HTML

Extract Google Related Searches data by URL, including suggested search queries and keyword varia...

google

IndiaMART

E-Commerce

IndiaMART: Search

Parsing available with Oxy Parser

Raw HTML

Scrape IndiaMART search result pages by providing a search term.

indiamart_search

IndiaMART

E-Commerce

IndiaMART: Product

Parsing available with Oxy Parser

Raw HTML

Scrape IndiaMART product pages by product ID.

indiamart_product

IndiaMART

E-Commerce

IndiaMART: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any IndiaMART URL of your choice.

indiamart

Falabella

E-Commerce

Falabella: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Falabella search results by keyword, with support for pagination.

falabella_search

Falabella

E-Commerce

Falabella: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Falabella product pages by product ID.

falabella_product

Falabella

E-Commerce

Falabella: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Falabella page by providing a direct URL.

falabella

Airbnb

Travel

Airbnb: Homes

Parsing available with Oxy Parser

Raw HTML

Scrape Airbnb property listings by ID.

airbnb_product

Airbnb

Travel

Airbnb: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Airbnb URL of your choice (homes, experiences, services).

airbnb

Universal Source

E-Commerce

Coppel: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Coppel data by URL, including product details, pricing, availability, and more.

universal

Magazine Luiza

E-Commerce

Magazine Luiza: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Magazine Luiza search result pages by providing a search term.

magazineluiza_search

Magazine Luiza

E-Commerce

Magazine Luiza: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Magazine Luiza product pages by product ID.

magazineluiza_product

Magazine Luiza

E-Commerce

Magazine Luiza: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Magazine Luiza URL of your choice.

magazineluiza

Universal Source

E-Commerce

Quill: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Quill data by URL, including product details, pricing, specifications, and more.

universal

Instacart

E-Commerce

Instacart: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Instacart search result pages by providing a search term.

instacart_search

Instacart

E-Commerce

Instacart: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Instacart product pages by product ID.

instacart_product

Instacart

E-Commerce

Instacart: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Instacart URL of your choice.

instacart

Bodega Aurrerá

E-Commerce

Bodega Aurrerá: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Bodega Aurrerá search result pages by providing a search term.

bodegaaurrera_search

Bodega Aurrerá

E-Commerce

Bodega Aurrerá: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Bodega Aurrerá product pages by product ID.

bodegaaurrera_product

Bodega Aurrerá

E-Commerce

Bodega Aurrerá: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Bodega Aurrerá URL of your choice.

bodegaaurrera

Menards

E-Commerce

Menards: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Menards search result pages by providing a search term.

menards_search

Menards

E-Commerce

Menards: Product

Parsing available with Oxy Parser

Raw HTML

See how to scrape Menards product pages by product ID.

menards_product

Menards

E-Commerce

Menards: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Menards URL of your choice.

menards

Avnet

E-Commerce

Avnet

Parsing available with Oxy Parser

Raw HTML

See how you can start formulating Avnet scraping requests.

avnet_search

Petco

E-Commerce

Petco: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Petco search result pages by keyword, with support for pagination, store selection, and fu...

petco_search

Petco

E-Commerce

Petco: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Petco page by providing a direct URL, with support for store-specific results.

petco

Cdiscount

E-Commerce

Cdiscount: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Cdiscount search result pages by keyword, with support for pagination.

cdiscount_search

Cdiscount

E-Commerce

Cdiscount: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Cdiscount product pages by product ID.

cdiscount_product

Cdiscount

E-Commerce

Cdiscount: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Cdiscount page by providing a direct URL.

cdiscount

Bed Bath & Beyond

E-Commerce

Bed Bath & Beyond: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Bed Bath & Beyond search result pages by providing a search term.

bedbathandbeyond_search

Bed Bath & Beyond

E-Commerce

Bed Bath & Beyond: Product

Parsing available with Oxy Parser

Raw HTML

Scrape Bed Bath & Beyond product pages by product ID.

bedbathandbeyond_product

Bed Bath & Beyond

E-Commerce

Bed Bath & Beyond: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Bed Bath & Beyond URL of your choice.

bedbathandbeyond

Staples

E-Commerce

Staples

Parsing available with Oxy Parser

Raw HTML

Scrape Staples search result pages by keyword, with support for pagination and domain localizatio...

staples_search

Universal Source

E-Commerce

Notebooksbilliger: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Notebooksbilliger data by URL, including product specifications, pricing, availability, an...

universal

Rakuten

E-Commerce

Rakuten: Search

Parsing available with Oxy Parser

Raw HTML

Scrape Rakuten search result pages by keyword.

rakuten_search

Rakuten

E-Commerce

Rakuten: URL

Parsing available with Oxy Parser

Raw HTML

Scrape any Rakuten page by providing a direct URL.

rakuten

Universal Source

Real Estate

Fotocasa: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Fotocasa data by URL, including property listings, pricing, locations, sizes, and more.

universal

Universal Source

E-Commerce

Logitech: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Logitech data by URL, including pricing, product images, and new releases.

universal

Universal Source

E-Commerce

Overstock: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Overstock data by URL, including product details, pricing, reviews, specifications, and mo...

universal

Universal Source

E-Commerce

Kobo: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Kobo data by URL, including e-book titles, authors, pricing, ratings, and more.

universal

Universal Source

E-Commerce

Sonos: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Sonos data by URL, including product specifications, pricing, compatibility details, and m...

universal

Universal Source

E-Commerce

Plus: URL

Parsing available with Oxy Parser

Raw HTML

Extract Plus data by URL, including product details, pricing, availability, and more.

universal

Universal Source

E-Commerce

Marks: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Marks & Spencer data by URL, including product details, pricing, sizes, availability, and ...

universal

Universal Source

E-Commerce

Rockler: URL

Parsing available with Oxy Parser

Raw HTML

Scrape Rockler data by URL, including product details, images, pricing, and more.

universal

Frequently Asked Questions

What are web scraping services?

Oxylabs' web scraping services include an all-in-one web scraping solution tailored to suit a specific niche of data extraction, such as collecting information from e-commerce websites, search engines, and other targets.

The web services provide a complete infrastructure developed to simplify data extraction with generalized commands, automatic data structurization (parsing), simple data delivery, and a full range of auxiliary tools like Scheduler, Custom browser instructions, OxyCopilot, and more.

If you're curious, you can find more information, such as tutorials or guides, in our blog – whether it is an API for dummies guide, a more in-depth coding tutorial, or a step-by-step walkthrough on building a JavaScript web scraper using Node.js and Puppeteer. You can also explore our recommended web scraping tools to enhance your data extraction setup.

Which coding language is best for web scraping?

The best coding language for web scraping depends on many factors, including your specific requirements, existing skill set, and the complexity of the task at hand. Python is often considered the best language for web scraping due to its wide variety of dedicated libraries and ease of use, making it the top choice for beginners and professionals alike.

Is web scraping legal?

The legality of web scraping depends on the website's terms of service, the nature of the data, and your jurisdiction. Always review the website’s terms and consult with a legal professional to ensure compliance with relevant laws and regulations.

What data formats can the Web Scraper API return?

Web Scraper API can return data in multiple formats for various use cases. You can retrieve:

Raw HTML: complete, unprocessed HTML of a web page.
Parsed JSON: structured HTML data.
Web page PNG: screenshot of the rendered web page.
XHR/Fetch requests: data from asynchronous requests made during page load.
Markdown: lightweight, easy-to-read format, ideal for LLMs and AI workflows.

Get the latest news from data gathering world

I'm interested

ISO/IEC 27001:2022 certified products:

Proxy Solutions

Scraper APIs

Scale up your business with Oxylabs®

hello@oxylabs.io support@oxylabs.io career@oxylabs.io