Proxy management
ML-driven proxy selection and rotation using our premium proxy pool from 195 countries.
Extracting data from complex websites has never been simpler. Discover the potential of our Web Scraper API with practical code samples.
Input parameters
source
Scraper
Set the scraper to 'google_search' to get web, image, or news search results. (Other sources: 'google', 'google_ads', 'google_lens', 'google_travel_hotels', 'google_suggest', 'google_trends_explore')
query
Search query
Input UTF-encoded search query.
geo_location
Localization
Specify the UULE-based geographic location value. (State name, Country name, Coordinates and Radius, Criteria ID)
domain
Google domain
Specify Google domain you want to scrape.
locale
Interface language
Set the interface language.
results_language
Results language
Set the results language.
render
JavaScript rendering
Enable to load JavaScript-based content.
parse
Structured data
Enable to get structured data.
Input
Output
Output preview
import requests from pprint import pprint username = "USERNAME" password = "PASSWORD" # Structure payload. payload = { "source": "google_search", "query": "adidas", "domain": "com", "geo_location": "California,United States", "parse": True } # Take a free trial or buy the product on our dashboard to create an API user. # Replace 'USERNAME' and 'PASSWORD' with your API credentials to run this request. # Get response by using real-time endpoint. response = requests.request( 'POST', 'https://realtime.oxylabs.io/v1/queries', auth=(username, password), json=payload, ) # Print prettified response to stdout. pprint(response.json())
"content": { "url": "https://www.google.com/search?q=adidas&filter=1&safe=off&uule=w+CAIQICIYQ2FsaWZvcm5pYSxVbml0ZWQgU3RhdGVz&gl=us&hl=en", "page": 1, "results": { "paid": [ { "pos": 1, "url": "https://www.adidas.com/us", "desc": "Sign Up For adiClub To Get Free Standard Shipping And Start Earning Points On Every Order. Shop The adidas® Official Site. Join Our adiClub Loyalty Program. Sign Up & Get 15% Off. Gift Cards Available. View Size Charts. Free Shipping Available.", "title": "adidas® Official Website | Place Your Order Today | adidas US", "data_rw": "https://www.google.com/aclk?sa=l&ai=DChcSEwjJ_POllYCGAxW_VEgAHe29DH0YABAAGgJjZQ&ae=2&gclid=EAIaIQobChMIyfzzpZWAhgMVv1RIAB3tvQx9EAAYASAAEgKwcfD_BwE&sig=AOD64_2LcoUnvekUgtnHdwRH-W1AE5U96g&q&adurl", "sitelinks": { "expanded": [ { "url": "https://www.adidas.com/us/men", "title": "Men" }, { "url": "https://www.adidas.com/us/men", "title": "Men's Collection" } ] }, "url_shown": "https://www.adidas.com", "pos_overall": 1 } ], "images": { "items": [ { "alt": "adidas Superstar Shoes - Black | Unisex Lifestyle | adidas US", "pos": 1, "url": "https://www.adidas.com/us/superstar-shoes/EG4959.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/superstar-shoes/EG4959.html" }, { "alt": "adidas Superstar Shoes - White | Unisex Lifestyle | adidas US", "pos": 2, "url": "https://www.adidas.com/us/superstar-shoes/EG4958.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/superstar-shoes/EG4958.html" }, { "alt": "Adidas Campus 00S Shoes - unisex - Better Scarlet Red / Clear Pink / Cloud White - M 14 / W 15", "pos": 3, "url": "https://www.adidas.com/us/campus-00s-shoes/H03477.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/campus-00s-shoes/H03477.html" } ], "pos_overall": 9 }, "organic": [ { "pos": 1, "url": "https://www.adidas.com/us", "desc": "adidas is about more than sportswear and workout clothes. We partner with the best in the industry to co-create. This way we offer our fans the sporting goods, ...", "title": "adidas Official Website | adidas US", "sitelinks": { "expanded": [ { "url": "https://www.adidas.com/us/women", "title": "Women's Shoes, Clothing and ..." }, { "url": "https://www.adidas.com/us/men-shoes", "title": "Men's Shoes" }, { "url": "https://www.adidas.com/us/men", "title": "Men's Shoes, Clothing and ..." }, { "url": "https://www.adidas.com/us/kids", "title": "Kids' Shoes and Clothing" }, { "url": "https://www.adidas.com/us/originals", "title": "Originals Sneakers & Clothing" } ] }, "url_shown": "https://www.adidas.com› ...", "pos_overall": 2 }, ...

Most popular search engines
City-level SERP data delivery from major search engines.
From $49/month
AI-driven search interfaces
Organic and geo-targeted LLM-generated responses.
Best for:
From $49/month
E-Commerce websites
E-commerce product page scraping with ready-to-use data.
From $49/month
Other websites
Scalable real-time data collection from a majority of websites.
Best for:
From $49/month
Step 1: Put your endpoint URL, API user credentials, and data payload into a single request.
Step 2: Send the request to our API. We'll take care of everything from there – you don't need to do anything else.
Step 3: Get the result either directly from the API or to your chosen cloud storage bucket in HTML, JSON, PNG, XHR, or Markdown.
import requests from pprint import pprint username = "USERNAME" password = "PASSWORD" payload = { "source": "universal", "url": "https://sandbox.oxylabs.io/products/", "geo_location": "United States", } response = requests.request( 'POST', 'https://realtime.oxylabs.io/v1/queries', auth=(username, password), json=payload, ) pprint(response.json())
Render JavaScript-based pages with a single line of code, eliminating the need for complex browser development or automated third-party tools. Set up custom browser instructions and enable Headless Browser to execute mouse clicks, input text, scroll pages, wait for elements to appear, and more.
Effortless JavaScript rendering
Browser instructions execution
Seamless data collection

Leverage Web Scraper API smart features for collecting real-time data.
Proxy management
ML-driven proxy selection and rotation using our premium proxy pool from 195 countries.
Custom parameters
Boost your scraping control with custom headers and cookies at no extra cost.
AI-driven fingerprinting
Unique HTTP headers, JavaScript, and browser fingerprints ensure resilience to dynamic content.
CAPTCHA bypass
Automatic retries and CAPTCHA bypassing for uninterrupted data retrieval.
Response recognition
ML-based recognition and adaptation to various responses, optimizing scraping efficiency.
Continuous scroll support
Set the amount of Google organic search results per SERP to suit your needs.
Scheduler
Automate recurring scraping jobs with desired frequency and receive data to AWS S3 or GCS.

Custom Parser
Define your own parsing logic using XPath or CSS selectors for structured data collection.
"Building and maintaining your own scraping and parsing solution is expensive. That’s why we turned to Oxylabs. They offered one of the best price-to-value combinations in the market and helped us save our total web scraping costs."

Wei Zheng
Chief Product Officer at Conductor

Access valuable e-commerce data, such as pricing, product information, or reviews, on a large scale.

Gather critical data while staying unnoticed by threat actors to make proactive security decisions.

Retrieve public data on a large scale to stop copyright infringement and counterfeiting.

Extract highly localized search engine data to monitor rankings and brand visibility.

Leverage real-time flight and hotel data to shape your travel business strategy with evidence-based insights.
Real-time ticket pricing data
Hotel pricing trends

Bypass anti-bot measures
Get AI-optimized, structured outputs
Collect multimodal web data at scale
Enjoy fully automated, maintenance-free performance

Keep track of your brand and competitor SERP rankings and LLM presence
Get data from Google page types, e.g., search and images
Extract SERP elements like featured snippet and local pack
Optimize SEO & GEO strategies

Technical API documentation
Discover available scraping parameters and explore code examples for specific targets.
Oxylabs GitHub repositories
Learn how to scrape websites, use our tools, integrate products, and more.
Setup guide for Web Scraper API
Quickly integrate our Web Scraper API into your infrastructure.
Pre-configured Web Scraper API endpoints that collect web data and simplify delivery. Each target supports customizable request parameters like location, language, and more.
Universal Source
Universal Source
Parsing available with Oxy Parser
Raw HTML
See how your requests would look with the universal source.
universal
86.9K
Publix
Publix: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Publix search result pages by providing a search term.
publix_search
86.9K
Publix
Publix: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Publix product pages by product ID.
publix_product
86.9K
Publix
Publix: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Publix URL of your choice.
publix
86.9K
Grainger
Grainger: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Grainger search result pages by keyword.
grainger_search
86.9K
Grainger
Grainger: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Grainger product pages by product ID, with support for domain localization across Grainger...
grainger_product
86.9K
Grainger
Grainger: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Grainger page by providing a direct URL.
grainger
86.9K
Allegro
Allegro: Search
Parsing available with Oxy Parser
Raw HTML
See how you should formulate your request to scrape Allegro search result pages.
allegro_search
86.9K
Allegro
Allegro: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Allegro product pages by product ID.
allegro_product
86.9K
Tokopedia
Tokopedia: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Tokopedia search result pages by keyword, with support for pagination.
tokopedia_search
86.9K
Tokopedia
Tokopedia: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Tokopedia page by providing a direct URL.
tokopedia
86.9K
Mercado Livre
Mercado Livre: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Mercado Livre search results using Web Scraper API. Retrieve product listings with simple ...
mercadolivre_search
86.9K
Mercado Livre
Mercado Livre: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Mercado Livre product pages by product ID.
mercadolivre_product
86.9K
Dcard
Dcard
Parsing available with Oxy Parser
Raw HTML
Retrieve Dcard search results using Web Scraper API. Simple integration with code examples for mu...
dcard_search
86.9K
Amazon
Popular
Amazon: Product
Parsed JSON
129 Data Points
Extract Amazon product data effortlessly with Web Scraper API. Access titles, prices, reviews, an...
amazon_product
15.0K
Amazon
Amazon: Search
Parsed JSON
88 Data Points
Scrape Amazon search results with Web Scraper API. Retrieve product titles, prices, ratings & mor...
amazon_search
15.0K
Amazon
Amazon: Pricing
Parsed JSON
23 Data Points
Access Amazon product pricing data with Web Scraper API. Retrieve price listings, discounts, and ...
amazon_pricing
15.0K
Amazon
Amazon: Sellers
Parsed JSON
22 Data Points
Scrape Amazon seller pages with Oxylabs Web Scraper API. Get ratings, feedback, profile data & mo...
amazon_sellers
15.0K
Amazon
Amazon: URL
Parsing available with Oxy Parser
Raw HTML
Scrape Amazon pages by URL with Web Scraper API. Request examples, parsed output, JS rendering, g...
amazon
15.0K
Popular
Google: Web Search
Parsed JSON
269 Data Points
Comprehensive Google Search scraper with parsed data for organic results, ads, snippets, knowledg...
google_search
10.8K
Google: Local Search
Parsing available with Oxy Parser
Raw HTML
Google Local Search API retrieves location-based results for restaurants, hotels, and services wi...
google_maps
10.8K
Google: AI Overviews
Parsed JSON
44 Data Points
Extract Google AI Overviews from search results with parsed data for answer text, bullet lists, p...
google_search
10.8K
Google: URL
Parsing available with Oxy Parser
Raw HTML
Google URL scraper retrieves content from any Google page with ease. Simple integration with code...
10.8K
Walmart
Walmart: Search
Parsed JSON
58 Data Points
Extract Walmart search results with parsed data, including pricing, ratings, seller info, variant...
walmart_search
2.6K
Walmart
Walmart: Product
Parsed JSON
59 Data Points
Extract Walmart product pages by product ID with parsed data including pricing, ratings, seller i...
walmart_product
2.6K
Walmart
Walmart: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Walmart URL of your choice.
walmart
2.6K
eBay
eBay: Search
Parsing available with Oxy Parser
Raw HTML
Scrape eBay search results by keyword, with support for pagination and domain localization across...
ebay_search
2.4K
eBay
eBay: Product
Parsing available with Oxy Parser
Raw HTML
Get eBay product pages by product ID, with support for domain localization across multiple eBay r...
ebay_product
2.4K
eBay
eBay: URL
Parsing available with Oxy Parser
Raw HTML
See how to scrape any eBay URL of your choice.
ebay
2.4K
Google: Lens
Parsed JSON
15 Data Points
Google Lens API extracts visual search results from provided image URLs. Returns visually matchin...
google_lens
2.3K
Aliexpress
Aliexpress: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Aliexpress search result pages by providing a search term.
aliexpress_search
2.2K
Aliexpress
Aliexpress: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Aliexpress product pages by product ID.
aliexpress_product
2.2K
Aliexpress
Aliexpress: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Aliexpress URL of your choice.
aliexpress
2.2K
Zillow
Zillow: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Zillow page by providing a direct URL.
zillow
2.2K
Google: Image Search
Parsed JSON
19 Data Points
Extract Google Image Search results with parsed data, including organic image listings, image URL...
google_search
1.7K
Google: News Search
Parsed JSON
25 Data Points
Scrape Google News results on a large scale and get completely parsed data. Extract articles with...
google_search
1.7K
ChatGPT
ChatGPT
Parsed JSON
17 Data Points
Extract ChatGPT responses by submitting prompts, with parsed data including response text, Markdo...
chatgpt
1.6K
Etsy
Etsy: Search
Parsing available with Oxy Parser
Raw HTML
See how you should formulate your request to scrape Etsy search result pages.
etsy_search
1.5K
Etsy
Etsy: Product
Parsed JSON
29 Data Points
Extract Etsy product page data by product ID, including pricing, images, seller details, reviews,...
etsy_product
1.5K
Etsy
Etsy: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Etsy page by providing a direct URL.
etsy
1.5K
Google: Trends: Explore
Parsing available with Oxy Parser
Raw HTML
Extract Google Trends data by keyword, date range, and category. API supports multiple search typ...
google_trends_explore
1.5K
Google: Ads Max
Parsed JSON
17 Data Points
Scrape Google Search results optimized for maximum paid ad visibility, with parsed data for paid ...
google_ads
1.3K
Lowe's
Lowe's: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Lowe's search results by keyword, with support for store and delivery ZIP localization, an...
lowes_search
1.1K
Lowe's
Lowe's: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Lowe's product pages by product ID, with support for store and delivery ZIP localization.
lowes_product
1.1K
Lowe's
Lowe's: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Lowe's page using a direct URL, with support for store and delivery ZIP code localizat...
lowes
1.1K
Target
Target: Search
Parsed JSON
24 Data Points
Extract Target search results with parsed data for organic listings, including pricing, ratings, ...
target_search
1.1K
Target
Target: Product
Parsed JSON
16 Data Points
Extract Target product pages by product ID with parsed data including pricing, brand, category, d...
target_product
1.1K
Target
Target: Category
Parsing available with Oxy Parser
Raw HTML
Scrape Target category pages by taxonomy node ID, with support for store, fulfillment type, and d...
target_category
1.1K
Best Buy
Best Buy: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Best Buy search results with domain, store, and fulfillment filtering using Web Scraper AP...
bestbuy_search
1.1K
Best Buy
Best Buy: Product
Parsed JSON
17 Data Points
Get Best Buy product details including pricing, ratings, and specifications. Extract parsed or HT...
bestbuy_product
1.1K
Costco
Costco: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Costco search result pages by keyword, with support for pagination and domain localization...
costco_search
859
Costco
Costco: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Costco product pages by product ID, with support for domain localization across multiple C...
costco_product
859
Costco
Costco: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Costco page by providing a direct URL.
costco
859
Alibaba
Alibaba: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Alibaba search result pages by providing a search term.
alibaba_search
851
Alibaba
Alibaba: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Alibaba product pages by product ID.
alibaba_product
851
Alibaba
Alibaba: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Alibaba URL of your choice.
alibaba
851
Bing
Bing: Search
Parsed JSON
22 Data Points
Extract Bing Search results with parsed data for paid ads and organic listings, with support for ...
bing_search
709
Bing
Bing: URL
Parsing available with Oxy Parser
Raw HTML
See how you can start scraping Bing URLs.
bing
709
Google: AI Mode
Parsed JSON
12 Data Points
Extract Google AI Mode responses by submitting prompts, including the full response text, referen...
google_ai_mode
545
Flipkart
Flipkart: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Flipkart search results by keyword, with support for pagination and JavaScript rendering.
flipkart_search
500
Flipkart
Flipkart: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Flipkart product pages by product ID.
flipkart_product
500
Flipkart
Flipkart: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Flipkart page by providing a direct URL.
flipkart
500
Lazada
Lazada: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Lazada search result pages by keyword, with support for pagination and domain localization...
lazada_search
438
Lazada
Lazada: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Lazada product pages by product ID.
lazada_product
438
Lazada
Lazada: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Lazada URL of your choice.
lazada
438
Amazon
Amazon: Best Sellers
Parsed JSON
22 Data Points
Discover Amazon Best Sellers data with Web Scraper API. Collect top-ranking product details, cate...
amazon_bestsellers
400
Google: Travel: Hotels
Parsing available with Oxy Parser
Raw HTML
Scrape Google Travel: Hotels results with guest count, dates, and star rating filters. Flexible A...
google_travel_hotels
328
Perplexity
Perplexity
Parsed JSON
24 Data Points
Extract Perplexity responses by submitting prompts, with parsed data including answer text, Markd...
perplexity
327
Mercado Libre
Mercado Libre: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Mercado Libre search results by keyword.
mercadolibre_search
261
Mercado Libre
Mercado Libre: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Mercado Libre product pages by product ID, with support for domain localization across mul...
mercadolibre_product
261
Mercado Libre
Mercado Libre: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Mercado Libre page by providing a direct URL.
mercadolibre
261
Kroger
Kroger: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Kroger product page data including pricing, availability, and fulfillment options using pr...
kroger_product
253
Kroger
Kroger: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Kroger search pages with filters for price range, brand, and store location. Retrieve orga...
kroger_search
253
Kroger
Kroger: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Kroger page via a direct URL, supporting store-specific results, delivery ZIP codes, a...
kroger
253
MediaMarkt
MediaMarkt: Search
Parsing available with Oxy Parser
Raw HTML
See how you should formulate your request to scrape MediaMarkt search results.
mediamarkt_search
235
MediaMarkt
MediaMarkt: Product
Parsing available with Oxy Parser
Raw HTML
Scrape MediaMarkt product pages by product ID.
mediamarkt_product
235
MediaMarkt
MediaMarkt: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any MediaMarkt URL of your choice.
mediamarkt
235
TikTok
TikTok: Shop Search
Parsing available with Oxy Parser
Raw HTML
Scrape TikTok Shop search result pages by keyword.
tiktok_shop_search
166
TikTok
TikTok: Shop Product
Parsing available with Oxy Parser
Raw HTML
Get TikTok Shop product pages by product ID.
tiktok_shop_product
166
TikTok
TikTok: Shop URL
Parsing available with Oxy Parser
Raw HTML
Scrape any TikTok Shop page by providing a direct URL.
tiktok
166
IndiaMART
IndiaMART: Search
Parsing available with Oxy Parser
Raw HTML
Scrape IndiaMART search result pages by providing a search term.
indiamart_search
64
IndiaMART
IndiaMART: Product
Parsing available with Oxy Parser
Raw HTML
Scrape IndiaMART product pages by product ID.
indiamart_product
64
IndiaMART
IndiaMART: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any IndiaMART URL of your choice.
indiamart
64
Falabella
Falabella: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Falabella search results by keyword, with support for pagination.
falabella_search
64
Falabella
Falabella: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Falabella product pages by product ID.
falabella_product
64
Falabella
Falabella: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Falabella page by providing a direct URL.
falabella
64
Airbnb
Airbnb: Homes
Parsing available with Oxy Parser
Raw HTML
Scrape Airbnb property listings by ID.
airbnb_product
59
Airbnb
Airbnb: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Airbnb URL of your choice (homes, experiences, services).
airbnb
59
Magazine Luiza
Magazine Luiza: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Magazine Luiza search result pages by providing a search term.
magazineluiza_search
51
Magazine Luiza
Magazine Luiza: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Magazine Luiza product pages by product ID.
magazineluiza_product
51
Magazine Luiza
Magazine Luiza: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Magazine Luiza URL of your choice.
magazineluiza
51
Instacart
Instacart: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Instacart search result pages by providing a search term.
instacart_search
44
Instacart
Instacart: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Instacart product pages by product ID.
instacart_product
44
Instacart
Instacart: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Instacart URL of your choice.
instacart
44
Bodega Aurrerá
Bodega Aurrerá: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Bodega Aurrerá search result pages by providing a search term.
bodegaaurrera_search
38
Bodega Aurrerá
Bodega Aurrerá: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Bodega Aurrerá product pages by product ID.
bodegaaurrera_product
38
Bodega Aurrerá
Bodega Aurrerá: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Bodega Aurrerá URL of your choice.
bodegaaurrera
38
Menards
Menards: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Menards search result pages by providing a search term.
menards_search
37
Menards
Menards: Product
Parsing available with Oxy Parser
Raw HTML
See how to scrape Menards product pages by product ID.
menards_product
37
Menards
Menards: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Menards URL of your choice.
menards
37
Avnet
Avnet
Parsing available with Oxy Parser
Raw HTML
See how you can start formulating Avnet scraping requests.
avnet_search
33
Petco
Petco: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Petco search result pages by keyword, with support for pagination, store selection, and fu...
petco_search
32
Petco
Petco: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Petco page by providing a direct URL, with support for store-specific results.
petco
32
Cdiscount
Cdiscount: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Cdiscount search result pages by keyword, with support for pagination.
cdiscount_search
32
Cdiscount
Cdiscount: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Cdiscount product pages by product ID.
cdiscount_product
32
Cdiscount
Cdiscount: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Cdiscount page by providing a direct URL.
cdiscount
32
Bed Bath & Beyond
Bed Bath & Beyond: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Bed Bath & Beyond search result pages by providing a search term.
bedbathandbeyond_search
30
Bed Bath & Beyond
Bed Bath & Beyond: Product
Parsing available with Oxy Parser
Raw HTML
Scrape Bed Bath & Beyond product pages by product ID.
bedbathandbeyond_product
30
Bed Bath & Beyond
Bed Bath & Beyond: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Bed Bath & Beyond URL of your choice.
bedbathandbeyond
30
Staples
Staples
Parsing available with Oxy Parser
Raw HTML
Scrape Staples search result pages by keyword, with support for pagination and domain localizatio...
staples_search
30
Rakuten
Rakuten: Search
Parsing available with Oxy Parser
Raw HTML
Scrape Rakuten search result pages by keyword.
rakuten_search
28
Rakuten
Rakuten: URL
Parsing available with Oxy Parser
Raw HTML
Scrape any Rakuten page by providing a direct URL.
rakuten
28
Oxylabs' web scraping services include an all-in-one web scraping solution tailored to suit a specific niche of data extraction, such as collecting information from e-commerce websites, search engines, and other targets.
The web services provide a complete infrastructure developed to simplify data extraction with generalized commands, automatic data structurization (parsing), simple data delivery, and a full range of auxiliary tools like Scheduler, Custom browser instructions, OxyCopilot, and more.
If you're curious, you can find more information, such as tutorials or guides, in our blog – whether it is an API for dummies guide, a more in-depth coding tutorial, or a step-by-step walkthrough on building a JavaScript web scraper using Node.js and Puppeteer. You can also explore our recommended web scraping tools to enhance your data extraction setup.
The best coding language for web scraping depends on many factors, including your specific requirements, existing skill set, and the complexity of the task at hand. Python is often considered the best language for web scraping due to its wide variety of dedicated libraries and ease of use, making it the top choice for beginners and professionals alike.
The legality of web scraping depends on the website's terms of service, the nature of the data, and your jurisdiction. Always review the website’s terms and consult with a legal professional to ensure compliance with relevant laws and regulations.
Web Scraper API can return data in multiple formats for various use cases. You can retrieve:
Raw HTML: complete, unprocessed HTML of a web page.
Parsed JSON: structured HTML data.
Web page PNG: screenshot of the rendered web page.
XHR/Fetch requests: data from asynchronous requests made during page load.
Markdown: lightweight, easy-to-read format, ideal for LLMs and AI workflows.
Get the latest news from data gathering world
Scale up your business with Oxylabs®
Proxies
Advanced proxy solutions
Data Collection
Datasets
Resources
Innovation hub