Get Real-Time Search Data With SERP Scraper API
Pay only for successfully delivered results
Get coordinate-level precision data
Scrape SERP features with no hidden fees
*This scraper is part of Web Scraper API.
Pay only for successfully delivered results
Get coordinate-level precision data
Scrape SERP features with no hidden fees
*This scraper is part of Web Scraper API.
Discover parameter tables for scraping the most popular search engines. View input and output through code snippets and HTML previews.
Input parameters
source
Scraper
Set the scraper to 'google_search' to get web, image, or news search results. (Other sources: 'google', 'google_ads', 'google_images', 'google_lens', 'google_maps', 'google_travel_hotels', 'google_suggest', 'google_trends_explore')
query
Search query
Input UTF-encoded search query.
geo_location
Localization
Specify the UULE-based geographic location value. (State name, Country name, Coordinates and Radius, Criteria ID)
domain
Google domain
Specify Google domain you want to scrape.
locale
Interface language
Set the interface language.
results_language
Results language
Set the results language.
render
JavaScript rendering
Enable to load JavaScript-based content.
parse
Structured data
Enable to get structured data.
Input
Output
Copy
import requests from pprint import pprint username = "USERNAME" password = "PASSWORD" # Structure payload. payload = { "source": "google_search", "query": "adidas", "domain": "com", "geo_location": "California,United States", "parse": True } # Take a free trial or buy the product on our dashboard to create an API user. # Replace 'USERNAME' and 'PASSWORD' with your API credentials to run this request. # Get response by using real-time endpoint. response = requests.request( 'POST', 'https://realtime.oxylabs.io/v1/queries', auth=(username, password), json=payload, ) # Print prettified response to stdout. pprint(response.json())
See full code
... "content": { "url": "https://www.google.com/search?q=adidas&filter=1&safe=off&uule=w+CAIQICIYQ2FsaWZvcm5pYSxVbml0ZWQgU3RhdGVz&gl=us&hl=en", "page": 1, "results": { "paid": [ { "pos": 1, "url": "https://www.adidas.com/us", "desc": "Sign Up For adiClub To Get Free Standard Shipping And Start Earning Points On Every Order. Shop The adidas® Official Site. Join Our adiClub Loyalty Program. Sign Up & Get 15% Off. Gift Cards Available. View Size Charts. Free Shipping Available.", "title": "adidas® Official Website | Place Your Order Today | adidas US", "data_rw": "https://www.google.com/aclk?sa=l&ai=DChcSEwjJ_POllYCGAxW_VEgAHe29DH0YABAAGgJjZQ&ae=2&gclid=EAIaIQobChMIyfzzpZWAhgMVv1RIAB3tvQx9EAAYASAAEgKwcfD_BwE&sig=AOD64_2LcoUnvekUgtnHdwRH-W1AE5U96g&q&adurl", "sitelinks": { "expanded": [ { "url": "https://www.adidas.com/us/men", "title": "Men" }, { "url": "https://www.adidas.com/us/men", "title": "Men's Collection" } ] }, "url_shown": "https://www.adidas.com", "pos_overall": 1 } ], "images": { "items": [ { "alt": "adidas Superstar Shoes - Black | Unisex Lifestyle | adidas US", "pos": 1, "url": "https://www.adidas.com/us/superstar-shoes/EG4959.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/superstar-shoes/EG4959.html" }, { "alt": "adidas Superstar Shoes - White | Unisex Lifestyle | adidas US", "pos": 2, "url": "https://www.adidas.com/us/superstar-shoes/EG4958.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/superstar-shoes/EG4958.html" }, { "alt": "Adidas Campus 00S Shoes - unisex - Better Scarlet Red / Clear Pink / Cloud White - M 14 / W 15", "pos": 3, "url": "https://www.adidas.com/us/campus-00s-shoes/H03477.html", "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==", "source": "https://www.adidas.com/us/campus-00s-shoes/H03477.html" } ], "pos_overall": 9 }, "organic": [ { "pos": 1, "url": "https://www.adidas.com/us", "desc": "adidas is about more than sportswear and workout clothes. We partner with the best in the industry to co-create. This way we offer our fans the sporting goods, ...", "title": "adidas Official Website | adidas US", "sitelinks": { "expanded": [ { "url": "https://www.adidas.com/us/women", "title": "Women's Shoes, Clothing and ..." }, { "url": "https://www.adidas.com/us/men-shoes", "title": "Men's Shoes" }, { "url": "https://www.adidas.com/us/men", "title": "Men's Shoes, Clothing and ..." }, { "url": "https://www.adidas.com/us/kids", "title": "Kids' Shoes and Clothing" }, { "url": "https://www.adidas.com/us/originals", "title": "Originals Sneakers & Clothing" } ] }, "url_shown": "https://www.adidas.com› ...", "pos_overall": 2 }, ...
OxyCopilot is your AI-driven assistant designed to effortlessly generate codes for scraping requests and parsing instructions, minimising manual coding from SERP data extraction:
Use Scraper API Playground
Enter your prompt
Instantly get ready-to-use code
Retrieve structured data from Google SERP, Google Images, and Google News search engines. Explore a comprehensive array of search elements that you can scrape:
Unlock localized search engine data effortlessly, wherever you are, and in any language you need.
Localized search results from 195 countries
Country, state, city, or even coordinate-level targeting
Try SERP Scraper API with free 5k results
Leverage SERP Scraper API smart features for collecting real-time data.
Proxy management
ML-driven proxy selection and rotation using our premium proxy pool from 195 countries.
Headless Browser
Render JavaScript with a single line of code, skipping complex browser development.
AI-driven fingerprinting
Unique HTTP headers, JavaScript, and browser fingerprints ensure resilience to dynamic content.
CAPTCHA bypass
Automatic retries and CAPTCHA bypassing for uninterrupted data retrieval.
Response recognition
ML-based recognition and adaptation to various responses, optimizing scraping efficiency.
Continuous scroll support
Set the amount of Google organic search results per SERP to suit your needs.
Scheduler
Automate recurring scraping jobs with desired frequency and receive data to AWS S3 or GCS.
Custom Parser
Define your own parsing logic using XPath or CSS selectors for structured data collection.
Easily access localized Google ad results for any keyword by selecting just a few parameters. SERP Scraper API, boasting a 2.7 times higher ad scraping rate than the industry average, will give you the edge to stay ahead of the competition.
100% Google success rate
6.04 seconds avg. response time
Benefit from our top-tier search results data collection infrastructure that is ready-to-use straight away.
No need for custom scrapers, parsers, or browsers
Let us handle CAPTCHAs and overcome IP blocks for you
Allocate your resources towards analyzing data
Step 1: Put your endpoint URL, API user credentials, and data payload into a single request.
Step 2: Send this request to our API. We'll take care of everything from there – you don't need to do anything else.
Step 3: Get the result back either directly from the API or store it in your chosen cloud storage bucket.
Copy
import requests from pprint import pprint username = "USERNAME" password = "PASSWORD" payload = { "source": "google_search", "query": "adidas", "domain": "com", "geo_location": "California,United States", "parse": True, } response = requests.request( 'POST', 'https://realtime.oxylabs.io/v1/queries', auth=(username, password), json=payload, ) pprint(response.json())
"Building and maintaining your own scraping and parsing solution is expensive. That’s why we turned to Oxylabs. They offered one of the best price-to-value combinations in the market and helped us save our total web scraping costs."
Wei Zheng
Chief Product Officer at Conductor
Pay only for successful results
No hidden fees
Save time and development costs
0
1 week trial
Limited to 1 user
49
$2.00 / 1K results
$49 + VAT billed monthly
99
$1.80 / 1K results
$99 + VAT billed monthly
249
$1.65 / 1K results
$249 + VAT billed monthly
24,500
55,000
151,000
10 requests / s
10% off
Yearly plans discount
For all our plans by paying yearly. Contact sales to learn more.
We accept these payment methods:
Technical API documentation
Discover available scraping parameters and explore code examples for specific targets.
Oxylabs Github repositories
Learn how to scrape websites, use our tools, integrate products, and more.
Setting up API
Quickly integrate and start using API with our quick start guide.
SERP scraping is a term used to describe the process of gathering public search results data from SERPs (Search Engine Results Pages) for various applications such as keyword research, SEO monitoring, and digital advertising.
SERP Scraper API enables real-time data extraction from top search engines, supporting tasks like SEO analysis, market research, and competitor tracking. Users can monitor search trends, analyze rankings, and refine strategies for content and advertising. Whether finding valuable keywords, understanding user behavior, or managing online reputation, the API is a versatile tool for informed decision-making in the ever-changing world of search engine results.
SERP API delivers results in real time. On average, it takes less than 10 seconds. For additional information, contact our support team at support@oxylabs.io or via the live chat on our website.
Our SERP Scraper API comes equipped with full support for Google Search continuous scroll. With the automatic detection of continuous scrolling layouts, you can rest assured that the API will efficiently load the requested amount of organic results without requiring you to send any extra parameters.
Read more on how to handle continuous scroll in web scraping here.
Yes. This is necessary in some Google services, such as Travel. This advanced functionality ensures comprehensive data retrieval, allowing users to delve into the dynamic and interactive aspects of web content.
To explore customized solutions, please fill out the contact form available in the footer or contact us at hello@oxylabs.io.
Results encompass individual entities of content, such as web page HTML, successfully retrieved from the web. Only results from the target site with 2xx or 4xx status codes are considered successful, while all others are deemed unsuccessful. Billing is based on the number of results with successfully extracted data. For further details, please refer to our billing information.
Get the latest news from data gathering world
Scale up your business with Oxylabs®