Get Real-Time Search Data With SERP Scraper API

  • Pay only for successfully delivered results

  • Get coordinate-level precision data

  • Scrape SERP features with no hidden fees

See it in action

*This scraper is part of Web Scraper API.

Dive into code samples

Discover parameter tables for scraping the most popular search engines. View input and output through code snippets and HTML previews.

Input parameters

source

Scraper

Set the scraper to 'google_search' to get web, image, or news search results. (Other sources: 'google', 'google_ads', 'google_images', 'google_lens', 'google_maps', 'google_travel_hotels', 'google_suggest', 'google_trends_explore')

query

Search query

Input UTF-encoded search query.

geo_location

Localization

Specify the UULE-based geographic location value. (State name, Country name, Coordinates and Radius, Criteria ID)

domain

Google domain

Specify Google domain you want to scrape.

locale

Interface language

Set the interface language.

results_language

Results language

Set the results language.

render

JavaScript rendering

Enable to load JavaScript-based content.

parse

Structured data

Enable to get structured data.

Input

Output

Copy

import requests
from pprint import pprint
username = "USERNAME"
password = "PASSWORD"
# Structure payload.
payload = {
    "source": "google_search",
    "query": "adidas",
    "domain": "com",
    "geo_location": "California,United States",
    "parse": True
}
# Take a free trial or buy the product on our dashboard to create an API user.
# Replace 'USERNAME' and 'PASSWORD' with your API credentials to run this request.
# Get response by using real-time endpoint.
response = requests.request(
    'POST',
'https://realtime.oxylabs.io/v1/queries',
    auth=(username, password),
    json=payload,
)
# Print prettified response to stdout.
pprint(response.json())

See full code

...
"content": {
    "url": "https://www.google.com/search?q=adidas&filter=1&safe=off&uule=w+CAIQICIYQ2FsaWZvcm5pYSxVbml0ZWQgU3RhdGVz&gl=us&hl=en",
    "page": 1,
    "results": {
        "paid": [
            {
                "pos": 1,
                "url": "https://www.adidas.com/us",
                "desc": "Sign Up For adiClub To Get Free Standard Shipping And Start Earning Points On Every Order. Shop The adidas® Official Site. Join Our adiClub Loyalty Program. Sign Up & Get 15% Off. Gift Cards Available. View Size Charts. Free Shipping Available.",
                "title": "adidas® Official Website | Place Your Order Today | adidas US",
                "data_rw": "https://www.google.com/aclk?sa=l&ai=DChcSEwjJ_POllYCGAxW_VEgAHe29DH0YABAAGgJjZQ&ae=2&gclid=EAIaIQobChMIyfzzpZWAhgMVv1RIAB3tvQx9EAAYASAAEgKwcfD_BwE&sig=AOD64_2LcoUnvekUgtnHdwRH-W1AE5U96g&q&adurl",
                "sitelinks": {
                    "expanded": [
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men"
                        },
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men's Collection"
                        }
                    ]
                },
                "url_shown": "https://www.adidas.com",
                "pos_overall": 1
            }
        ],
        "images": {
            "items": [
                {
                    "alt": "adidas Superstar Shoes - Black | Unisex Lifestyle | adidas US",
                    "pos": 1,
                    "url": "https://www.adidas.com/us/superstar-shoes/EG4959.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/superstar-shoes/EG4959.html"
                },
                {
                    "alt": "adidas Superstar Shoes - White | Unisex Lifestyle | adidas US",
                    "pos": 2,
                    "url": "https://www.adidas.com/us/superstar-shoes/EG4958.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/superstar-shoes/EG4958.html"
                },
                {
                    "alt": "Adidas Campus 00S Shoes - unisex - Better Scarlet Red / Clear Pink / Cloud White - M 14 / W 15",
                    "pos": 3,
                    "url": "https://www.adidas.com/us/campus-00s-shoes/H03477.html",
                    "data": "data:image/gif;base64,R0lGODlhAQABAIAAAP///////yH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==",
                    "source": "https://www.adidas.com/us/campus-00s-shoes/H03477.html"
                }
            ],
            "pos_overall": 9
        },
        "organic": [
            {
                "pos": 1,
                "url": "https://www.adidas.com/us",
                "desc": "adidas is about more than sportswear and workout clothes. We partner with the best in the industry to co-create. This way we offer our fans the sporting goods, ...",
                "title": "adidas Official Website | adidas US",
                "sitelinks": {
                    "expanded": [
                        {
                            "url": "https://www.adidas.com/us/women",
                            "title": "Women's Shoes, Clothing and ..."
                        },
                        {
                            "url": "https://www.adidas.com/us/men-shoes",
                            "title": "Men's Shoes"
                        },
                        {
                            "url": "https://www.adidas.com/us/men",
                            "title": "Men's Shoes, Clothing and ..."
                        },
                        {
                            "url": "https://www.adidas.com/us/kids",
                            "title": "Kids' Shoes and Clothing"
                        },
                        {
                            "url": "https://www.adidas.com/us/originals",
                            "title": "Originals Sneakers & Clothing"
                        }
                    ]
                },
                "url_shown": "https://www.adidas.com› ...",
                "pos_overall": 2
            },
...

Try SERP Scraper API out for yourself

Discover Scraper APIs Playground on Oxylabs dashboard for a firsthand interaction with our APIs, and explore technical documentation for all the information you need.

Collect timely data from leading search engines

Use SERP Scraper API to collect timely and reliable search results data from the most popular search engines. Receive either HTML or structured JSON data with both organic and paid results.

OxyCopilot

Simplify SERP scraping workflows with OxyCopilot

OxyCopilot is your AI-driven assistant designed to effortlessly generate codes for scraping requests and parsing instructions, minimising manual coding from SERP data extraction:

  • Use Scraper API Playground

  • Enter your prompt

  • Instantly get ready-to-use code

Scrape SERP features and get parsed data

Retrieve structured data from Google SERP, Google Images, and Google News search engines. Explore a comprehensive array of search elements that you can scrape:

No geo-restrictions

Access search results from any location

Unlock localized search engine data effortlessly, wherever you are, and in any language you need.

  • Localized search results from 195 countries

  • Country, state, city, or even coordinate-level targeting

Try SERP Scraper API with free 5k results

Advanced features

Leverage SERP Scraper API smart features for collecting real-time data.

Proxy management

ML-driven proxy selection and rotation using our premium proxy pool from 195 countries.

Headless Browser

Render JavaScript with a single line of code, skipping complex browser development.

AI-driven fingerprinting

Unique HTTP headers, JavaScript, and browser fingerprints ensure resilience to dynamic content.

CAPTCHA bypass

Automatic retries and CAPTCHA bypassing for uninterrupted data retrieval.

Response recognition

ML-based recognition and adaptation to various responses, optimizing scraping efficiency.

Continuous scroll support

Set the amount of Google organic search results per SERP to suit your needs.

Scheduler

Automate recurring scraping jobs with desired frequency and receive data to AWS S3 or GCS.

Custom Parser

Define your own parsing logic using XPath or CSS selectors for structured data collection.

Best SERP API with the market’s highest ad rate

Easily access localized Google ad results for any keyword by selecting just a few parameters. SERP Scraper API, boasting a 2.7 times higher ad scraping rate than the industry average, will give you the edge to stay ahead of the competition.

  • 100% Google success rate

  • 6.04 seconds avg. response time

Learn more
SERP Scraper API

Get a maintenance-free scraping infrastructure

Benefit from our top-tier search results data collection infrastructure that is ready-to-use straight away.

  • No need for custom scrapers, parsers, or browsers

  • Let us handle CAPTCHAs and overcome IP blocks for you

  • Allocate your resources towards analyzing data

Simple integration

Step 1: Put your endpoint URL, API user credentials, and data payload into a single request.

Step 2: Send this request to our API. We'll take care of everything from there – you don't need to do anything else.

Step 3: Get the result back either directly from the API or store it in your chosen cloud storage bucket.

API reference

Copy

import requests
from pprint import pprint

username = "USERNAME"
password = "PASSWORD"

payload = {
    "source": "google_search",
    "query": "adidas",
    "domain": "com",
    "geo_location": "California,United States",
    "parse": True,
}

response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=(username, password),
    json=payload,
)

pprint(response.json())
    

What do others say?

"Building and maintaining your own scraping and parsing solution is expensive. That’s why we turned to Oxylabs. They offered one of the best price-to-value combinations in the market and helped us save our total web scraping costs."

Wei Zheng

Chief Product Officer at Conductor

Read full story
More customer stories

Pricing

Regular
Enterprise

Pay only for successful results

No hidden fees

Save time and development costs

Don’t miss out

Free trial

0

1 week trial

Limited to 1 user

Micro

49

$2.00 / 1K results

$49 + VAT billed monthly

Starter

99

$1.80 / 1K results

$99 + VAT billed monthly

Advanced

249

$1.65 / 1K results

$249 + VAT billed monthly

Results
5000

24,500

55,000

151,000

Rate Limit

10 requests / s

50 requests / s
50 requests / s
50 requests / s
Premium Proxies
AI-Powered Web Scraping
JavaScript Rendering
Dedicated Account Manager

10% off

Yearly plans discount

For all our plans by paying yearly. Contact sales to learn more.

We accept these payment methods:

Frequently asked questions

What is SERP scraping?

SERP scraping is a term used to describe the process of gathering public search results data from SERPs (Search Engine Results Pages) for various applications such as keyword research, SEO monitoring, and digital advertising.

Read more

What are the common use cases for SERP Scraper API?

SERP Scraper API enables real-time data extraction from top search engines, supporting tasks like SEO analysis, market research, and competitor tracking. Users can monitor search trends, analyze rankings, and refine strategies for content and advertising. Whether finding valuable keywords, understanding user behavior, or managing online reputation, the API is a versatile tool for informed decision-making in the ever-changing world of search engine results.

How long does SERP API take to deliver results?

SERP API delivers results in real time. On average, it takes less than 10 seconds. For additional information, contact our support team at support@oxylabs.io or via the live chat on our website. 

Does SERP Scraper API support Google Search continuous scroll?

Our SERP Scraper API comes equipped with full support for Google Search continuous scroll. With the automatic detection of continuous scrolling layouts, you can rest assured that the API will efficiently load the requested amount of organic results without requiring you to send any extra parameters.

Read more on how to handle continuous scroll in web scraping here.

Can SERP Scraper API render JavaScript?

Yes. This is necessary in some Google services, such as Travel. This advanced functionality ensures comprehensive data retrieval, allowing users to delve into the dynamic and interactive aspects of web content.

Do you offer customized solutions?

To explore customized solutions, please fill out the contact form available in the footer or contact us at hello@oxylabs.io.

How are results calculated?

Results encompass individual entities of content, such as web page HTML, successfully retrieved from the web. Only results from the target site with 2xx or 4xx status codes are considered successful, while all others are deemed unsuccessful. Billing is based on the number of results with successfully extracted data. For further details, please refer to our billing information.

Get the latest news from data gathering world

I'm interested