Oxylabs Web Scraper API Expands With 30 New Parametrized Sources

We’ve updated our Web Scraper API with 30 new parametrized sources for the most popular e-commerce scraping targets. The new sources allow you to briefly describe scraping parameters for complex websites that have historically required extensive configuration and maintenance.

Instead of manually crafting URLs and handling headers and cookies, you can now rely on built-in URL constructors and source-specific scraping logic. Such automation significantly improves reliability when dealing with CAPTCHAs and dynamic content.

You can try new sources with a one-week free trial with 5K results using the Scraper API Playground.

Parametrized sources

Parametrized sources are tailor-made inputs, such as search terms, store IDs, or ZIP codes, replacing full URLs and custom HTTP request configurations.

Simplified requests

Usually, for web scraping, you have to:

• Construct and validate URLs manually

• Configure domain-specific HTTP headers 

• Manage domain-specific cookies

The parametrized sources remove these requirements by encapsulating site-specific logic within the API infrastructure. Web Scraper API handles these elements automatically to get structured data faster.

You can now execute complex queries for more targets with minimal payload.

payload = {
   'source': 'bestbuy_search',
   'query': 'iphone 14',
   'domain': 'com'
}

All available sources

The update adds many new e-commerce sources across Asia, Europe, and the Americas, along with expansions to legacy scraping targets, such as search engines.

Each source is optimized for a specific site for better success rates, cleaner results, and reduced need for custom logic.

The new sources feature advanced capabilities of Web Scraper API:

• JavaScript rendering

• Built-in proxy management

• Headless browser support

• CAPTCHA bypass

• Custom parsing, job scheduling, and web crawling

• Cloud storage delivery

• OxyCopilot for code generation

• Playground access

Focus on data, not infrastructure

Web Scraper API is built to handle vast amounts of data, enabling you to focus on what matters most – data and its analysis  – leaving extraction to us. In turn, you can spend less time debugging and maintaining scraping scripts.

We continuously monitor and update each parametrized source to maintain optimal data extraction:

• CAPTCHA solving, anti-bot fingerprinting, and retries are maintained per source.

• Cleaner data with higher success rates thanks to target-specific strategies.

Summary

The update provides immediate benefits in development efficiency for technical teams seeking to optimize their data collection architecture. With expanded sources, you can redirect engineering resources from infrastructure maintenance to data analysis.

Detailed parameters, codes, and explanations are available in our documentation.

For any questions, contact us via support@oxylabs.io or the live chat.