How to Use Cursor IDE With Web Scraping Tools

What is Cursor AI?

Cursor is an Integrated Development Environment (IDE) that speeds up coding processes with AI-driven code generation, intelligent auto-completion, seamless code refactoring, and natural language search across your codebase — all within a familiar VS Code-like editor.

Set up Cursor and Oxylabs account

Before moving forward, make sure you have completed the following steps:

Download Cursor from the official website, install it on your device, and sign in to your account.
Get user credentials for Oxylabs Web Scraper API or Web Unblocker.

7-day free trial

No credit card needed
Web Scraper API – 5K results
Web Unblocker – 1 GB of traffic

Quick overview of Oxylabs MCP

Installation methods

Via uvx: The most stable option that enables direct API calls.
Via Smithery CLI: Uses Smithery CLI to call the MCP server hosted in Smithery.
Using a Local/Dev setup: Host the MCP server locally in your environment.

Currently available tools

oxylabs_universal_scraper: Scrapes any public website URL you provide.
oxylabs_google_search_scraper: Scrapes Google search results by search term.
oxylabs_amazon_search_scraper: Scrapes Amazon search results by search term.
oxylabs_amazon_product_scraper: Scrapes Amazon product details by ASIN.
oxylabs_web_unblocker: Uses an AI-driven proxy solution and returns HTML.

Installing via uvx

1. Install uv

uvx is part of the uv package. To install it, follow this official guide and pick the method that works best for you. For instance, on macOS devices, you can use Homebrew, among other methods:

brew install uv

Next, check whether uvx installed successfully:

uvx -V

2. Configure MCP

In your Cursor app, head to Settings → MCP → Add new global MCP server.

This will open the mcp.json file where you can paste the following Oxylabs MCP configuration:

{
  "mcpServers": {
    "oxylabs_scraper_uvx": {
      "command": "uvx",
      "args": ["oxylabs-mcp"],
      "env": {
        "OXYLABS_USERNAME": "YOUR_USERNAME",
        "OXYLABS_PASSWORD": "YOUR_PASSWORD"
      }
    }
  }
}

Replace YOUR_USERNAME and YOUR_PASSWORD with the API or Web Unblocker user's credentials.

3. Test your setup

Open the chat box, select the Agent mode, and run a test prompt, for example:

Search Google for "best AI agent frameworks" and summarize results

Installing via Smithery CLI

1. Install Node.js

Install Node.js version 16 or higher to ensure compatibility.

After that, verify that npx is available on your system by running a simple version check:

npx -v

2. Configure MCP

Open the Cursor app’s terminal and automatically install the Oxylabs MCP server using Smithery CLI:

npx -y @smithery/cli install @oxylabs/oxylabs-mcp --client cursor

Then, enter your Web Scraper API or Web Unblocker credentials as prompted.

3. Verify the setup

Go to Settings → MCP where you should see the oxylabs-mcp card added to this window. Make sure there are no errors and that you see a green dot next to the card's name.

4. Run a test prompt

Open the chat window, select the Agent mode, and submit your prompt, for example:

Search Google for "best AI agent frameworks" and summarize results

After successful integration, you can start using Oxylabs solutions in Cursor for advanced cases, such as quickly creating an LLM training set:

Scrape https://en.wikipedia.org/wiki/Miss_Meyers without additional parameters and create a production-quality JSON training set with detailed metadata following LLM training best practices. Don't summarize the content, use full text from the MD file.

Wrap up

Visit Oxylabs MCP GitHub repository to find comprehensive details about our MCP server, including setup instructions for Claude Desktop or Local/Dev configuration. Eager to expand your AI toolkit? Check out these specialized tutorials:

Our team is always ready to assist with any questions about our solutions – simply connect with us through email or live chat.

Please be aware that this is a third-party tool not owned or controlled by Oxylabs. Each third-party provider is responsible for its own software and services. Consequently, Oxylabs will have no liability or responsibility to you regarding those services. Please carefully review the third party's policies and practices and/or conduct due diligence before accessing or using third-party services.