How to Set Up a Proxy Server on Screaming Frog

What is Screaming Frog?

Screaming Frog is a platform designed to scrape public web data for SEO-related purposes. It's available on macOS, Linux, and Windows devices. The tool offers public data scraping from up to 500 URLs; if you need more, you’ll need to upgrade to a bigger plan. 

Here are some common SEO-related initiatives professionals use this tool for: 

• Redirect searches

• Broken link searches

• Content duplicate searches

• Metadata analysis

• Site architecture analysis

Screaming Frog SEO Spider proxy integration 

Before starting with the integration, download and install the program. If you have the paid version, navigate to the menu bar above and click Licence > Enter Licence. 

Enterprise Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via sales.

Address: 1.2.3.4 (a specific IP address)

Port: 60000

You’ll have to choose an IP address from the acquired list. Visit our documentation for more details.

Self-Service Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via the dashboard.

Address: ddc.oxylabs.io

Port: 8001

Here, the port indicates the sequential number of an IP address from the acquired list. Check our documentation for more details.

Shared Datacenter Proxies

Address: dc.pr.oxylabs.io

Port: 10000

You can also use a country-specific entry. For example, entering dc.ca-pr.oxylabs.io under Address and 34000 under Port will acquire a Canadian exit node. Please refer to our documentation for a complete list of country-specific entry nodes.

3. Click OK and Restart to complete the proxy setup.

4. Upon starting a new crawling job, you'll be asked to enter your Oxylabs proxy user’s credentials. Use the same username and password you entered to create a new proxy user in the Oxylabs dashboard.