How to Set Up Proxies With Octoparse

3. Type the URL of the webpage you intend to extract data from in the URL Input and click Save. Let's use Oxylabs scraping sandbox as an example.

4. After your selected URL loads, go to Task Settings > Anti-blocking. Now, check Access websites via proxies, enable Use my own proxies, and click Configure.

5. Configure your Oxylabs proxies by specifying the following format:

IP/host:port:username:password

Residential Proxies

IP/host: pr.oxylabs.io

Port: 7777

You can also use country-specific entries. For example, entering ie-pr.oxylabs.io under IP/host and 25000 under Port will acquire an Irish exit node. Please refer to our documentation for a complete list of country-specific entry nodes or if you need a sticky session.

Enterprise Dedicated Datacenter Proxies

IP/host: a specific IP address (e.g., 1.2.3.4)

Port: 60000

For Enterprise Dedicated Datacenter Proxies, you’ll have to choose an IP address from the acquired list. Visit our documentation for more details.

Self-Service Dedicated Datacenter Proxies

IP/host: ddc.oxylabs.io

Port: 8001

For Self-Service Dedicated Datacenter Proxies, the port indicates the sequential number of an IP address from the acquired list. Check our documentation for more details.

Datacenter Proxies

IP/host: dc.oxylabs.io

Port: 8001

For the Pay-per-IP subscription, the port corresponds to the sequential number assigned to an IP address from the provided list. Hence, port 8001 uses the first IP address on your list. See our documentation for further details.

For the Pay-per-traffic subscription, port 8001 randomly selects an IP address but remains consistent throughout a session. You can also specify geo-location, such as the US, in the user authentication string: user-USERNAME-country-US:PASSWORD. For more details, see our documentation.

ISP Proxies

IP/host: isp.oxylabs.io

Port: 8001

6. Depending on whether you use a rotating or sticky session type, set up the Switch interval.

7. Enter your Oxylabs proxy user’s credentials. Use the same username and password you entered to create a new proxy user in the Oxylabs dashboard.

Proxies are now set up.

2. Set up pagination to scrape multiple pages. This particular website uses numbered pages, prompting you to choose Next page button.

3. Choose the exact button in the page layout that opens the following page – Forward – to automate pagination.

4. Complete the scraping setup and press ▶Run.

5. Choose Run on your device with Standard Mode to receive data as a file on your PC.

6. Let the scraping process run until complete. The process will be over when the final product page is reached or when you stop it manually.

7. Extract the collected data and select the file format.

Here's the final result in a spreadsheet.

That’s it – you are all set up and ready to focus on your web scraping tasks with Octoparse.

Conclusion

Combined with Oxylabs proxies, Octoparse can assist businesses in their data extraction operations. The tool is simple and doesn’t need any coding, yet fast and efficient. If you still have questions about the Octoparse proxy integration process, don’t hesitate to contact us.

Check for more similar web scraping tools like WebHarvy in our integrations.

Please be aware that this is a third-party tool not owned or controlled by Oxylabs. Each third-party provider is responsible for its own software and services. Consequently, Oxylabs will have no liability or responsibility to you regarding those services. Please carefully review the third party's policies and practices and/or conduct due diligence before accessing or using third-party services.