Proxy Integration With WebHarvy

3. Click on Proxy Settings. Select to mark Enable network connection via Proxy Server and choose HTTP, HTTPS, or SOCKS5 as your Type.

To configure Oxylabs proxies, add the following details.

Residential Proxies

Type: HTTP, HTTPS, or SOCKS5

Host: pr.oxylabs.io

Port: 7777

You can also use country-specific entries. For example, if you fill in us-pr.oxylabs.io under Address and 10000 under Port, you’ll acquire a US exit node. For a complete list of country-specific entry nodes or if you need a sticky session, please refer to our documentation.

Enterprise Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via sales.

Type: HTTP or SOCKS5

Host: a specific IP address (e.g., 1.2.3.4)

Port: 60000

For Enterprise Dedicated Datacenter Proxies, you’ll have to choose an IP address from the acquired list. Visit our documentation for more details.

Self-Service Dedicated Datacenter Proxies

Specify the following if you purchased Dedicated Datacenter Proxies via the dashboard.

Type: HTTP, HTTPS, or SOCKS5

Host: ddc.oxylabs.io

Port: 8001

For Self-Service Dedicated Datacenter Proxies, the port indicates the sequential number of an IP address from the acquired list. Check our documentation for more details.

Datacenter Proxies

Type: HTTP, HTTPS, or SOCKS5

Host: dc.oxylabs.io

Port: 8001

For the Pay-per-IP subscription, the port is the sequential number assigned to an IP address from the given list. Thus, port 8001 uses the first IP address from your list. For more details, see our documentation.

For the Pay-per-traffic subscription, port 8001 picks a random IP address but stays consistent during a session. You can also specify geo-location, for example, the US, within the user authentication string: user-USERNAME-country-US:PASSWORD. See our documentation for more details.

ISP Proxies

Type: HTTP, HTTPS, or SOCKS5

Host: isp.oxylabs.io

Port: 8001

4. Click to mark Requires authentication to enter your Oxylabs proxy user’s Username and Password. Click on the + button to add your newly input proxy to the list. Lastly, press Apply to finish your WebHarvy proxy servers integration.

And that’s all. With proxies, WebHarvy can scrape data anonymously without being blocked.

How do you scrape with WebHarvy?

1. To begin, navigate to a target website. In this case, search results from https://sandbox.oxylabs.io/products.

2. Press Start to begin target data selection.

3. Select the desired attributes, for example, book titles and prices. The browser allows you to click on specific content for scraping. The cursor detects data patterns that occur on a webpage. If the data repeats, the tool scrapes it automatically without additional user input.

4. Choose Capture Text and name your items accordingly.

5. After selecting data to be scraped, press Stop to finish the configuration.

6. Click Start-Mine and press ▶Start to extract your data.

7. After the extraction process is over, click Export and select the export method. WebHarvy saves scraped data in Excel, XML, CSV, JSON, and TSV formats. Alternatively, a database destination could be used as well.

And that’s it. Here’s the final result – a spreadsheet with titles, prices, availability, and description.