Proxy Integration With WebHarvy

3. Click on ProxySettings. Select to mark Enable network connection via Proxy Server and choose HTTP as your Type.

4. Fill in the required credentials. Under Address, enter pr.oxylabs.io, and under Port, type in 7777. You can also use country-specific entries. For example, if you fill in us-pr.oxylabs.io under Address and 10000 under Port, you’ll acquire a US exit node. For a complete list of country-specific entry nodes or if you need a sticky session, please refer to our documentation.

5. Click to mark Requires authentication to enter your Oxylabs sub-user’s Username and Password. Click on the + button to add your newly input proxy to the list. Lastly, press Apply to finish your WebHarvy proxy servers integration.

And that’s all. With proxies, WebHarvy can scrape data anonymously without being blocked.

How do you scrape with WebHarvy?

1. To begin, navigate to a target website. In this case, search results from  https://books.toscrape.com/.

2. Press Start to begin target data selection.

3. Select the desired attributes, for example, book titles and prices. The browser allows you to click on specific content for scraping. The cursor detects data patterns that occur on a webpage. If the data repeats, the tool scrapes it automatically without additional user input.

4. Choose Capture Text and name your items accordingly.

5. After selecting data to be scraped, press Stop to finish the configuration.

6. Click Start-Mine and press ▶Start to extract your data.

7. After the extraction process is over, click Export and select the export method. WebHarvy saves scraped data in Excel, XML, CSV, JSON, and TSV formats. Alternatively, a database destination could be used as well.

And that’s it. Here’s the final result – a spreadsheet with book titles and prices.