Make.com Integration With Web Scraper API

Then, choose Build from scratch to continue.

2. Add the Oxylabs module

Make sure to claim a free trial for Oxylabs Web Scraper API by registering on the Oxylabs dashboard.

Once you have your account, click the plus sign to add a new module in Make, search for Oxylabs, and select the Scrape Amazon Search module.

Next, create a connection by entering your Oxylabs Web Scraper API username and password:

After saving, you’ll see a window where you can set API parameters. For this tutorial, let’s set the Query to lenovo laptop, Geo location to Seattle’s downtown ZIP code 98104, Parse to Yes, and Pages to 2:

These settings will tell the scraper to search Amazon for “lenovo laptop”, localize results for Seattle, collect data from 2 pages, and then parse everything into a structured JSON format. Save this configuration and run this single module to see how it works. The output should contain two scraped pages, so let’s move on to the next step.

3. Add the Set variable tool

Click the plus sign on the right side of the Oxylabs module to connect a new module. Search for Set variable and select it:

Set the Variable name to flattened and paste this function as the Variable value:

{{flatten(map(map(map(1.results; "content"); "results"); "organic"))}}

This will pick all the scraped organic search results from all pages and gather everything into a single array of items. Run the scenario to see the results.

4. Add Iterator, Array aggregator, and Google Sheets

While you can use the flattened results directly to save the entire array in bulk to Google Sheets, this approach will not let you map specific data points to columns. For this reason, let’s use Iterator and Array aggregator to iterate through the array and prepare results for Google Sheets.

4.1 Add Iterator

Connect the Iterator module to the Set variable tool. Paste this {{2.flattened}} as a value or select flattened[] from the items menu:

Follow the steps to Create a connection for Google Sheets. 

After that, manually create a spreadsheet in your Google Drive so you can use it in the scenario. Of course, you can set up the scenario to do that for you, but that’s over the scope of this guide.

• Spreadsheet title: Amazon Search Results

• Sheet name: Organic

• 12 column names: ASIN, TITLE, PRICE, PRICE STRIKETHROUGH, RATING, REVIEWS COUNT, SALES VOLUME, IS PRIME, IS AMAZONS CHOICE, BEST SELLER, SHIPPING, and URL.

Your spreadsheet should look like this:

Getting back to Make, use the ID finder to search for the spreadsheet’s title in the Google Sheets module:

Next, make sure to disable the map setting so you would be able to select the Sheet’s name (Organic) from the dropdown list. Set the Column range to A-Z and, in the Rows field, paste {{4.array}} or simply select Array[] from the item menu. Save these settings.

You can clean up the URL value (12th column) by appending https://www.amazon.com to the start and removing everything starting from the /ref= part. Use this function:

https://www.amazon.com{{first(split(3.url; "/ref="))}}

You can paste this system prompt:

# Role and Objective
You are an expert e-commerce product assistant. Your goal is to analyze scraped product data to identify the best deals based on product specifics, price, availability, and overall value.

# Instructions & Rules
- Provide a comprehensive report of your main findings, highlighting the best product options.

Once saved, you can access this agent directly in the scenario by adding a module, searching for “agent”, and selecting the Make AI Agents - Run an agent module.

6.2 Use the agent in a scenario

For demonstration purposes, let’s utilize the same Make scenario. First, change the total of pages to 10 in the Oxylabs module to gather more data. Next, add a Router between the Set variable tool and Iterator.

This will allow you to branch out the scenario rather than having everything in a single line. Then, click the router and add your agent. To send the scraped data to it, in the Messages field, select the flattened[] item or paste this: {{2.flattened}}.

Finally, connect the Google Sheets - Update a cell module to AI. Make sure to create another Sheet in the same spreadsheet and give it a name, for example, “Analysis”. Then, you can select it in the Google Sheets module, specify the cell where the AI’s response will go, and set the {{7.response}} as a value.

Once executed, the scenario will save scraped Amazon data from 10 pages, and the AI agent will summarize all the data in a new sheet: