Skip to main content

Fred de Villamil

Chief Technology Officer @ NielsenIQ Digital Shelf

Fred has over 20 years of experience in the tech industry, starting his career as a systems engineer and infrastructure lead, where he built petabyte-scale big data architectures. Over the years, he held leadership positions, including VP of Engineering at Ledger and Aircall (both French unicorns), as well as CTO roles at MyLi and Data Impact, which was acquired by NielsenIQ in 2021. For the past 10 years, he has specialized in the web scraping field, working across three different companies: Synthesio, MyLi, and Data Impact. Since joining Data Impact (now NielsenIQ Digital Shelf) in December 2020, he has been helping businesses leverage large-scale web data collection to drive better decision-making.

Fred de Villamil

Learn more about Fred's presentation

Scaling E-Commerce Data Extraction: From Zero to 10 Billion Products a Day

Building a resilient, efficient, and cost-effective scraping strategy is key to long-term success. From ensuring data security and quality to optimizing for cost, every decision matters. Additionally, when scraping operations involve thousands of e-commerce websites, real-time adaptability and monitoring become essential. In this presentation, Fred will demonstrate how NielsenIQ Digital Shelf develops scalable e-commerce websites' scraping strategies, addresses the complexities of location-based scraping, and implements real-time monitoring systems for proactive issue detection and resolution. 

Watch this presentation to:

  • Discover how to build a scalable multiple e-commerce website scraping strategy;

  • See how large-scale web data monitoring works in practice;

  • Learn about a fully automated issue detection and response workflow.

12:40 PM