Learn more about Eivydas' presentation:

Practical Application of Common Web Scraping Techniques

On the journey of building a web scraping project, developers often realize that the path is long, winding, and thorny. Various obstructions, such as anti-bot solutions, dynamic layouts, slow scrapers, and many more, stand in their way. Knowing the tools used to solve these problems makes the scraping path faster and clearer.

In this presentation, Eivydas will demonstrate a practical application of common techniques in web scraping development and mention some of the advanced ones as well:

  • Session preparation components, including headers, cookies, and proxies;

  • Headful, headless and browserless scraping;

  • Public data extraction: a case for XPath;

  • Optimizations in software design and scraping behavior.