Tadas Malinauskas
Python Developer at Oxylabs
Tadas started working as a Python Developer at Oxylabs more than two years ago. When he became a team lead of a scraping track, he focused on reworking the whole scraping infrastructure. His goal was to design and develop frameworks that allow developers to quickly and conveniently build scrapers and parsers.
Learn more about Tadas' presentation:
Managing Dozens of Python Scrapers’ Dependencies: The Monorepo Way
Managing Python projects' dependencies might seem like an easy task nowadays. However, developing your own frameworks and libraries with many dependent projects usually requires more than 10 merge requests for even a minor change. Then, the process of managing Python projects becomes challenging.
Tadas’ presentation will take a quick look at:
A "wannabe" Python monorepo setup;
Issues when trying to manage an increasing number of scrapers and how to solve them without additional tools conveniently;
How to build a "wannabe" Python monorepo setup using Poetry and GitLab.
Meet OxyCon 2022 speakers
Coming from different industries and backgrounds but united in common passion and aspirations, these web scraping experts will share their experiences and answer your questions.
Proxies
Advanced proxy solutions
Data Collection
Datasets
Resources
Innovation hub