Tadas Malinauskas

Python Developer at Oxylabs

Tadas started working as a Python Developer at Oxylabs more than two years ago. When he became a team lead of a scraping track, he focused on reworking the whole scraping infrastructure. His goal was to design and develop frameworks that allow developers to quickly and conveniently build scrapers and parsers. 

Learn more about Tadas' presentation:

Managing Dozens of Python Scrapers’ Dependencies: The Monorepo Way

Managing Python projects' dependencies might seem like an easy task nowadays. However, developing your own frameworks and libraries with many dependent projects usually requires more than 10 merge requests for even a minor change.  Then, the process of managing Python projects becomes challenging. 

Tadas’ presentation will take a quick look at:

  • A "wannabe" Python monorepo setup; 

  • Issues when trying to manage an increasing number of scrapers and how to solve them without additional tools conveniently;

  • How to  build a "wannabe" Python monorepo setup using Poetry and GitLab.

Meet OxyCon 2022 speakers

Coming from different industries and backgrounds but united in common passion and aspirations, these web scraping experts will share their experiences and answer your questions. 

Glen De Cauwsemaecker

Lead Crawler Engineer @ OTA Insight

More details

Martynas Saulius

Python Developer @ Oxylabs

More details

Allen O'Neill

CEO/CTO @ The DataWorks

More details

Alex Reese

Partner @ Farella Braun + Martel

More details

Sarah McKenna

CEO @ Sequentum

Julius Zaleskis

CEO @ Dataistic

More details

Denas Grybauskas

Head of Legal @ Oxylabs

More details

Paul Morgan

Data Collections Team Lead @ Datasembly

Ondra Urban

COO @ Apify

More details

Sanaea Daruwalla

General Counsel @ Zyte

More details

Eivydas Vilčinskas

Technical Team Lead @ Oxylabs

More details

Karsten Madsen

CEO @ Morningscore

More details

Vaidotas Šedys

Moderator @ OxyCon

More details

Gabija Fatėnaitė

Moderator @ OxyCon

More details

Ovidijus Balkauskas

Linux Systems Engineer @ Oxylabs

More details

Glen De Cauwsemaecker

Lead Crawler Engineer @ OTA Insight

More details

Martynas Saulius

Python Developer @ Oxylabs

More details

Allen O'Neill

CEO/CTO @ The DataWorks

More details

Alex Reese

Partner @ Farella Braun + Martel

More details

Sarah McKenna

CEO @ Sequentum

Julius Zaleskis

CEO @ Dataistic

More details

Denas Grybauskas

Head of Legal @ Oxylabs

More details

Paul Morgan

Data Collections Team Lead @ Datasembly