Jannis Grönberg: Battle of Pipelines - who will win python orchestration in 2022?

preview_player
Показать описание
Speaker:: Jannis Grönberg

Track: PyCon: DevOps
Python is used for a wide variety of applications in data science, scientific computing, and other complex enterprise-level products. When building production-ready products, there is no way around using a suitable framework that triggers the different set of pipelines handling the dataflow. Nowadays, there is an enormous landscape of orchestration tools, making it easy to lose track of their various advantages and disadvantages. This talk will take a look at the current landscape of orchestration tools in Python. Specifically focusing on Kubeflow, Airflow and Prefect and which of them are best suited in terms of performance, usability, and effort of implementation and maintenance.

Recorded at the PyConDE & PyData Berlin 2022 conference, April 11-13 2022.
Рекомендации по теме