Chin Hwee Ong - Designing Functional Data Pipelines for Reproducibility and Maintainability

Designing data pipelines at scale is often a challenge, as testing and debugging across compute units are often complex due to dependencies at runtime. In this talk, I explore the use of functional programming in Python to design data pipelines that are reproducible and maintainable at scale.