How to Build Reliable, Scalable, and Maintainable Data Applications! Data Application Best Practices

preview_player
Показать описание
In this video, I'll teach you all the best practices and guidelines for building data powered applications in the modern age!
Рекомендации по теме
Комментарии
Автор

Excellent video, Dataguy, as always.I have a concern and would like to get your opinion.I have this pipeline:

Data source (API and CSV data) => transformation (Python) => Load (PostgreSQL).

It is a completely open-source pipeline. Is it possible to insert an HDFS between extraction and transformation to manage fault tolerance? Is it wise to do so? Is it possible to manage scalability and high availability in this pipeline without using the cloud?

Thank you for your help.

xavAk