Versioning (5) - Data Management - Full Stack Deep Learning

New course announcement ✨

We're teaching an in-person LLM bootcamp in the SF Bay Area on November 14, 2023. Come join us if you want to see the most up-to-date materials building LLM-powered products and learn in a hands-on environment.

Hope to see some of you there!

--------------------------------------------------------------------------------------------- What are the different levels of versioning your data?

Summary
- Data versioning refers to saving new copies of your data when you make changes so that you can go back and retrieve specific versions of your files later.
- In Level 0, the data lives on the filesystem and/or object storage and the database without being versioned.
- In Level 1, the data is versioned by storing a snapshot of everything at training time.
- In Level 2, the data is versioned as a mix of assets and code.
- Level 3 requires specialized solutions for versioning data. You should avoid these until you can fully explain how they will improve your project.