Here Is What You Should Use for Data Validation

preview_player
Показать описание
In this short, I explain why data validation is so important and which tool can help you do it quickly and easily.

#arjancodes #softwaredesign #python
Рекомендации по теме
Комментарии
Автор

Check out my channel links for a free code diagnosis workshop or my free design guide! 🔥

ArjanCodes
Автор

I got into pydantic because of fastapi, havent looked back since. I even use it in Data Engineering projects. :D

kbaafi
Автор

Your data has error correction, and the best way to validate your data is to use a hash function to validate your error correction data.

This scales with your data encryption and the data validation method as hashed data can be set to whatever your maximum dataset’s validation size is with headroom to hash the metadata to ensure that your matching dataset for validation can be verified. Keep your dataset hashes on a separate pathway and use backups.

For anyone who is rolling their own datasets rather than using a package or framework.

Stopinvadingmyhardware
Автор

I remember this from the live stream. Very helpful answer!

timmarkhuff
Автор

just used pydantic for the first time and i am not going back

amitozsidhu
Автор

I use msgspec for data validation. It is blazing fast an easy to use via usual python type annotations

veritas-odium-parit