Why You NEED an Audit Table For Your Database (Part 1 of 2)

Audit Tables help you track changes to records in your database. They are an important tool in your toolbelt to understand the stateful transitions that your records go through. This is important for auditing, debugging, and general understanding of how clients are modifying your records. In this video, I explain to you what an Audit Table is in the context of DynamoDB, and a architecture to set one up. In Part 2 of this video series (coming soon), I show you how to set up an audit table with DynamoDB, DynamoDB Streams, Kinesis Firehose, S3, and Amazon Athena. You'll learn how to migrate data from your DynamoDB table into a cold store in S3, and perform SQL queries on it using Athena.

🎉SUPPORT Daniel @ BE A BETTER DEV🎉

📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚

🎙 MY RECORDING EQUIPMENT 🎙

💻 MY DESKTOP EQUIPMENT 💻

🌎 Find me here:

#SoftwareEngineer
#SoftwareDeveloper

[cristiannechita]

Two questions:
1. I remember that Athena has issues when scanning multiple objects from an S3 bucket (this is how I assume you are going to handle the DynamoDB streaming data)?
2. Why not actually use the DynamoDB itself as an Audit table (you could have two tables, 1 that is the current view and the other that stores the actual audit trail)? Benefit of this, is that you could actually trigger business logic when a certain event happened.

[chanu]

Does that mean we have to keep appending any order's all executions in single file as well as in Athena table ? Also, why not in Aurora ?

[michszym]

Hmm... A glitch? The changes presented on the orders table ...goes back in time? First state lastUpdatedDate ends with 8, the consecutive ones end with 7. Was that in purpose to present a situation where the entries come from different machines that may not have their time synced? Or to present that the lastUpdatedDate cannot represent a time series of entries? And I'm afraid same goes for the Athena entries.

[abhinavlohani]

Hi Daniel. I tried to find your course in Udemy but I was unable to find one. Is it available there?