Python Interview: Log File Analysis | Complex Scenario | #python #dataengineering #dataanalytics

GitHub link for log files and code base

# You are given multiple log files from different servers, and each log entry follows this format:
# [Timestamp] [Log Level] [Message]
# 2025-02-26 10:17:05 WARN Memory usage high on server_id=789
# 2025-02-26 10:15:30 INFO User login successful for user_id=123
# 2025-02-26 10:16:10 ERROR Database connection timeout for user_id=456

# The log files are stored in different directories, and each directory represents a different server. You need to write a Python program to:

# Read and merge all log files while maintaining chronological order.
# Identify the top 3 most frequent error messages.
# Generate a summary report that includes:
# Total number of log entries per log level (INFO, WARN, ERROR)
# The top 3 most frequent error messages with their counts

Some links to go through for few topics used in the video