Able to get stdout stderr in realtime in python from sh script but not python script

Title: Real-time Capture of Stdout/Stderr in Python from Shell Script
Introduction:
Sometimes, you might need to run shell scripts from within a Python script and capture their stdout (standard output) and stderr (standard error) in real-time. This can be useful for various purposes, such as logging, monitoring, or processing the script's output as it is generated. In this tutorial, we'll explore how to achieve real-time stdout and stderr capture when running shell scripts from a Python script. We'll also discuss why this isn't as straightforward when running Python scripts.
Requirements:
In this code, we use the subprocess.Popen() function to open a subprocess for the shell script. The stdout=subprocess.PIPE and stderr=subprocess.PIPE options capture stdout and stderr, respectively. We then use a loop to read and print the output lines in real-time.
Here's an example of how to do this:
In this code, we use the iter() function to continuously read lines from the stdout and stderr streams until the subprocess completes. This approach ensures real-time capture of output, even when running a Python script.
Conclusion:
Capturing stdout and stderr in real-time from shell scripts is relatively straightforward using the subprocess module. When running Python scripts, you can use the iter() function to achieve real-time output capture. This can be helpful for various purposes, including logging, monitoring, and interacting with external processes from your Python script.
ChatGPT