Power BI: Displaying Live System Performance using Power BI, SQL and Python

The video explains a step-by-step guide on how to display system performance information in real-time using Python, Microsoft SQL Server, and Power BI Desktop. The narrator explains that this exercise will help learners understand Python, SQL, and Power BI Desktop and how to connect the three major data science applications.

The video begins by explaining that Python will be used to read system performance information, which will then be inserted into Microsoft SQL Server Database. Afterward, Microsoft Power BI Desktop will be used to display the information on a dashboard in real-time, just like in Windows Task Manager.

The video then shows how to create a new database in Microsoft SQL Server and name it "system information." The narrator explains that they will create a new table in this database named "performance" and shows how to add various columns to store CPU usage information, memory usage information, CPU interrupts, CPU calls, memory used, memory free, bytes sent over the Internet, bytes received from the Internet, and disk usage information.

After creating the table, the video shows that it is currently blank, and no data has been entered yet. The next chapter will explain how to insert data into the table using Python.

The video then goes on to explain how to import Python system and process utilities, the time library, and the ODBC library for Python. After importing the libraries, the narrator shows how to create a connection to the SQL Server database using the ODBC Python library. They also explain how to find out the server name from the SQL Server Management Studio and enter it in the Python script.

Next, the video shows how to create a SQL cursor using the connection defined above. The narrator then creates an infinite loop using Python's system utility and explains how to gather system performance information using the Python script. They also explain how to insert the gathered information into the Microsoft SQL Server database using the SQL cursor.

Overall, the video provides a detailed explanation of how to display system performance information in real-time using Python, Microsoft SQL Server, and Power BI Desktop. It covers all the necessary steps from creating a new database to inserting data into the database using Python.

Chapters:
00:55 - Designing SQL Database
04:22 - Using Python to Get System Performance
14:33 - Testing the Application
15:14 - Connecting Power BI to SQL Server
25:49 - Creating Measures for Latest Values
18:20 - Creating Power BI Live Dashboard
24:12 - Testing the Final Results

#Python #SQLServer #PowerBI #RealTimeDashboard #SystemPerformance #DataScience #ODBC #DatabaseManagement #DataVisualization #Microsoft #WindowsTaskManager #PerformanceMonitoring

[devanshsingh]

('22003', '[22003] [Microsoft][ODBC SQL Server Driver][SQL Server]Arithmetic overflow error converting int to data type numeric. (8115) (SQLExecDirectW); [22003] [Microsoft][ODBC SQL Server Driver][SQL Server]The statement has been terminated. (3621)')
same issue I am having.

[chilangowave]

psutil disk and memory functions dont work:(

[knowldegesharing]

Thanks for sharing such an amazing video!

When there is a direct option to link and get data from SQL to PBI, then why to use Python ?

Also, what are the other possible scenarios which requires Python, to develop Dashboards/ Reports?

[arsalraza]

i love this video ❣... from a long time i'm thinking about how powerbi is connected to live data . Today I got my answer ; also rewised my database with python knowledge . thank you 💞

[SanjaySanjay-pw]

Bro how you install that pyodbc Pls tell me bro...

[shamli]

I am unbale to connect sql server to my power bi . How to give server name while connecting to sql server.

[sachindubey]

Every this mine i got the points . But i still have a doubt, how your dashboard refreshing on live data, is this will be work fine when i will publish it on power bi service of public use ?? Will i get the live Data?

[MoonShine-bscl]

Hi awesome explanation, but i have one doubt why my RLS is not working after fresh data updation in powerbi service and desktop

[anubindadash]

Awesome! One question : Can we do the same for the connected sources of power BI? Suppose I have 3 connected sources in Power BI - Apache, Salesforce and SQL, is there a way we can show how much memory, utilization is happening, and show it in a dashboard? Please reply.

[ashokmunga]

This topic put in resume project or not

[SarveshKumar-mbr]

hey
it's awesome it really works
but pleas can you tell me how to creat live dashboards because it is only updating in report not in dashboard

[yuvrajchavale]

day by day conding knowledge going up thank bro❤️❤️❤️

[MoonShine-bscl]

Hi your video is wonderful and it does a great job and learning, I have an request it will be very helpful for me if you publish a brokerage analysis dashboard for 4 yrsby this Friday itself, it would give me an idea on doing quick analysis. Sample and simple one would be good, thanks a lot on your helpful hand. Looking out for this ASAP.

[mkamran]

I am collecting all linux servers performanceetrix using python code into an excel, so what could be next steps in making the same dashboard, also do I need to schedule that python code to run continously or hourly or at every 30min ?

[gabrieldsfaria]

Hi! I loved the video! Can I use SSMS in macOS? I tried using pgAdmin but had problems connecting with pyodbc

[MoonShine-bscl]

Hi it's pretty good video, but could you please help me in understanding the audit report analysis how to do as my requirement is that and could you also help me with dax function of due date and over all due date in calculation I saw the audit report video as well but there is no dax calculation... It will be helpful... 😊tq

[jameyreed]

Hi I'm looking for a powerbi report that can measure the DB size and capacity of storage used and free

[jameyreed]

Ive got a problem with the script Import from psutil can not be resolved from source do you know How I fix this please

[vivprime]

Im getting a error in GETDATE()


Traceback (most recent call last):

File "d:\pyproject\Systeminformation.py", line 28, in <module> cursor.execute("insert into Performance values (GETDATE(), "

Connect

pyodbc.DataError: ('22003', '[22003] [Microsoft] [ODBC SQL Server Driver] [SQL Server] Arithmetic overflow error converting numeric to data type numeric.. ) (SQLExecDirect); [22003] [Microsoft] [ODBC SQL Server Driver] [SQL Server] The statement has been terminated. (3621)')

PS D:\pyproject>

Ln