AI Meets Pandas: A First Look at PandasAI

𝗗𝗘𝗦𝗖𝗥𝗜𝗣𝗧𝗜𝗢𝗡
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
In this video, I explore PandasAI, a new Python library that works in tandem with Pandas to provide a more interactive data analysis experience. Follow along as I dive into a hands-on example, using a dataset to demonstrate how PandasAI answers direct queries about your dataframe.
Apart from demonstrating its usage, I also share my personal views on this new tool, discussing its pros, cons, and aspects like privacy, security, and costs. This video is an initial exploration of PandasAI - giving you a taste of what it can do, and how it can enhance your data analysis workflow with Python and Pandas.
Tune in, whether you're new to Python or an experienced data scientist, to gain a fresh perspective on data analysis with PandasAI.

🌍 𝗟𝗜𝗡𝗞𝗦:

⭐ 𝗧𝗜𝗠𝗘𝗦𝗧𝗔𝗠𝗣𝗦:
0:00 – Intro
0:20 – Setting Up the Dataset
0:31 – Analyzing Data with Pandas
1:39 – Analyzing Data with PandasAI
3:20 – Sharing My Opinion on PandasAI
3:46 – Discussing Privacy, Security, and Costs
4:30 – Outro

𝗧𝗢𝗢𝗟𝗦 𝗔𝗡𝗗 𝗥𝗘𝗦𝗢𝗨𝗥𝗖𝗘𝗦
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

𝗖𝗢𝗡𝗡𝗘𝗖𝗧 𝗪𝗜𝗧𝗛 𝗠𝗘
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

☕ 𝗕𝘂𝘆 𝗺𝗲 𝗮 𝗰𝗼𝗳𝗳𝗲𝗲?
If you want to support this channel, you can buy me a coffee here:

[CodingIsFun]

*What do you think of PandasAI? Let me know in the comments below!* ⤵

[LukeBarousse]

This is awesome! We're pretty close to not having to code at all for data analysis
Makes me happy for those that can't code... but sad for someone like me that likes to code

[deldridg]

Great intro and thank you. Having worked with mission-critical corporate and life-critical healthcare data, someone has to have ownership and responsibility of analytical outputs. I can see how powerful this could be for getting some rapid analytical directions, but (at least for now), the absence of accountability and the high likelihood of errors is a show-stopper for critical work. I'm looking forward to seeing how it can function as a kind of junior assistant analyst. Cheers - Dave

[zhilee]

"But for now, I'd rather write my own pandas code because it lets me know how the data is processed.", I totally agree.

[brianbibohere]

Thank you, I am already excited to go start using the PandasAI once on my desk😊😊

[alikhanak]

With any dataframe i am running on this its giving me following error.. Even can't find solution on bing or chat gpt


"data type 'int64' not understood
" unfortunately i was not able to answer your question, because of the following error:\ndata type 'int64' not understood \n"

[arnoldtvisagie]

I think I'm first. 🎉 Always a good day when Sven uploads.

[kilopist]

Great Video! Thanks. Careful with your API key!:)

[ordaflash]

Thank you for this video !
This is an amazing library, however i was wondering if its possible to plot the "charts" it render in a streamlit app ?

[bc]

I like the picture 🐼. And it's a short leap from here, but at this point it still needs a human to know what to ask, and to care what the results are. Plus, most places have little to zero technical analysts / tools, so if anything this would be another tool for their analysts - or have no effect at all... 🤷. What this could represent though, is the evolution of the AI's ability to give accurate info, versus "hallucinations" - even if used just to have it show how the answers were determined.

[un]

not sure what the use case for this is when you can just paste in the git hub link into the prompt bar and Chat will analyze and help with errors or write documentation or whatever.

[kenn]

Does it work well with large datasets?

[arch.blender]

Noob question :) I am a Blender user for (old school) architecture, with PandasAI can this be used in the Blender's Python console to read an external database, read to a written instruction, and respond by creating a 3D model? I'm thinking the external database would include a schedule of rooms that would include dimensions and areas, relationships to other rooms, equipment list and so on. Does this make sense? Cheers Nigel

[damaslan]

Hi, great video. Thank you very much. Would it also work with Bard ?

[ESPjump]

I would not use, because of the same reason: I want to control what I do, how I do it and everything involved in the process. Also, once you know the syntaxis, the classic Pandas in Python is faster, and easy to change. I want to control what I save in the variables, and to be sure about the results. If you automatize some lines, you already do not control how it reached the result, and you even do not know or understan the result. If I employ the .nlargest() function, I know exactly what Pandas will do. If I just ask the AI about the top 5 countries by GDP, I do not know what it was doing, if the result is plausible, and what the AI understoo as the top5. The main problem with the OpenAI tools for data analysis is that you can never be sure if the result is what you meant.

Other example: there is already time ago the posibility of using queries in Pandas, and as far as I know, it is still a not so popular option. And I think this is because of 2 reasons, the first one is that syntaxis does not improve in efectiveness or speed, and the second one is that you keep a less strict control over the operations.

[georgistoyanow]

Do you think this is a good option for beginner python data analyst like me? Or rather I should focus on the mechanics of understanding the code first?

[generic-youtube-user]

Hi! How do I give this "memory"? I want to use it in a sample chatbot. It should be aware of the context of the conversation as it goes on, then only it will be able to understand user's queries

[shekarshekar]

hey Although I am using Paid API key, the API is taking a long time to respond. is there any chance, we can improve the Performance?

Is it possible to retrieve the intermediate_steps ?

[williansuarez]

excelente información, thank you, unfortunately here in Venezuela we are blocked to use openAI, but anyway I prefer the normal pandas