Python Pandas tutorial | Highlight differences between two dataframes | An IT Professional

This video is for Python and Pandas enthusiasts who wants to understand how to highlight the data mismatch between two dataframes.

#DataScience #Pandas #Python #AnITProfessional

Follow our page on FB/Instagram for any Python related queries and interesting videos:

[DeepakKumar-cxtr]

Thanks so much, this is exactly what I was looking for

[shomandas]

@An IT Professional Thanks for this video, but I am getting InvalidError: Reindexing only valid with uniquely valued Index objects

[sathyanarayana]

Hi . Thiyagu. Many thanks for the helpful video. It suits my requirement. I need one addition to this, to highlight the differences(values) if the difference is greater than certain threeshold value(eg: difference greater than 3). My data frame has only numeric values (no string Data)

[alexwotton]

Can we compare two excel in similar way?

[alterevilx]

hi this is a great video, it helped me alot but i have a question.
how do i include the column names also under first and second?

[itconceptsmadeeasy]

I have exactly same requirement with slight modification, I don’t want to print the entire record which is exactly same in both data frames

[deekshataneja]

Hi. This solution is working fine for very small files but for large file size say >10MB script is getting ended with error, looks to be memory issue. Anything you can suggest to resolve memory size issues ?

[rupeshjha]

I need help on comparing two table and update destination with source using dataframe

[namiikkool]

Hey Thiyagu thanks a lot, this helped me, however instead of first and second, how do we produce differences in single column for eg
Age
40<>30. And will this solution hold good for huge files with 5-10 million records ?

[sourcecode]

I have a similar kind of script but it fails if there are duplicate pkeys and if the number of rows are diff in df1 and df2 and if there are additional pkeys in df1 or df2