Can Google's Gemini Advanced Beat GPT-4? Or Is ChatGPT Still King?

Google's highly-anticipated Ultra 1.0 model has finally arrived alongside a full rebrand of Bard to Gemini. To get access to Ultra 1.0 you need a paid-for AI Premium plan from Google. Is it worth it? Can it beat ChatGPT Plus? Let's find out.
---

#garyexplains

[namangupta]

Have you seen how Gemini was giving bullet points and was actually using language that would seem to be gramatically easier to understand. AI have been made to make humans understand better and faster. I can bet that reading bullet points is much easier and faster then reading the whole paragraph in chatGPT.

[walid]

Gemini feels better to use than ChatGPT
easier to understand plus it feels more human than chatGPT

[getolvid]

lua, julia, elixir...my fav too (but no video necessary.) Tks for the AI comparing ! outside of Vscodium, gpt3* is an invaluable mentor for elixir coding as well as every thin such as linux commands, pizza recipes and word etymology, you name it.... especially on a remote island and timezone !

[ollydsouza]

Thanks great job and very useful. Beautiful to watch!

[timtanhueco]

How do you guys keep affording ti pay those on a monthly basis?

[LA-MJ]

Chat gpt writes better code but princes bride was spot on

[umeshgiriplay]

Standard benchmark tests might not fully capture Gemini's performance, considering how quickly it seems to adapt. Asked Gemini for a JDK 1.8.0_392 install guide and got a caution about security, pushing to install JDK 17 instead. ChatGPT, however, offered the exact install steps for 1.8.0_392. After sharing ChatGPT's response with Gemini and revisiting the prompt later, Gemini had adapted to provide the same instructions as ChatGPT. It's fascinating to see such rapid learning

[lionheart]

Personally like how Gemini Advanced gives information as to "Why" in most scenarios whereas GPT4 does not always explain the why but rather the how.

[marcusvnogueira]

Star Wars is a fairy tale: a young man leaves home, meets a wizard, and goes to rescue a princess from the dark lord. That is more in-line with Princess Bride than with the Matrix to me!

[fromann]

In your Star Wars question, I agree that there was a tie. This was not a fact-based question, and both LLMs gave an answer with valid reasoning.

[jimgsewell]

Your video makes it easy to determine who the winner is. It is us, the users. Good competition among the providers, clearly benefits the users.

[WMCBTech]

I just got ChatGPT Plus and Gemini Advanced today and I'm be ready to start my AI journey! Because ChatGPT 4 has limits of 40 messages per 3 hours, I'd honestly use Gemini advanced as fallback

[gregholloway]

Neat video, Gary. I wonder if Gemini would answer differently to the movie question if Matrix was spelled correctly. 👍

[ephraimedits]

The movie's question is a tie. The reasoning for both makes sense

[Market-MOJOE]

🎯 Key Takeaways for quick navigation:

00:00 *🏆 GPT-4 and ChatGPT have been leading large language models, with Google's Gemini as a contender.*
00:40 *💬 Google rebranded BERT to Gemini with an advanced version, Gemini Ultra, competing with ChatGPT.*
01:48 *🤖 Both ChatGPT and Gemini Advanced correctly answer logic questions, showcasing their capabilities.*
02:30 *🎥 ChatGPT and Gemini Advanced disagree on which movie is most similar to Star Wars, highlighting differing interpretations.*
04:10 *⚽ Both models recognize a humorous statement about a football player being offside, showing contextual understanding.*
06:00 *💻 ChatGPT and Gemini Advanced both successfully write a Python script to perform a given task.*
08:18 *🐜 Both models identify an overflow bug in C code and propose solutions, demonstrating their ability to debug.*
11:33 *💡 ChatGPT and Gemini Advanced generate code in the Lure language to find prime numbers, showing versatility in handling less common languages.*

Made with HARPA AI

[splendorman]

geminis answer was better on star wars question

[youraveragesguys]

gary, try playing chess with both to see their abilty to logic and problem solving, i know gpt 3.5 is lousy at it

[ShaunakHub]

What I personally liked about Bard compared to ChatGPT is that Bard never shied away from controversial questions. (I have not used either extensively) So I guess in a way Bard is more 'human' like.

[Burrgundy]

Gemini’s analysis on the movie question actually required thought which is why I like it more

[zoddmark]

While I don't think a decisive conclusion can be made based on the small number of tests here, If I had to judge them solely on the results of these tests I'd say the Princess Bride answer Gemini gave and the overall readability of Gemini's responses would put it on top for me. I'll admit my gut reaction to the movie question was also The Matrix based on the Sci-fi and "choosen one" themes, but Gemini convinced me on Princess Bride. It's not an uncommon opinion that Star Wars is really just a fantasy story in space rather than a straight Sci-fi movie and the plot points really are pretty similar.