GPT-4 is OVERHYPED

Checkout my second Channel: @NeetCodeIO

#coding #neetcode #python

[NeetCode]

Am I just coping or do you agree that the hype is a bit overstated?

[jayanthduvvada]

Looks like google employees are under lot of pressure 😂

[coalhater]

They should definitely rename the company to closed ai. It's not about research anymore just business.

[orbedus]

i am a junior dev and had reported issues with a project of mine. I tried reproducing it and was close to pull my hair out as I was not able to reproduce the issue during debugging. Spend a good 6 hours on it without a solution. Yesterday I copy pasted my code and asked gpt4 why it bugs out and it imemdiately told me about the race condition and the changed timings I most likely encountered and provided a solution. from the moment of pasting to finding, and fixing the issue, a total of 3 minutes passed. 3 minutes. vs the 6 hours I spent aimlessly prior. Of course hindsight is 20/20 and if I work backwards I can easily find the problem, but from my point of view I was stuck and it was solved instantly. By a mere chatbot no less.

[nodavood]

Up until 1 year ago, we didn't have an AI that could pass the bar exam (an exam which is not multiple choice, but you have to write essays and know case laws). Not even close. Now we have. The fact that it happened so fast, shows this is not over-hyped. But we have to recognize its limitations. This is not general intelligence yet. That might take a while.

[David-gjdc]

I feel like it's not about outright replacing all programmers. I've encouraged my coworkers to experiment and become familiar with AI tools because I believe these tools will widdle teams of 10-20 to teams of 1-5 potentially. They may need these tools to remain competitive.

However I think it is important to remember that the economy in general is not a zero sum game. More productive programmers does not necessarily have to imply less programmers. They just might be doing different types of tasks or using different languages than they might have before (html and css in particular might be something we write relatively little of going forward).

[tacticaltaco]

I think this is a bit of a closed-minded (npi) way of thinking about it. It's hyped a bit in the wrong ways but a lot of the productivity gains it offers deserve the hype. It's not replacing programming but replacing programming is overhyped. I think the things AI can do overall (not just chatgpt) helps to overcome a lot of pointless work. That said yeah I wish it was open source too, and it ought to be, but them going back on their word isn't really surprising and doesn't make it overhyped.

[shrunkensimon]

Being completely reliant on input quality for its output quality, with no ability to actually think, is not going to be compatible with business requirements. IT makes mistakes, which means you'll need workers there to understand why it isn't working. Which means paying for workers and AI, and losing time going through code which they could have just written properly the first time through.

It will be like Excel. A useful productivity booster, raising the baseline. It might replace simple jobs, but not ones requiring any degree of thinking ability.

[jendabekCZ]

I find it both - very powerful and in some areas already game changing, but overhyped at the same time.

[xilongcao]

Let me try answer that "what is the limit of generative AI" question: The way we do it, it just makes it BS gradually better, with human assisted RL now, it even looks like it has some sort of intelligence.

But BS is BS, without the real ability to think for itself with logic, it will remain just that, very unreliable.

[egorasirotiv]

Ok, let me speculate a bit…

In my opinion, ChatGPT and other advances show that AI is starting to become useful outside of narrow well-defined tasks (like image classification and similar ones). This will probably mean more ML vacancies. What these jobs will look like exactly is hard to say yet, however I’m reasonably sure the fundamentals will stay the same: finding the right problem, collecting and cleaning data, choosing the right model, evaluating the results.

How hard it is to find a job is always a supply and demand question. If the demand for a person with certain skills is greater than the supply, then finding a job is easy. I don’t see ChatGPT significantly reducing the demand; it’s a nice productivity booster technology (explaining concepts, helping with writing code in unfamiliar language, etc.), but not a replacement for any aspect of the ML developer role.

It’s an incredible time to be in AI, and I think it’s only going to become more fascinating going forward.

[JuanPablodelaTorre]

I copied your prompt (1:51) and asked GPT-3.5 and GPT-4. I got correct answers out of both models. GPT-3.5 got me "2 and 5" and GPT-4 answered "[1, 5]", which also sums to 6 as an added bonus.

But there's more, GPT-3.5 gave me an algorithm as part of the answer. I wrote a piece of code following the algorithm, which outputs "[0, 5]". It's not "2 and 5" but it is also correct. Meanwhile, GPT-4 gave me some Python code that outputs "[2, 5]". Which is not "[1, 5]" but it is also correct.

I find all of this very funny. But I had to try changing the numbers so there's only one correct solution. The GPT-3.5 algorithm is obviously flawed and it failed in most cases while the GPT-4 code works every time (and it is also faster).

All in all, I would say GPT-4 is significantly better but how useful you find it depends entirely on what are you asking of it.

[maniksharma]

Bro there is something wrong with prompt because chat gpt 3 literally made me a gd extension plugin for godot game engine even when Godot 4 was released a weak ago.
It was written in c++ and i only get one error and gpt even solved it.

[HardKore]

Generative Artificial Intelligence (AI) refers to machine learning models that can generate new data that resembles the training data. While these models have shown great potential in various fields, there are still some limitations to what they can do. Here are some of the main limits of generative AI:

Data quality: Generative AI requires large amounts of high-quality training data to learn from. If the training data is of low quality or biased, the generative AI model may produce inaccurate or biased results.
Overfitting: Generative AI models can overfit the training data, meaning that they become too specialized in reproducing the training data and fail to generalize to new data.
Understanding context: While generative AI can produce data that resembles the training data, it may not always understand the context of the data or be able to interpret it accurately.
Limited creativity: While generative AI can produce new data, it is still limited in its creativity compared to human imagination.
Computational power: Some generative AI models require significant computational power to train and run, which may limit their accessibility to some applications.
Overall, while generative AI has many promising applications, it is important to understand its limitations and consider the potential risks and biases that may arise from its use.

[codeisawesome]

What was the embedded lecture around 2:37?

[stephenburgess]

My experience with the code accuracy of gpt-3 is that it is much less than 50% for non-trivial questions.

When you said it can’t solve leetcode questions but to be fair neither could you I had a full spit take lol.

[elias]

How sould we who are still in college or upcoming developers prepare for any potential job loss in the future due to such AI? I would love to hear your advice please especially now even without ChatGbt, getting internships or jobs is heartbreaking.

[TheGoldenrun]

Well, I did the same things with better language and syntax and it never failed. I think people should focus on actually being more articulate, use proper wording and analyzing their speach in a more concise way. I tried both in GPT4 and 3.5 the following:

Lets say you have as input the following array:

nums=[1, 1, 1, 2, 3, 5], and the target is 6.

Which two indices contain the elements which add up to 6?

The answer give was always correct .

[jaimeeduardo]

I just tried to replicate the problem that you showed, bc it was pretty funny, but actually it answer all my questions correctly, I even tried tricky questions of multiplying the numbers by two or asking for a sum that is not possible

[antiquarian]

maybe you are confusing the hype of AI development rate with GPT 4, sure there are people hyping gpt 4 but majority of people are hyping the rate at which AI is progressing, this rate points to a future that is unrecognizable from todays world.