Copilot Is Destroying Devin

Recorded live on twitch, GET IN

### Reviewed Video

### My Stream

### Best Way To Support Me
Become a backend engineer. Its my favorite site

This is also the best way to support me is to support yourself becoming a better backend engineer.

MY MAIN YT CHANNEL: Has well edited engineering videos

Discord

Hey I am sponsored by Turso, an edge database. I think they are pretty neet. Give them a try for free and if you want you can get a decent amount off (the free tier is the best (better than planetscale or any other))

[IgorKaratayev]

Hope MS will use AI to fix their Windows Start menu finally.

[leonvolq]

Can't wait for news like "AI destroyed my startup" or "Billion dollars AI bug" to start popping up everywhere 🗿🍷

[wsh]

The copyright free gamer music is crazy

[landlubbber]

I'm working on a PhD thesis about ML-based source code vulnerability detection and let me tell you the literature is nowhere close. LLMs are useful but for anything other than the most obvious vulnerabilities that probably got into the training data, they suck at detecting them at a function-level and are even worse when you get more granular than that. The main problem is that code is functional, not vague like natural language. The best efforts right now are about code graphs but we're still a long way off from even agreeing on what a program's "meaning" even is

[TeamChemicalDestruct]

I feel like LLMs are right now where self-driving cars since 5-10years. Perpetually 2-3 years from the breakthrough that will finally make it good.

[jenslorden]

I can enjoy using copilot, but god am I tired of reviewing pull requests, seeing some really strange code and when I ask the author to describe why it's here they just respond "Copilot did it".
The user really needs to be able to understand the code (and so would be able to write it themselves) that the LLM is generating to be able to use it.

[purpleguy]

It really feels like copilot is trying to be the code calculator and it creates the exact same problem. You can just as easily make mistakes with a calculator as in your head, except if you over-rely on a calculator you end up not understanding where the problem was and how to fix it

[ImmacHn]

I use copilot, but turned off the autocomplete, I love asking it to explain the code back to me and sometimes that gives me insight something I might have missed. But I do agree it's not even close to ready for actual real world applications, it's a neat tool to save on some boilerplate and some googling.

[Vorenus]

3:49 “there is no i in LLM” …great you got the joke 😂

[gsgregory]

The problem with trying to use an llm for this is that it can't think. At the base level it can solve "you used a metric wrench instead of a standard" type of problem because there is a clear right and wrong answer. They cannot solve "I cannot fit my hand in this space, I need to use a long wrench that has been shaved down to fit" because they have no understanding of the problem being solved and no way to think through it.

[bentleysayer]

Great takes, I can only imagine how many people were catching strays with the outro 😂😂😂

[matrixnorm]

Next in AI space: Copilot is using Devin to shit out nonsense.

[benjikrafter]

My use for copilot is to assist in research. If I can’t find proper documentation or examples for code, instead of scouring through the source files, I can ask copilot to give me a sample program that does X. Great tool to help learn and find things, but not to completely write MY code.

[dominiccogan]

😂😂😂😂 “The I in LLM sands for intelligence “ first time I heard that you killed me

[brymstoner]

that closing summary was everything people need to hear about real world dev work.

[chinyereUgwuoke-tplh]

Success is not built on success. It's built on failure, it's built on frustration, it's built on fear that you have to overcome. I pray that everyone who reads this remains successful in life.

[real.johannes]

This is not the music used in the original video. "Neon Beach - Tryhard" got replaced by "Warriyo - Mortals" (from NCS), probably due to licensing, etc.

[Ventus]

I was working with my boss on an powershell automation and he went back and forth cursing and cheering for copilot.

[bobbastian]

The music is like a 90s war movie.
This is gonna be good....

[Destide]

It really helps me to verticalise my code ceiling