Using Llama Coder As Your AI Assistant

In a recent video some folks asked which languages these AI assistants support. To answer that, I have to explain how they work. And this video does that.

My Links 🔗

[trsd]

This is by far the best video I have seen for self hosted ai code assistance! Great understandable explanation and very important details! Thank you!

[calvinnguyen]

Love the clarity and production of your videos. Thank you Matt!

[JunreyBeduya]

I haven't really followed this kind of stuff but your explanation is very clear and I am now running a local instance of code assistance AI. You deserve more subscribers.

[bosthebozo]

Dude your awesome, easy to understand and love the subtle bits of humor. Subbed

[outofahat]

I just discovered self hosted ai and I’m going through all of your videos. Thank you so much for providing this very useful content.
Particularly liked the part where you show the prompt being passed visible in the logs

[vpd]

Just subscribed. Love how your videos stay on point and how your explanations are easy, taking into account all our (assuming) varying levels of knowledge and experience in using these tools.

[MatiasBerrueta-pn]

Incredible ! thank you Matt !

Can you show which tools or process can be used to train or give our context to a model? would be great to tell the model `learn from this documentation` or `seek in my previous projects`

[Silviu-The-One]

I like that you are not chasing clicks. Keep up the good work.

[thinzin]

love the way you do these video, Thank you very much creating such niche content for us

[prestonashworthmusic]

This was great. Clarified some things for me and it's great to be able to get at log messages and see the prompts, etc.

[teamjupeter]

Just wonderful. Much thanks from South Korea.

[agenticmark]

This is a much better way to run models compared to LMStudio. Thanks for the in depth to replace codepilot!

[savantofillusions]

Llama is good at explaining documentations too

[halgari]

“What’s Idris?” as yes, a language where you can define the types and the compiler writes the internals of the function. It’s like Haskell, but even more elite

[banzie]

Subscribed and linked. Definitely an underrated video. Yet to check out your other videos, and will check those out too. You mentioned that you were using a m1 based laptop (assuming, due to the reference to battery life). Not sure if you sped up the inference part of the video, but if that is the native inference speed, it really is great. Is there any video where you've covered the specs of this laptop ?

[envivomedia]

Really informative and great delivery! I see you're just starting your channel (5.71k subs at time of writing). Keep up the great work!

[xoptics]

The thumbnail says “better than copilot” - that’s the thing I want to know! I use copilot and ChatGPT daily in my work and it’s hard to find time to set up and maintain the best open-weights models.

So my question is, for popular languages (let’s say TypeScript and python), do the open-weights models match copilot and gpt4? I’m concerned with code quality.

I also often use the chat interfaces to just rubber duck, so that’s valuable too.

Thanks for your insight. I know there probably isn’t an unambiguous answer, but I’d love to hear your thoughts.

[c]

I really wish you talked about the hardware requirements for running the models locally.

[robwin]

Matt, I do not see COBOL (of any flavor) especially for PCs; e.g., MicroCOBOL and or GnuCOBOL 😢😢😢

Which Ai Code Assistant can GnuCOBOL?

Is LaTeX not considered a programming language?
Or is LaTeX considered native to all Ai entities?

[tomw]

GPT-4 has high ability to correct itself. Have you tested if Llama coder can be used as reliably as GPT4 to review and correct the code itself if it's incorrect?