Exploring StarCoder: Open Source LLM for Code Completion

StarCoder, the hottest new Open Source code-completion LLM, is based on GPT-2 architecture and trained on The Stack - which contains an insane amount of permissive code.

Star Coder shows how open source AI is advancing fast. The model may not match GPT-4 but it highlights how the community is gaining capabilities that are on pace to match industry titans such as Google and OpenAI!

Overall, Star Coder is a solid model for code completion!

Check it out - it's totally open source!

#llm #generativeai #huggingface #starcoder

[justinmilner]

Anyone know if it's possible to host Star Coder locally?

[creativeuser]

Can you do a review on all of the other code copilots and show us which is the best?

[Machiuka]

How to use it locally through gpt4all? Thank you!

[HaseebHeaven]

This needs lots of improvement the Codex AI is far better model

[arvj]

I was so looking forward to using this LLM to use on my iOS project and then the paper said, "Out of the languages present in MultiPL-E (Cassano et al., 2023), only D and Swift were not included in the training set. For D, language misclassification of the files led to less than 2MB of data in The Stack (Kocetkov et al., 2022). For Swift, due to a human mistake, it was not included in the final list of languages." lmao wat

[Mihaela-wtu]

Very informative video, thank you.
One question about HuggingFace Chat. How did you get the change model option ? I see the current chat version is v0.2 and in this version or in my account at least, the change model option is missing.
Thank you

[amparoconsuelo]

Can a subsequent SFT and RTHF with different, additional or lesser contents change the character, improve, or degrade a GPT model? Can you modify a GPT model?