How to use Llama 3(70B) API for FREE (beats GPT4 for business!)

Llama 3, an open-source model from Meta, is truly remarkable but can demand significant resources. In this video, I guide you through running the 80-billion-parameter model using Groq cloud API, unlocking its power for free (Grow is currently free with rate limits)

Llama 3 80B

[Shiffo]

Is your data secure if you run it through Groq? i want to use llama on excel data but don’t want to leak information.

[emilsmezinskis]

why I have this error? export GROQ_API_KEY="my_api_key"
export: The term 'export' is not recognized as a name of a cmdlet, function, script file, or executable program.
Check the spelling of the name, or if a path was included, verify that the path is correct and try again.

[DAvgGamer]

Excellent video. Suggesting to optimize the video more in terms of description and keywords so that you end up getting more search traffic. Please keep up the good work.

[knight]

That's great. Thanks for the video, sir.

[mohamedalichakroun]

Thanks, but It can extract data from images ?
I tried llava but it gave me a bad result
Always say that the image provided doses not have good resolution ?
Can you please make a video about that like you did with gpt4 for conversion img to json

[ashleylauren]

Thanks! Super helpful and straight to the point

[pacific]

Hi, is it imp to download the model and do the setup or just calling api in backend is enough to get ai response does meta provide the api service since i dont know python I rely on api only 💀

[LegionLeague]

This seems to be a real game changer for developers, but something feels off. What are caveats of running groq + llama 3 for free? What are limitations? Why is everyone and their grandmother not creating apps with this exact set up right now?

[GurbyTheGreat]

If it's free your prompt content is being saved. 70b costs lots of money to run on a server like this, it's not free!

[PalkiaOwnsYou]

Hi,
Is there a way for the code from this video to be posted?

[JackFlas]

Great vid! I could manage to make it work, but not with all the code you gave. Either it writes an empty .md or else I erase some of the code and gives me the cv on the output console but it doesn´t create the .md file.
This is the error I get: "line 36, in <module>

AttributeError: 'Stream' object has no attribute 'choises'"
Could you give me some hints?

[MedhanshSharma]

i want to use it in spring boot project how to do that

[definitelynorandomvideos]

Any idea what the rate limits are? Couldn't find that information on google :/ I only saw the max tokens per request.

[Yuri-wkrk]

Thank you, please post source code next time ! :)) I havу tested it, works perfect

[playgirl]

when i do the 'python project.py' step in terminal it doesnt work. how to fix this?