Run Llama 2 on Google Colab (Code Included)

#llama #llama2 #largelanguagemodels #llms #generativeai #deeplearning
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⭐ Learn LangChain: Build #22 LLM Apps using OpenAI & Llama 2 (13$):
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Llama 2 has been release by Meta AI, Llama 2 is an open source Large Language Model. Llama 2 comes with pretrained and fine-tuned generative text models, LLama2 includes 3 different models, ranging from 7 billion to 70 billion parameters

Download the Colab File:

If you enjoyed this video, be sure to subscribe and press the 👍 button

🧑🏻‍💻 My AI and Computer Vision Courses⭐:

📙 YOLOv9: Learn Object Detection, Tracking with WebApps (13$):

📕 Learn LangChain: Build #22 LLM Apps using OpenAI & Llama 2 (14$):

📕 Learn OpenCV: Build # 30 Apps with OpenCV, YOLOv8 & YOLO-NAS (13$):

Follow Me:

Chat with us on Discord:

For Consultation Call:

[muhammadmoinfaisal]

🧑🏻‍💻 My AI and Computer Vision Courses⭐:

📙 YOLOv9: Learn Object Detection, Tracking with WebApps (13$):

📕 Learn LangChain: Build #22 LLM Apps using OpenAI & Llama 2 (14$):

📚 Computer Vision Web Development: YOLOv8 and TensorFlow.js (13$):

📕 Learn OpenCV: Build # 30 Apps with OpenCV, YOLOv8 & YOLO-NAS (13$):

[briancunning]

Thank you so much fo writing this colab. Works like a dream out of the box and thanks also for taking the time to go through how it works in this video.

[ewwdog]

I really appreciate your video! I had been stuck for multiple hours getting LLama installed. Your example code and setup was very helpful!

[ywbc]

I enjoyed this video, so I subscribed and pressed the 👍 button

[sagunchalise]

Explained in such a nice way. Thank you so much for this. Will be subscribing your channel. Could you also take one use case for example- Training and finetuning the model to summarize the pdf or training the model to answer the domain specific questions using llama2

[AmineTeffal]

Thanks Muhammad for the great notebook. Running on colab is what I searched for ! It will great if you can try to do similar with Ollama and RAG.

[saffaahmad]

Thank you much buddy. I was looking someone who can explain this in simple way alone with code. You really made it simple n easy. If possible plz make video on fine tuning llama 2 as summarizing text from pdf and answering questions from the information present in pdf.

[uku]

Any way to run a WebUI with any chosen LLaMA 2 model from Colab? The only Colab file I've seen for running a WebUI doesn't have the model I want as an option. Thanks for the helpful video, liked and subscribed.

[sjboese]

I'm excited to give this a try but doing it 1/20/24 I'm getting a bunch of revision conflicts.
Tensorflow was incompatible with typing_extensions 4.9.0 so I force installed 4.5.0. However now I'm seeing errors that 4.5.0 is not compatible with fastapi and openai. Any advice on how to resolve the revision conflicts?

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
fastapi 0.109.0 requires typing-extensions>=4.8.0, but you have typing-extensions 4.5.0 which is incompatible.
openai 1.8.0 requires typing-extensions<5, >=4.7, but you have typing-extensions 4.5.0 which is incompatible.

[gauravraut]

How long length content it can generate and any other models which can generate long length content and also able to run on free colab

[craftedbysrs]

Can this be used for text classification?

[amanseth]

are these configs: lcpp_llm = None
lcpp_llm = Llama(
model_path = model_path,
n_threads = 2, #VCPU Cores
n_batch=512, # Amount of VRAM in GPU
n_gpu_layers=32 #GPU VRAM pool
)

going to run on free colab version with no GPU compute units available ?

[ViratSingh-nqok]

You said that the model executed inference very quickly but it actually took 2m 10s according to the Colab execution time output.

It's actually quite slow, no?

[usamaali]

How we convert this model into tensorflow lite? Can you please help me

[AbhishekBade]

how can i increase the limit of words allowed in the prompt

[ishikinokami]

Bro, I am getting assertion error when I execute the code.
I did not get the same error a month ago when I executed the same code.
Can you please help.
Bhai please help kardo

[artiflix]

Can you give me the code to create a chat loop please? I asked ChatGPT but he made mistakes.

[jionlys]

Hello, is it that Llama2 does not support multithreading, or is it because my configuration is too low? I can run it successfully following your steps. However, when I try to run two threads, feeding two different queries at the same time, the program crashes.

[artiflix]

Can I use it if I have the free version of Google Colab ?

[zahrasadeghigol]

how can i access to these codes to this video?