No GPU? No Problem! Running Incredible AI Coding LLM on CPU!

Показать описание

Replit Coder from Replit and teknium

Base Model: replit/replit-code-v1-3b

This is version 2 of the Replit Code Instruct fine tune model.

This model is fine tuned on both Sahil2801's CodeAlpaca & Teknium's GPTeacher Code-Instruct to give Replit's Code model instruct capabilities.

❤️ If you want to support the channel ❤️
Support here:

Рекомендации по теме

Комментарии

On Windows the line
`python -m venv env && source env/bin/activate` may give you an error `'source' is not recognized`

To get around you need to use the (2 lines) as follows instead:

> python -m venv env
> env\Scripts\activate.bat

jgcornell

Dang you're churning out videos like a factory, thanks for your work, keep it up.

lord

INSTAND FOLLOW! Love your channel - much love from New Orleans!

TJTHEFOOTBALLPROPHET

This ran really well on M1 Pro (16") 16GB ram

though the ouput is a bit questionable (at least when it comes to Rust)

I wonder how easy it would be to fine tune with some coding specific human-reinforced prompts

thewilltejeda

We just need a better interface like Copilot where one can quickly switch between different generations and consolidate the best one.

jamesjonnes

I've found that on both Windows and Linux, it's best to use virtual environments for your python apps. Miniconda is my go to.

badgids

классное решение! какие еще модели можно использовать, перепробовал несколько моделей не работает (квантованные 4х битные и с поддержкой ctransformers) в чем хитрость?

djs

Hey there. Can you please make some more content on fingpt?

greendsnow

Okay. So. say my generated response was LONGER than the maximum token length, Anyone know of way to get iterative output. Clearly the model being trained to give reponses with a token start offset would be the dream.. but yeah.. anyone?

twobob

Has anyone had any luck finetuning this?

thewilltejeda

What can you actually do with this as far as creating apps or programs is concerned?

Corteum

can we give our own pdf or text file to this and ask from that?

ajeshm

can I fine tune this model or connect it to a local vector database?

rewanthnayak

No GPU? No Problem! Running Incredible AI Coding LLM on CPU!

No GPU? No Problem! A Quick Guide To Integrated Graphics

No GPU? No Problem! Finally run today's AI Applications!

No GPU? No Problem! Running Incredible AI Coding LLM on CPU!

Activating GPU on Google Colab

this is not a GPU #shorts

Computer Repair: Fix No Display For Integrated Graphics

PC Gaming Without a GPU is Finally Good

iGpu shows display New Gpu no display FIX

Lian Li LANCOOL 207 - Full Build! [NEW CASE!]

How to fix GPU No display but Fan spinning on Windows PC

Want a Free GPU? Do This!

Fixed - Computer Turns On But No Display & No Signal In Monitor | CPU Fan Spinning But No Displa...

Running LLaMA 3.1 on CPU: No GPU? No Problem! Exploring the 8B & 70B Models with llama.cpp

Frame Drops With Low CPU And GPU Usage FIXED?

GPU Not Showing in Task Manager Windows 10

Run Stable Diffusion on Your CPU. Not GPU Required

No GPU? No Problem! Wuthering Waves on Ryzen 5600G 💪

How To Fix Game Not Using GPU/Graphics Card In Windows 11/10

Nvidia RTX 3080 Mini! The Future of GPUs! #shorts #pcgaming #gpu #aprilfools

what if you plug a 2nd GPU into a running computer? #shorts

Your motherboard will kill your GPU if you are not careful

4 Problems that Cause a Faulty GPU and How to Fix them.

No GPU, No Problem? 2021 Productivity PC Build

Use My %@#$ GPU Windows!!! -- Forcing Windows 10/11 To Use Your Laptop NVIDIA GPU/eGPU