Pro's Finetuning Guide for GPT and LLMs

WRITING STUFF

[DaveShap]

Correction for the SBD training: the "scrambled" dataset was the input, the correctly formatted Wiki was the output. My bad.

[JRMI]

This is top tier David 💎 THE best video on fine tuning I’ve found and trust me I’ve been searching. You gave a solid map to get me started.

[micbab-vgmu]

For my workflows, I still achieve better results using RAG and prompt engineering than fine-tuning. Thank you for the video.

[imthinkingthoughts]

This video feels uncanny. Love your work Dave, but I stay for your personality ♥

[heski]

very good info, thx. Waiting for GPT4 be able to be finetuned! OpenAI promise to open acces to GPT4 finetunning this autumn!

[zhalberd]

Thanks for taking the time to keep making videos. We all know you’re neck deep in ACE right now. Would LOVE to see more info about CoR experimentation.

[bentray]

Dave, must be working on a workflow where you provide key information in an episode and have GPT4 iterate the script then use an API to generate and post the synthetic voice and images. Its interesting.

[remsee]

Oh I need this so it can understand my codebase

[DefenderX]

I know this might be against transparency, but I think AI conversing between each other in an AI's own novel language would increase the efficiency of the AI's work, basically due to the need for less tokens for all messages than English.

[VastCNC]

Do you have the hardware to do a Llama 2 implementation from soup to nuts? I think that would be an interesting series

[benjaminheim]

David I would love to see a response from you on the new “reversal curse” paper that demonstrates a failure of LLMs to generalize B to A given A to B. I’m usually an optimist when it comes to the transformer architecture and LLMs, but this has me worried.

[cjsmith]

Hey Dave great video. IIRC you said you were getting an editor if this is their work they did great.
Did you guys use AI to generate your voice though? Noticed a few oddities that stuck out. like your inflection was very neutral throughout most of the video.
Also, what happened at 11:36?

Again great video, hope you are doing well!

[TheREAL.BrandOnShow]

David! Is this video made with 11labs? Your voice sounds synthesized and I noticed you do not appear in this video! Am I right? :))

[TheYvian]

Listening to the end of the video, it sounds a bit "off" such as the pronunciation of "the movie Her". Voice clone AI?
Great and informative video nonetheless, but i'm so used to your personal style of speech and the cam appearance that this didn't feel like a Dave Shapiro video.

[fRSky]

I mean, euthanasia reduces suffering in a short term...

[ladams]

Doesn't sound quite like Dave. Was the voice AI generated? Maybe it's the mood of the speaker.

[Diabloto]

This is very monotone, hard to keep up without the slides tbh, is this tts?

[moistweener]

this whole video was done with AI haha