Using Python and AI to Automate My Video Editing Process

This is a behind-the-scenes breakdown of my current process for making videos (as of 2024).

In this video I'll show all the steps I take as I make these videos, the equipment I use, and some of the custom AI and automation tooling I've created to help make the process go faster (originally it was 1-2 months, now it's down to about 7 days).

I use a lot of automation (with Python and AI tools) to do a lot of the time-consuming work, such slide generation, editing, translation, and generating video meta-data.

📚 Chapters
00:00 - Introduction
00:45 - Video Production Process
01:59 - Project Idea
02:52 - Coding
04:21 - Writing
04:55 - Generating Slides
08:44 - Recording
09:44 - Editing
10:20 - Automated First Edit
14:05 - Translation Process
14:55 - Chapter Labelling
15:45 - Process Demo

[MichaelCannUk]

Great video Jakrin! Super useful advice and that part about using the embeddings for similarity detection is simply genius!

[st.m]

The vector embeddings step is super cool, I've never thought of using it in that way! I'm sure you're the only one who has ever done that.

[droidcage]

Dang, this is genius. I'm sure you could even sell this library of python scripts you've built for other content creators to take advantage of, maybe even save themselves some time.

[gustavojuantorena]

Wow. This is an incredibly valuable video. I'm not sure if I understand all the details but it's really thought provoking for creators. Thank you for sharing, this type of video will be a great addition to the channel.

[williamagyapong]

Wonderful! Have been looking for such help and tips to run my own channel. It’s incredible to see the amount of work that goes into every video you share. No wonder your videos are of such high quality and relevance! I discovered your channel about a day ago and have already fallen in love with your content. Keep up the amazing work. I’m learning a lot from you.

[webdoze]

Thanks! Not a lot are sharing this details.

[pradachan]

im glad to say that i've learned something new & would suggest u to make more videos centered around the topic automation with ai, it would eventually increase your viewers coz many people are new to ai + coding and they dont know how to mix and match it ....

[thefilmjerk]

Brilliant. I’m a small time commercial filmmaker who films interviews and then cuts stories from them. I’ve been learning Python in my spare time since January hoping I could use it to speed up my workflow and this is it! I’d love to talk about how to incorporate this process into mine where you’d give ChatGPT some themes and have it pull the related quotes and order them into a short story. For example, I usually interview someone for 30 min or so and then truncate that into a 2/3 min video piece. Is there a way to tell your model to look for certain themes and then compile a short story arc?

[richardbeare]

Thanks for sharing this! I've used whisper and LLMs for similar applications (e.g. automating game dialogue captions and localization). Automating video editing is no small task - but one I've been considering doing. I'm lucky to have found your video! I appreciate you sharing. Going to save me a lot of time.

[somestuff-kdcm]

Could you please share the code for this project?

[antaljani]

I love this video, and pretty sure I'll watch is several times in the next couple of days. I like very much automated editing, however this is absolutely new for me.
I see this video as most valuable for video content creators.
Thanks a lot!
(is there any way to get the Python files for learning this better?)

[alfredadam]

This is awesome and so valuable!
I am just wondering:
how do you link your slides in the autoedit to the right timestamp?

Do you use again embedding and cosine distance to link the script (and thus the slides) to your audio transcript?

[Rcky]

Quality work! You've earned a sub. Thanks for sharing. Look forward to your new posts!

[aiplusi]

Awesome tutorial, love it! Do you know if Capcut has an XML structure like Adobe has? The way you do the tiles is very cool!

[mrcallumfleming]

hey would you consider sharing the code you wrote to write the slides, im interested to see how you got the emojis and tables :)

[UmutErhan]

Where can I learn more about this xml editing for Premiere Pro? I had to learn adobe extendscript to automate video editing but it would be great if I was able to do it in python

[winnerking]

hello, I really appreciate your work. Please keep going
By the way, is it possible to get acces to these codes and automation tools ?

[KevinOMalleyisonlysmallreally]

This is great, but why not just write markdown in quarto in vscode and then everything is in vs code? Am I missing something?

[omelhoranime]

analyze my content, is there anything I can use from there?

[ibloo]

What API do you use to edit the videos?