I automated EVERYTHING in my HomeLab // Kestra #2

In this video I will show you my ultimate solution for automating everything in my HomeLab, where I integrate all my favorite automation tools and workflows, including Ansible and Terraform, into a unified workflow using Kestra as the platform that enables me to orchestrate all these tools together seamlessly, creating a powerful automation ecosystem. If you're a fan of automation, you won't want to miss this!

References

________________

💜 Support me and become a Fan!

💬 Join our Community!

👉 Follow me everywhere

________________

Read my Tech Documentation

My Gear and Equipment

________________

Timestamps:

00:00 How I’m automating EVERYTHING
00:58 What automation tools I’m using
02:14 The problem with Ansible and Terraform
04:09 My automation pipelines in Kestra
05:26 Build an Ansible Flow in Kestra
09:22 Problems with the Flow execution
10:55 Adding the private SSH key
14:18 Expanding the Ansible Flow
16:07 Some Ansible examples of my HomeLab
21:41 Terraform Flows in Kestra
23:21 Updating my DNS using Terraform and Kestra
26:21 GitHub Actions + Kestra + Terraform + DNS

________________
Links can include affiliate links.

[weholmes]

Just watched your 2023 Homelab Tour where you shared your 100k Creator Award. And here you are on the brink of 200k! Next Award will be well deserved. Keep up the great work/fun. You are much appreciated 😊

[glen_nz]

Something I'd be keen to see is a video about storing credentials securely, whether it be a key or an actual password - and retrieving it within Kestra.

[guanche]

Kestra looks cool, and it could combine a few tools I use professionally and at home. But, having no secrets manager and needing to taking everything down every time I need to add something is not an option. Paying for features is not a problem, but the only other tier next to 'free' is "talk to us". This is a really high barrier, while this is provided and managed in a free AWX setup.

Also concurrency requires separate tasks in Kestra and writing extra domain specific YAML, which makes migrating more expensive..

Overall I'm not sold yet. The product looks cool, flashy (slick UI i must say), but these are show stoppers. Would have loved to play with shiny things though ;)

[DreamerCze]

There is Event-drive Ansible now, that might be worth checking out.

[berndeckenfels]

If you automate it anyway, also manage the known hosts file with the server keys and not turn security in ssh off

[petrafied]

Please provide a link to the video for the Ansible tutorial mentioned at 12:00. I would like to generate an ssh key.

[AlphaX]

Does Kestra have a vault features to store secrets ? Inject SSH key in the container itself looks ok, but what about some other secret that you want to you use in the ansible playbook ? Do you really need to use the container environment variables each time you need to had a secret ?

[mariotubelecce]

it's basically jenkins with a nice interface and a paid option?

[RealNeuronaut]

you should probably not circumvent permission problems by running the docker container as root... adding the following task after the local file creation does the trick just as well:

- id: set_perm
type:
commands:
- chmod 600 id_rsa

[mikephares]

Great video. Thanks you for your time. Will you look into Gitea for triggering Kestra?

[sandeepreddy]

Hello Christian,

Loved your work…!!!
i really appreciate it,

It would be a great help, if you can show us how can i control the flow execution based on the exit code of previous tasks in kestra

[mathesonstep]

I am now trying to decide between using this or Ansible Semaphore

[Danielo]

What I want is a nice way to execute playbooks against custom servers in a nice UI

[ramomammah]

Is there a way to automate docker compose up using kestra?

[oneil]

nice video, but how do I use ansible-galaxy in kestra? only with the galaxy I can manage my proxmox.

[antonkozyk]

How do you use your /app/scripts? What kestra type can be used?

[corincorvus]

So Kestra replaced your Ansible Semaphore Installation in a past Video?

[piyushanand]

Hey Christian, your video is very helpful, but can you tell me how I can pass the password from the inventory only, I don't want to use key based authentication.

[hcjkruse]

Cool, I Didn't know Kestra going to look into it. Would be nice if Kestra also could run helm charts and docker-compose files.
Going to look into that. My first thought was, but I have a homelab git repo, but that was anwered quickly.

But.... Do you have a separate set of disaster recovery playbooks in a remote backup etc that you can use to setup the machines to run all this just from the shell? All this automation looks cool but bootstrapping it again by hand would not be fun.

[Glatze]

I prefer ansible and cronicle task scheduler for automating tasks in my homelab.