Backup Proxmox VE to the CLOUD! Backup Hook Scripts to push backups to S3-compliant cloud storage

Proxmox has a pretty good backup scheduler, but it relies on the backup destination being mounted as a storage location. This implies that the backup destination needs to be a protocol that Proxmox supports - SMB (CIFS), NFS, … or Proxmox Backup Server. If you want to push your backups to a cloud service, you probably need something a bit more complicated. Thankfully, Proxmox’s backup scheduler thought about this and has a hook feature we can use for this purpose, and we can use any protocol supported on the Debian base system, including things such as FUSE or s3cmd.

In this project, I integrate S3-compliant cloud object storage with the Proxmox backup scheduler, copying resulting backups to a cloud storage service directly from the Proxmox system. The S3 protocol is ubiquitous among cloud object storage providers, so we aren’t tied to AWS - we can use any service such as Backblaze. In my case, I’m demonstrating this with Linode.

YES, I deleted the access key after using it in this video. I didn't want to deal with blurring it.

Link to the blog post on this topic, which includes the final script I used for you to copy and paste:

My Discord Server, where you can carry on the discussion or suggest future topics:

Timestamps:
00:00 - Introduction
01:13 - PVE Backup Hook Scripts
07:12 - S3 Tools
10:45 - Backup Script
12:16 - S3 Cleanup Script
13:28 - Conclusions

Proxmox is a trademark of Proxmox Server Solutions GmbH
#proxmox

[derXner]

Thanks for the video, it helped a lot. By coincidence I found one more hook: job-init . It seems as if it is executed right at the start so i was able to start my backup server via wake on lan before the pve checks if the backup server is available. Now I have daily backups on a different machine without powering a thinclient and backup disks 24/7.

[franckbellot]

Thanks a lot for this video, it help me a lot to set external backup copy to cloud

[Jojje]

2024 here thanks for the guide, set it up with Backblaze without a hitch.

[mikecaldera]

"My favorite person is my cat!" 100 percent and I have that same mug!

[thepiecesfit]

Thanks for the tutorial works great. Only issue I'm having right now is the seemingly slow transfer rates to Backblaze B2 S3 bucket. Took me 35 minutes to upload a 10GB file on a Gigabit connection.

[akurenda]

One more time for the people in the back. Raid is not a backup!

[Jeppedy]

Since I already have my NAS pushing backups out to the cloud, I don't need to specifically make a backup to the cloud.
Cleaner and easier, where my NAS has RAID, onsite backup, and cloud backup. This includes my backups I store on my NAS...

[abdallahhanoun]

Thank you you always inspire me to learn Proxmox

[mikemorris]

Great vid you should include a IPFS option it might be easier for many to do.

[lucaszampieri]

That is great, but how would you go about restoring a vm of those backups?

[RickBane]

Great tutorial as always. Do you know if s3cmd work with storj?. Thanks and regards.

[CasualtyGaming]

woah your clipboard is working or its limited to the OS?

[GerryCrooked]

So if I got it right, no possible way to get incremental backups on s3, as it would modify it? :-/

[SEOng-gslj]

is there a way to backup an attached data disk of a PVE VM while it is running?

[BetaPhish]

The script isn't working I get unknown phase.

[WolframWebers]

Nice video. Lets just hope you invalidated the credentials you used in the video. Just a hint.

[nbensa]

Hi! You can just add `script: /path/to/script` in /etc/vzdump.conf ... downside: the script will run for every backup job and maybe is not what you want