REMOTE BACKUP: FreeNAS to AWS S3 Glacier

preview_player
Показать описание

Beware of "per-request fees" when doing S3 cost calculations.

FreeNAS discussions:

Some of backup scripts to my data onto my freenas organised by YYYY-MM-DD
Рекомендации по теме
Комментарии
Автор

NOW I have my costs under control by using FreeNAS 12 (unreleased) with rclone Fastlist (this reduces the listbucket API calls and associated costs), uploading as DEEP_ARCHIVE storage class and doing away with (lifecycle) transitions which cost a lot. TODO, blacklist more files. Uploading node_modules for example is not only stupid, but very expensive due to sheer volume of objects created!

kaihendry
Автор

did you write your own script to upload to b2? it may be slow because b2 doesn't have any servers outside of the 1 in the US, but most of the time i found b2 third party upload utils were itself causing the issues. its worth noting that b2 is way cheaper and does provide free egress to cdn with cloudflare (With sg servers)

rickyu
Автор

FreeNAS at home and remote backup FreeNAS at a friends home!
And he has backups at my FreeNAS box!
Best and cheapest solution imo.

shaytal
Автор

For my personal stuff backup, my method is bit hacky. I got a G Suite account which has nearly unlimited google drive storage ( daily limit upload around 700+ GB ), so I usually just encrypt, zip them and upload to google drive using gdrive

rayrayray-ll
Автор

Not sure if it would be appropriate for your usecase, but might be worth looking at AWS Deep Archive, basically Glacier with longer restore times (12-48 hours) but cheaper storage cost, works out as a $1/month/TB, (excluding other fees, which is always something to keep a eye with AWS)

Conaerr
Автор

For backup I use offline hard drive and MegaSync(50GB)

yrun
Автор

If you don't mind getting spied on ( you'r using amazon after all ) then use google photo. I backs up all your photos and videos with unlimited storage. The rest of your stuff that is not photo or video can go to a free google drive where you have 15 gigs and if you need more for the non photo videos, then you either buy up space from google or use AWS for the remainder.
There you go, that should lower your cost to almost 0$

walid
Автор

B2 is slow ! But its cheap ! I backup about 20TB to it a month. (total store, not data transfer )


Problem i have is that it uses rsync, i want a place where i can just use a zfs send command.


Sync failures are usually long filenames.

andljoy
visit shbcf.ru