Warning

 

Close

Confirm Action

Are you sure you wish to do this?

Confirm Cancel
BCM
User Panel

Site Notices
Posted: 3/1/2024 4:09:39 PM EDT
I have a TrueNAS box that is the main component of my home lab (runs several  VMs and apps in k8s). There are about 20TB of files on there. The bulk of the files by way of size are photos.

I currently back that up to another TrueNAS box that exists solely for the purpose of backups. I'd like to replace that box with a low power/heat machine that I can put in the safe.

The problem is that that second box probably wouldn't run ZFS, and if it did, it probably wouldn't support ECC memory.

Suppose a bit gets flipped on a file on the backup box, I'm assuming there's no feasible way for the primary NAS to catch that and re-write the file? As I understand it, tools like rsync just use the filename and size of the file to determine if a file is "the same," and a file with a single flipped bit wouldn't be identified as being different....

Link Posted: 3/1/2024 4:33:07 PM EDT
[#1]
I'm in exactly that situation.

I've got a Synology NAS I'm using to back up a system running ZFS.

I've got the NAS providing an iSCSI target that is used as a ZFS pool on the system and I 'zfs send | zfs recv' entirely locally.

It feels dumb but it works.
Link Posted: 3/1/2024 4:46:29 PM EDT
[#2]
Originally Posted By Flockas:
I have a TrueNAS box that is the main component of my home lab (runs several  VMs and apps in k8s). There are about 20TB of files on there. The bulk of the files by way of size are photos.

I currently back that up to another TrueNAS box that exists solely for the purpose of backups. I'd like to replace that box with a low power/heat machine that I can put in the safe.

The problem is that that second box probably wouldn't run ZFS, and if it did, it probably wouldn't support ECC memory.

Suppose a bit gets flipped on a file on the backup box, I'm assuming there's no feasible way for the primary NAS to catch that and re-write the file? As I understand it, tools like rsync just use the filename and size of the file to determine if a file is "the same," and a file with a single flipped bit wouldn't be identified as being different....

View Quote


You can "zfs send" your dataset to a tarball - it's not optimal for a variety of reasons but you can do it

You can run a pretty low power TrueNAS box, but I don't think you're going to get a low-enough to run inside a completely closed safe
At minimum you'll need to get low power ssd and ram instead of spinning disks - 2x 3.5" hdd will generate enough heat to need ventilation, and some ssd controllers will also need ventilation

If you're trying to do this as a major disaster recovery thing, consider instead/also backing up to an offsite bulk cloud storage like backblaze b2 or aws s3 glacier
A tool such as rclone can encrypt locally before uploading and the cost should be around $30/mo for 20TB on B2, and cheaper for S3 Glacier (but you'll pay alot more to get your data back out than B2)
Both services have a way to do a one-time bulk transfer with a standalone device if you don't have enough internet to upload the 20TB initially
Link Posted: 3/1/2024 7:01:02 PM EDT
[#3]
Discussion ForumsJump to Quoted PostQuote History
Originally Posted By mnd:
I'm in exactly that situation.

I've got a Synology NAS I'm using to back up a system running ZFS.

I've got the NAS providing an iSCSI target that is used as a ZFS pool on the system and I 'zfs send | zfs recv' entirely locally.

It feels dumb but it works.
View Quote


Does the Synology NAS have ecc memory?
Link Posted: 3/1/2024 7:02:27 PM EDT
[#4]
Discussion ForumsJump to Quoted PostQuote History
Originally Posted By stiglitz_actual:


You can "zfs send" your dataset to a tarball - it's not optimal for a variety of reasons but you can do it

You can run a pretty low power TrueNAS box, but I don't think you're going to get a low-enough to run inside a completely closed safe
At minimum you'll need to get low power ssd and ram instead of spinning disks - 2x 3.5" hdd will generate enough heat to need ventilation, and some ssd controllers will also need ventilation

If you're trying to do this as a major disaster recovery thing, consider instead/also backing up to an offsite bulk cloud storage like backblaze b2 or aws s3 glacier
A tool such as rclone can encrypt locally before uploading and the cost should be around $30/mo for 20TB on B2, and cheaper for S3 Glacier (but you'll pay alot more to get your data back out than B2)
Both services have a way to do a one-time bulk transfer with a standalone device if you don't have enough internet to upload the 20TB initially
View Quote


Backblaze and others would be pretty expensive... For instance, backing up 20TB to something like Wasabi would be $140/month....
Link Posted: 3/1/2024 10:06:47 PM EDT
[#5]
Originally Posted By Flockas:
As I understand it, tools like rsync just use the filename and size of the file to determine if a file is "the same," and a file with a single flipped bit wouldn't be identified as being different....
View Quote

Your understanding is incorrect. rsync is a block-level copy. If a file changes at all it gets seen as different compared to the destination and is copied over. It doesn't validate what makes it different, just that the blocks are different. Changing a single bit or byte on the file will change the block(s) the file is on and it will get flagged by an rsync.
Link Posted: 3/1/2024 10:21:04 PM EDT
[Last Edit: mnd] [#6]
Discussion ForumsJump to Quoted PostQuote History
Originally Posted By Flockas:


Does the Synology NAS have ecc memory?
View Quote View All Quotes
View All Quotes
Discussion ForumsJump to Quoted PostQuote History
Originally Posted By Flockas:
Originally Posted By mnd:
I'm in exactly that situation.

I've got a Synology NAS I'm using to back up a system running ZFS.

I've got the NAS providing an iSCSI target that is used as a ZFS pool on the system and I 'zfs send | zfs recv' entirely locally.

It feels dumb but it works.


Does the Synology NAS have ecc memory?

Some do.  DS 723,923,1522 at least do, and those are the size of what you'd store in a safe.

ETA: And those units can be upgraded to 10GB ethernet, which is helpful if your snapshot replications are on the ample side.
Link Posted: 3/7/2024 1:38:41 AM EDT
[#7]
OP, you can run ZFS on any type of Linux/Unix box.  And while ECC is recommended while running a ZFS file system, its not mandatory.  My file server in my basement is running Debian 12, and has a 34 terabyte ZFS volume on it.  System does not use ECC memory either.
Close Join Our Mail List to Stay Up To Date! Win a FREE Membership!

Sign up for the ARFCOM weekly newsletter and be entered to win a free ARFCOM membership. One new winner* is announced every week!

You will receive an email every Friday morning featuring the latest chatter from the hottest topics, breaking news surrounding legislation, as well as exclusive deals only available to ARFCOM email subscribers.


By signing up you agree to our User Agreement. *Must have a registered ARFCOM account to win.
Top Top