Тёмный

Backup & Recovery Made Easy: TrueNAS ZFS Replication Tutorial 

Lawrence Systems
Подписаться 341 тыс.
Просмотров 32 тыс.
50% 1

Опубликовано:

 

15 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 63   
@Z0eff
@Z0eff 6 месяцев назад
Having the two different TrueNAS systems use a different color theme makes a huge difference, thanks!
@RonnieRedd
@RonnieRedd 6 месяцев назад
That's basically how I have my 2 truenas boxes setup. Been running them for years now. It works perfectly 😊 That said I still use core. I'll go to scale when core goes EOL
@karelsantana2729
@karelsantana2729 3 месяца назад
The best contents about truenas, just here, thank u. I have learn a lot since I find ur videos and forums. Thanks again
@parl-88
@parl-88 6 месяцев назад
Loving these TrueNAS Scale videos! Thanks Tom. Great job.
@2008mjb
@2008mjb 6 месяцев назад
This was what I had planned for next week. Perfect timing. Thanks... :)
@leozendo3500
@leozendo3500 5 месяцев назад
For encryption, the fact you must type a directory name to make a new directory instead of making a dataset and choosing it, is extremely confusing and impossible without this video. Thank you so much. for more info, no matter the property you set for the designation it will not work, unless you double encrypt (encrypted designation inherited folder, and re-encrypt the snapshots sent to put in there).
@mutosanrc1933
@mutosanrc1933 6 месяцев назад
so niceeee. Just what I needed now as I bumbed into problems. Got a secondhand HP DL380 Gen9 to get rid of my very loud and very old IBM 360. Hope I can manage the replication with this tutorial. also boot disk is failing on the old system and dont know if I can replace that so I move to the new system.
@dyong888
@dyong888 Месяц назад
Great video. I'm just about to build a 2nd TrueNAS system to do just his. One question: I plan on replicating from the current system that is still running FreeNAS-11.3-U5 to a new system running the latest version of TrueNAS SCALE. Do you think this will be a problem? What can I do instead? Thanks.
@JonnieZuramski
@JonnieZuramski 3 месяца назад
Okay, I had a misunderstanding of replication. When a task is completed the files are written to the other pools and appear in a filesystem the same way they are on the source end so you can interact with them. I thought replication stored it in a way where the data wasn't accessible unless recovered. I'll be using this for sure! I have two TrueNAS scale systems one at my house, one at my parents, both running Plex. Would like to back up there to their Plex library so they can also view the movies I add and it seems like this would be a good solution. Does that sound about right?
@jgren4048
@jgren4048 2 месяца назад
Thank you so much for this. It helped me realize what I need to do for backup. Question I have , does the drive capacity of the backup server need to be as large as the data set that is snapshot? I ask because say all the data on my main pool is gone. 4 drives dead, z3, so the data is essentially gone. Is it possible to use these snapshots to layer back onto a new pool of drives say larger in capacity than before? That are currently blank? Or would those existing drives also need to be used? Would it be possible to recreate from scratch like that? I’m scared to death to lose my zpool disks and need someway to replicate the data if kind of a total failure happens
@jifgif
@jifgif 6 месяцев назад
Just a note, I use Tailscale in subnet router mode on each side. I had to select Netcat Active Site as REMOTE for the replication task to commence.
@jgren4048
@jgren4048 2 месяца назад
Good tip thanks
@TheDillio187
@TheDillio187 5 месяцев назад
doing pulls of data from a production TrueNAS to a backup one is a pretty awesome way to create hidden backups.
@ramachandrants2849
@ramachandrants2849 3 месяца назад
Thank you for the great tutorial. I successfully replicated my dataset, but I'm having trouble replicating "ix-application." I'm running Immich (App) on my primary TrueNAS Scale server. How can I replicate it to my offline TrueNAS server?
@Brakken99
@Brakken99 2 месяца назад
@LAWRENCESYSTEMS A question that I see myself and others struggle with about snapshots and restoring as a backup solution is: If I just start creating snapshots on an already established dataset that is 4TB in size, and a year from now I need to rebuild that dataset from a catastrophic failure, how would it be rebuilt from the most recent snapshot if it only reflects the last changes of say, a single pdf that was added? Wouldn't restoring with this snapshot only restore what it had detected as what changed since the previous snapshot and nothing before that? I have a hard time wrapping my head around how a 10kb snapshot can restore a 4TB+ dataset with this.
@Sanyi83
@Sanyi83 2 месяца назад
I am building a second system next week to do this exact thing.
@itupdate156
@itupdate156 2 месяца назад
what do you think about FreeNas 11.2 replication to TrueNas, it's Possible ?
@saphy-old
@saphy-old 6 месяцев назад
brilliant, thank you for this well timed video. i don't suppose you have a "cloud sync" tutorial in the works?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
I have some older videos on CloudBackup I might do some newer ones but the cloud backups are easier than TrueNAS Replication ones.
@IPD2001
@IPD2001 Месяц назад
I would like to replicate from Core to Scale. Everything is setup propperly with SSH. Problem is after just a few moments I am getting this error and I don't know which permission are wrong and how to fix that. :( Replication "Datasetname" failed: cannot receive new filesystem stream: permission denied warning: cannot send "Snapshotname" signal received.
@goldfingerdash
@goldfingerdash 6 месяцев назад
Thanks for the video. Replication from scratch is still a bit unclear to me. Let's say the backup server has replication data from multiple TrueNAS servers. Will Replication from scratch delete all snapshots regardless of destination paths, or just the snapshots for a set destination path?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
From scratch is just for that dataset path on the destination
@dozerd42
@dozerd42 6 месяцев назад
I've seen a lot of videos like this in setting up replication, but I haven't found anything on restoring TrueNAS from a replication after a complete failure. If system A replicates to system B, how do I restore system A from B after system A fails?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
You simply reverse the process
@dozerd42
@dozerd42 6 месяцев назад
​@@LAWRENCESYSTEMSawesome. Thanks for the reply.
@BlackC5Z06
@BlackC5Z06 6 месяцев назад
You do a one time, non scheduled, replication from the backup server to the main server and proceed as normal.
@rokyo401
@rokyo401 6 месяцев назад
Perfect, just what I need! So, the replication task always does a RAW send (zfs send -w), so that encrypted datasets are always sent encrypted on the wire by default? And the SSH encryption (if turned on) would basically send doubly encrypted data? What does the other "Encryption" checkbox on the right side (under the destination) do? From the video it looks like the destination dataset automatically was set as encrypted because the source was, even though, this "Encryption" checkbox was not checked in the setup of the replication. Is this checkbox only needed to turn unencrypted source datasets into encrypted ones on the target? One technical question: Does the encrypted dataset need to be locked in the moment when "zfs send -w" (or the replication task) is run in order to be sent encrypted or will it be sent encrypted even when the dataset on the source is currently unlocked (like in the example here)?
@entelin
@entelin 6 месяцев назад
The locked / unlocked status of a volume, indeed even if it's mounted or not, has no impact on the ability to send. Keep in mind, you're sending a snapshot anyway, not the truly live data. In fact the destination server doesn't even need the encryption key for this to work, it's not important that the destination server be able to actually decrypt the volume it's receiving. ZFS send operates at the volume level, not the file level.
@rokyo401
@rokyo401 6 месяцев назад
@@entelin oh yeah right, the replication sends the snapshot! Then it makes perfect sense that it would always be sent encrypted
@phasechange5053
@phasechange5053 27 дней назад
This definitely seems to be the Ticket for Full speed no overhead Truenas-Scale backups/Replications for DATA. I also like you can turn the backup/Replication Truenas Box into a Big JBOD Mixed Capacity Disk so I was able to put together a 35TB backup repository easily with some Misc Large/Med TB Drives i had to just serve as a backup form my ZFS Raided data. Even Still it replicated at 2.5GB/s on HDDS (Not SSDS) maxing out the 2.5GB network in my home. I tried to do this with Veeam B&R CE via - W10/11 Backing up Proxmox VM and it was stuck Sub 1GBPS for what ever reason Didn't mater if i run the Veeam B&R CE on another HEDT or a worker on the destination off the Backup Box or with a Root install of windows just slow never broke 1GBPS I ended up giving up i just have way to much TB for it to not get a full 2.5.
@HermieDaddy
@HermieDaddy 6 месяцев назад
If you manually snapshot the source and the destination, can it determine differences and copy just those or will the destination allways be wiped out? this was not clear.
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
You can have it send over all snapshots from source both manual and automatic, but don't make changes on the destination because they will either be over written or cause the process to fail.
@MikelManitius
@MikelManitius Месяц назад
Very helpful, thank you.
@peterworsley
@peterworsley 6 месяцев назад
How can you us the Zpool iostat and other commands in Truenas Scale?
@jonathanchevallier7046
@jonathanchevallier7046 6 месяцев назад
Thank you for this great and detailed explanations.
@UnwalledGarden
@UnwalledGarden 6 месяцев назад
Is replication an extension provided by Truenas, or a built in feature of zfs? In other words, can one replicate zfs snapshots between systems that aren’t Truenas?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
This is a function of ZFS but for simplicity of this video I kept it just to showing how to use it in TrueNAS.
@UnwalledGarden
@UnwalledGarden 6 месяцев назад
Thanks for the reply.
@johnharrison712
@johnharrison712 6 месяцев назад
Would this be a good idea for say something like a active failover if your running your own hardware? Then on XCPNG just manual flip the connection?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
There is not a simple process for that, so not really.
@johnharrison712
@johnharrison712 6 месяцев назад
That is what I thought, I'm trying to use 2 of the same hardware I have for an Failover just incase trying to be like a normal SAN without like XOSAN or vSAN@@LAWRENCESYSTEMS
@rodri1030
@rodri1030 5 месяцев назад
Is Raidz necessary with a setup like this if availability is not important but data integrity is?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 5 месяцев назад
You need at least 2 drives to validate & fix data integrity issues.
@franktippin9150
@franktippin9150 6 месяцев назад
Did I miss it but did you ever state that that netdata is now the built-in system reporting app?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
You can load Netdata as an app
@nicoladellino8124
@nicoladellino8124 6 месяцев назад
Very useful video, THX.
@npham1198
@npham1198 6 месяцев назад
Does this still work well if you use the truenas box for esxi datastores
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
Yes
@mspencerl87
@mspencerl87 6 месяцев назад
Why is ZFS replication on target system read only by default?
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
So you don't mess with the backup data because if you do it will need to resend the snapshots again from the source
@HermieDaddy
@HermieDaddy 6 месяцев назад
@@LAWRENCESYSTEMSaha thats what I am doing wrong. I really cannot touch anything in the replica? I was thinking they could both be doing snapshots and sync...
@LAWRENCESYSTEMS
@LAWRENCESYSTEMS 6 месяцев назад
@@HermieDaddy That is why in the beginning of the video I explained the concepts of how it works and that it IS NOT a syncing system.
@rameshy-ex6gn
@rameshy-ex6gn 5 месяцев назад
sir explain from other system to nas..........in local network file sync............
@this_is_tn
@this_is_tn 6 месяцев назад
Great video!
@Wilarico
@Wilarico 6 месяцев назад
Encrypt everything... the actual cost of time/bandwidth is not that significant anymore IMHO
@Robert-sj8ld
@Robert-sj8ld 6 месяцев назад
👍🏻👍🏻👍🏻👍🏻👍🏻
@SuzanneFleming-nj5cc
@SuzanneFleming-nj5cc Месяц назад
Smith Helen Perez Ruth Anderson Cynthia
@TechySpeaking
@TechySpeaking 6 месяцев назад
first
Далее
Configuring TrueNAS NFS Share for XCP-ng
12:41
Просмотров 17 тыс.
Getting the Most Performance out of TrueNAS and ZFS
18:31
The PERFECT Desktop Homelab Server!
16:45
Просмотров 100 тыс.
6 Crucial Settings to Enable on TrueNAS SCALE
11:16
Просмотров 78 тыс.