Thank you, this 7 year old video is the only video that explained this in a way that is easy to understand, i wasted so much time watching 40 min videos and having no idea what they are talking about.
+My Playhouse, Morten, at 06:47, I believe that your overall single hard drive capacity, depends on how you format it. For example, a 1TB hard drive, will actually have 931.32GB of free space. A manufacturer considers 1 Megabyte to be 1000 Kilobytes, 1 Gigabyte to be 1000 Megabytes, 1 Terabyte to be 1000 Gigabytes and so on. This is correct considering that kilo means 1000 and mega means 1000000 (10^6). However, computers calculate on base 2 and to them, 1MB is actually 1024 kilobytes, 1GB is 1024MB and 1TB is 1024GB. This difference in the method of computation is responsible for this "missing space". For example, a 500GB disk from a manufacturer's point of view will have 500*1000*1000*1000 = 500000000000 bytes. However, from a computer's point of view, 500GB is actually 500*1024*1024*1024 = 536870912000 bytes.
Hi +Rinoa Super-Genius Thanx,, I do hope it helps you. I am not as good as you,, you can explain a lot in just one take,,every day! Thank you for watching! :-)
Thanks for a brilliant video. It really clarified how I can get the best from my DS420+. I set up 2x4TB as RAID1 and then found I couldn't add two more in flight so I had to re-think it. Now going for SHR with 4x4TB. Great stuff and thanks again.
This was actually very helpful. Thank you for that! So when buying a nas with say 4*4 TB in an SHR config... You'd get 16 - 4 = 12TB worth of usable disk space. When you want to increase the disk space you actually need to buy at least 2 bigger drives. That I didn't know.
Hey Morten. Remember that BTRFS has some advantages over ZSF, mainly that you can add drives to a BTRFS pool but not to a ZSF pool. BTRFS now also supports raids 5 and 6, and in the newest Synology DSM you can setup your box with BTRFS.
Thank you Morten! great video and I liked your mp3 explanation. I just bought Synology ds414 and was not sure which RAID to choose. After watching your video, I am going for SHR :)
@@MyPlayHouse I wish there was something that could be done about it. That ever present hum is very distracting, which is unfortunate because the content and explanation is very good.
Thank you i just bought a NAS able to contain 4disk and to begin with, i wanted to go with a raid 5 so i took 3 6To disk. But with your explanation i understand now that if i go with SHR i can upgrade with 8To disk later and replace the lower capacity disk without loosing my data.
HI +Raymond Earle It is not that hard, and you can set it up on your old hardware,,, or on a real server like I did in this video : ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Zw99g_MJa4A.html Thank you for watching! :-)
Hi. Thanks again for a great video :-) A question for raid build: I understand, that if you have made a, lets say Raid 5, and you want to change it to a Raid 6, then you have to erase all the data on the disks and rebuild the Raid. Is that correct understood? But how does it work with SHR: I plan to begin with just 2 or 3 disks in my NAS, and therefor go with the "1 disk security", but if I later, in the future, choose to expand my NAS with more drives, and therefore want to set the SHR to "2 disk security", do the Synology then also have to erase all the data to set up this new Raid, or can I keep my data on the disks while it changes the system? (I hope my question makes sense?)
Hi Kaspar On some raid controllers you can change from R5 to R6. On many you can expand from X diskes to X+1 disk with data on. But it can be tricky,, and this is a very fast way to clear all your data :-/ On a Synology you can expand with more drives, but I do not think you can change from R5 to R6 or SHR (but I haven't looked for it eathere) If you want a SHR with 2 disk security,, just dige up some old 200Gb as place holders, and you can exchange them any time, with something bigger. Thank you for watching! :-)
My PlayHouse Thx. Makes sense :-) Btw, do you know, if I build a SHR with 3 2TB, can I later then add a 1TB drive (so I have 3 2TB + 1 1TB), or am I now locked to just being able to add 2TB (and above) drives?
Thanks. Good explanation. I couldn't see the point of the separation, which I knew about. But of course, it's obvious when somebody points it out. Ingenious!
I'm looking at buying the 4bay DS420... can I start with 2 HDDs and SHR? or do I need minimum of 3 HDDs? or does the SHR partitioning mean that you can start with one HDD?
Hi Ahmed AlMullah Glad I could help! the Synology boxes and the SHR, is realy great for a set up you do not want to worry about. Thank you for watching! :-)
I run SHR-2 because I wanted 2 redundant disks and unlike Raid 10, which only has 2 redundant disks if you loose the right 2 disks. With my NAS and gigabit networking I can’t notice any difference between Raid 0, 1, 10, SHR, or SHR-2 because my network is slower than any of the storage methods. I also run 2 NVMe drives for both read and write cashing. I also didn’t notice any real difference in either read or write speeds after installing the NVMe drives. I’ve run Raid 1 for years simply to protect data locally; all it takes is 1 critical drive failure and you’ll all of a sudden be a fan of mirroring your data. SHR and SHR-2 are both now required as of DSM 7, in my understanding, in new NAS setups to get VRMs working without a big performance hit. While I like the ease in out of the box functionality of the Synology NAS I have 2 other NAS storage devices which each run FreeNAS, now free TrueNAS, and run in Raid 1; these function as simple data backup from the Synology NAS and local systems in 2 remote buildings. Nice video.
Thanx,, No if you have a 1Gbit connection to your NAS,, you can kind of forget about optimising your setup for performances,, and those two M.2 SSD's are probably overkill :-)
WHat about performance? RAID5 vs SHR? And what about how many drives are active when retrieving a file? What happens if two drives fail, will I lose all files as in RAID5 or only those on that drive?
Amazing explaination THANKS Have 2 disk SHR setup for redundancy Didn't know benifits of 4 disk SHR setups (for increasing capacity) Up to 8TB now & just updating to DS218Play Next upgrade will definitely consider 4 disk SHR setup & older model NAS for capacity & performance 🤪🤔
I like that explanation and can see why you like it (I would too -haha)! Gives us the opportunity to upgrade slowly as we can afford larger disks and get more space each time. Thanks!
Hi And that was also why I did not move my drives from the old Synology box over in the new one,, I wanted SHR,, not RAID 5 Thank you for watching! :-)
Hi Morten, thank you for the great video. On the subject of Synology software raid with NAS certified hard drives, would you recommend 8 X 2TB HDD = 12TB SHR2 or 5 X 4TB HDD = 12TB SHR2? Both usable capacity is 12TB but I'm not sure which way is best/less risky. Only difference on synology raid calculator is, 1st setup mentioned: 4TB "used for protection" and 2nd setup mentions: 8TB "used for protection. Any help would be great!
Hi SHR2, is for really really safe keeping,, are you sure all your 12TB are that important? and if så you might want to go with a external copy somewhere else instead. I'd get 4TB or larger,, 3*6TB and remember that with SHR you can put in a 8 or 10TB disk into your array later :-)If you do find some of my videos interesting,, please like them,, that helps my channel a lot :-) Thank you for watching! :-)
Thanks Morten! And correct me if I'm wrong but I'm assuming your answer is due to less disks = less work for the cpu and software raid when rebuilding? I was worried this might be too taxing on the hard drives as it will take a long time to rebuild. Especially since Synology is only software raid, no dedicated hardware raid controller. BUT, i realized I can address it by getting enterprise level hard drives. Thanks again Morten for your feedback! Liked and already subscribed :) ever since I saw your datacenter setup vid.
Hi John S No I was thinking more of futur expandings. Small disks will end up in the trash sooner then a few larger ones. :-) Thank you for watching! :-)
Many thanks for your all amazing Videos... I have NAS Storage, RAID 5 configured with 1 volume, Right now data is 43% only but issue is after 10 or 15 days storage will be reaching to 100%, then it will be auto refresh to 43%, My concern is... Between the process getting WARNING ERROR. Please suggest me how fix it. Don't want to reach 100% Unnecessar
I really love this video, thank you for the explanation! I bought a Synology DS1815+ and I haven't set it up yet (I have 4TBx8 drives, 32TB) But I think I will go with SHR after watching this video. I think they also have SHR2 now. I would love to see benchmarks (performance metrics) between SHR and Raid5/6 or so. Thanks again.
Thank you! I love it so far, it's been amazing! Although I do wish it had a better SFTP client that can function in the background for long transfers. I managed to write and run my own script as a task and it's been alright so far!
2 questions: 1. Can a normal PC read a SHR drive if you need to recover files off a single drive? Seems like it wouldn't? 2. Is it better to run two RAID 1 pair volumes (and make one volume backup to the other volume), over RAID 5, since RAID 5 seems like a lot of writing is always involved per file transaction, and can only sustain 1 drive failure before all is lost and hence more likely to fail?
Hi Potenti4lz No Raid is a replacement for a backup,, so if you're SHR dies, you build it again with a new disk and retrieve important data from your backup. Raid 1 pair,, sounds like a waste of space,,, not sure. Thank you for watching! :-)
@@MyPlayHouse I probably did but I as I believe he said if there's 2 8GB and 2 2GB drives installed 1 of the 8 GB drives will be a checksum drive while the other 3 totaling up to 12GB is for use. Is this not what was said?
Aaaah (sigh) the first geek that manages to explain something complex to non geeks in an understandable way. Thanks. You are a shining beacon of light in geek land.
Thanks. But could you change the configuration once you have started with one. I mean, what if you started with RAID 5, could you shift to SHR anytime afterwards? especially if you have acquired larger hard drive. Or are you stuck with the configuration you started with?
Hi MrKockabilly Thank You very much! I do not think you can from R5 to SHR.. some others you can,,, but do remember to have a backup when you try this. Thank you for watching! :-)
Thank you for the great video. One thing that always confuses me. If I have a raid 5, can I just turn off my NAS and put a new drive in and everything just keeps working without having to do anything special?
Hi Jeff C. Thank You very much! No on a Synology it will complain,, and you will have to go in and tell it to use the new drive as a replacement to the one you took out. I have done a few videos doing this. Thank you for watching! :-)
Hi, do you talk about sham raid marketing? Technical I cannot not follow you on my Sinologie bis. I see only one data mdraid with one single lvm volume and ontop a single Btrfs filesystem. So you will lose for example the self healing functionality of the btrfs filesystem.
Nice video. I had a problem to replace to a larger HDD. One solution is to migrate data and reinstall packages. The other one is SHR that I could enlarge the disk from 1TB + 1TB to 1TB + 1TB + 3TB. Then downgrade to 1TB + 3TB. The problem is that the conversion is a long time might take 2 days or more. I am afraid the HDD crash during the process.
Hi Lyu JH Thank You very much! Raid is not a replacement for backup,, safe data is a job,, there is the risk of a drive going bad all the time. Thank you for watching! :-)
i was wondering, have you ever used ZFS in a RAIDZ configuration and if so can you make a video about that. It is like Synology Hybrid raid a software raid solution that should be very save to use. I am personally using Nas4Free for a long time now and i use RAIDZ1 as RAID config but it is still a mistery for me how it works and what is the best configuration. I know this runs under FreeBSD and i haven't seen a FreeBSD video yet but hey, its worth asking :)
+Boe oh well i was to quick to ask my question :) i saw that you don't have any experience with ZFS. Only thing i want to add is that all tho ECC ram is recommended it isn't forced to run ZFS
+My PlayHouse (Morten Hjorth) I might not represent most RU-vid's but I actually like the longer videos. Sometimes things can't be explained properly in five minutes. I never knew how raid worked entirely. I had a concept that it was similar to how you mentioned it. I thought it was more SHR though.
Hi +Projectepic Thanx a lot,,, 100k is still some time out there :-) I al looking forward to 10k,, acording to socialblade.com/youtube/user/sirnetrom1/futureprojections/subscribers that is somthing like 116 days out. Thank you for watching! :-)
do you have any dell m1000e m600 i didnt see any on your rack -- im making a play server and i have the 10u rack and some parts --- do you have any videos on this server or could you do one on this series thanks --- i watch your videos - kendhill
Hi +kenneth hill Sorry,, I do not have any Dell's right now,,, and I do not have access to that series :-/ But I do hope you figure it out anyway. Thank you for watching! :-)
Hi, i have 50 Autocad concurrent users in my office & want to save files and work on NAS drive, i need 12 tb data, 2 lan port with faults tolerance which one is good for me. Thanks
Hi Jawed Akhtar I would suggest you to look at the DS1819+ Put in one fast SSD like a Samsung 500GB or 1TB Pro 870 SSD for caching and 7 HD like WD RED 4TB in SHR-2,, that will give you 20TB. Thank you for watching! :-)
160/5000 Super. That's exactly what I was looking for. Now I know the SHR function and can properly digest my DS416play. Thank you for this very good explanation.
Is this considered enterprise class? I dont think so. Fine for a home user storing a vid collection but im not sure i would run several hundred VMs off it. First off its software raid. Yeah i know NetApp etc are realy software based too and waffles are wonderful but it took them some time to get wafl right. Still it underperforms in certain scenarios compared to asics on a plain old fashion SAN. Emc for instance. Also forcing you to split it up in small volumes allows them to use varied drive sizes better but striping across logical volumes adds absolutely zero to performance and prob hinders it. Striping adds bandwidth and throughput because the files can be pulled from discreet channels simultaneously. Striping a volume still has you using the same controller, buffers and ports so when they are full/busy the cpu will still have to wait. No gains there. Checksums or security as the are called in the video should be refered to as metadata or supporting data in the way the terms being used in this video. While security is a part of it and so are checksums, it includes way more than that which alows the data to rebuilt upon a failure. Also i want o say the vfat is striped also but im too lazy to look it up atm so dont quote me there;) Size is one aspect thats important for sure. More important is the ratio of raw to useable space once formatted. How much overhead is taken up space in other words. Also iops. How many are you getting? Simultaneous connections also important. Does it support compression? d-dup? Replication? Snapshots? Encryption? Can yoi use ssd's? If so can you force a file to a particular set of spindles or the ssd's or is it you get what u get by chance. How does it perform doing random reads? rand writes. linear reads. Linear writes. Each of these should be evaluated for small medium and large files. Then you must consider what is ur data like? A ton of tiny files? Big video files? Is it textual in nature or is it a compression based file such as jpg or mpeg. These cannot be further compressed. If you are running any type of database then you have even more considerations! Don forget power. Do you have the 220, 204, 240, 110, 115, 120 volt circuit and does it support sufficient amps and finally does it even have the correct termination/plug/socket? Not to mention the various ways hose circuits can be made and the pole reqs of the device... Consider also interface. iSCSI? Fiber? Infiniband? Direct attached? Does it support what you need? Form factor too. Can it be raced. If your Colo then how many U's is important cause ur payin for it. Power consumption is important in that case too. Well in all cases really I suppose. Manageability....remote management or out of band mgmt is important too. Web interface and cli. Dont forget about that. Monitoring and alerting. I doubt it has phone home services but what does it have? Does it support snmp. I've seen some that will allow you to completely provision entirely with snmp. Hey ya never know...buy no i would not have bothered writing those oids lol. Is it supported by the usual players when it comes to backup and restore? Arcsight, commvault, Veeme etc. Another good question is does VmWare support it. Are there drivers for it.Thats a biggie with me as i do a great deal of virtualization. Can u boot from SAN off it? Another biggie for me. Support for nfs, smb, cifs, appleshare and dare i say it ....Novell? I realize its a nas but these things might be important to someone and they dont even know to consider em. Oh....i hope this isnt comin off as bashing the video. More to the person that is looking for storage but isnt aware of allllll the stuff that needs consideration. Good video tho. Gives a basic understanding of Syn raid and how it basically functions. If ur an IT professional please look at more than space tho. Please please;) If you're a home user then u wasted ur time reading my reply and i apologize;) These factors are only important when u start trying to support 10-20k users etc. Apologies for any innacurate statements. As i said feelin lazy so this is off the top of my head. Been in IT for 25 years but storage is my weakest area so take it with a grain of salt. Lol...my knowledge of comes more from bitching at my storage guys for what they gave me to use and what they DIDNT consider and i had to work around;)
HI They are not that cheap :-/ lenovopress.com/tips0805-system-x3650-m3#controllers-for-internal-storage The ServeRAID M1015 SAS/SATA Controller has the following specifications: Supports RAID levels 5 and 50 with optional ServeRAID M1000 Series Advanced Feature Key. Thank you for watching! :-)
RAID - Redundant Array of INEXPENSIVE Disks - not "independent" - from the days when "inexpensive" SCSI disks actually cost an arm or a leg to the consumer, but in business a bunch of such disks would still be a lot cheaper than hard drives for a mainframe. I mean, a lot cheaper. The point of the "inexpensive was to have "redundancy" as as a way to arrive at drive availability and data integrity, while keeping price low. And, as each drive has a bit of extremely fast I/O cache, an array of drives across which to stripe data could give higher throughput - "could" as tiny I/O operations still may have considerable filesystem overhead and this introduces significant latency relative to the data in the I/O. Yes, the drives in an array are independent, in the sense that they are individual devices, but in a RAID array they are logically tied together.
Hi 42jnyl Yes Dave Jones of @EEVblog sell them out the back, to avoid taxation on those enterprises licencies. And you need to know if you are looking for a per, color lic. or just pay, meters used. Thank you for watching! :-)
OK-OK-OK-OK - I think I got it. Please correct me if I'm wrong. SHR performs RAID on disk sections, making it easy for somewhat optimal performance no matter how many disks is available and how big they are. But if the disks (3+) are of the same size, RAID5 i used. X-RAID is a fancy word for the NAS to determine which standard RAID mode should be used. For easy adding more disks. All disks have to be the same size for this one to be optimal. 1 disk = Normal disk mode (No RAID) 2 disks = RAID1 3 and more disks = RAID5
I think it's pretty funny that you have a raid 5 video then a few days later you have a video about one crashing :p (i think you do still have some work on your grammar, but that's expected for someone who doesn't speak it native)
HI +Metario Thanx I try very hard. I cut out a lot of the really bad speak,,, But explaining and translating at the same time,, well it is demanding,, but I do hope I am getting better ad it. Thank you for watching! :-)
Depends on the system. Ubuntu is brining support for ZFS which is good. Well if you want to try then yes FreeNAS is good bet for ZFS. However it needs lots of RAM and the RAM needs to be ECC.
ZFS has error correction for bits. Since data can get Bitrot. ZFS will compare files and prevent corruption. For example Raid 1 will clone a corrupt file from one drive to the other if it becomes corrupt due to Bitrot. ZFS running in ZFSraid1 will see the Bitrot and will use the other drive to fix the broken file on the first drive. It wont just blindly copy / mirror files. it performs many checksums etc. Hence why it needs lots of RAM. I dont use ZFS on much but if you got the specs then its decent. However I often use Debian and its tricky to get ZFS on Debian like you can on BSD based OS like FreeNAS.
HI thingyee1118 But,, every new HD also checkes for this,, every time you read your data from the disk,, it has a check sum,, If there is an Error (Bit error/bir rot) It will tell it to the S.M.A.R.T. thing on the hard drive,,, and the drive will fix the error and copy the data to another place on the drive, and mark this place as not good. To many S.M.A.R.T. errors and you will get an prediction error,, warning and it's time to replace that drive. The Btrfs file system also includes data protection and recovery mechanisms, and so does ReFS, whitch came with Windows server 2008.
Never buy the Qnap the SHR is very very important and fundamental in NAS. Without this function, the machine is useless (is you Qnap), why don't use raspberry pi to replace the Qnap?
Wow what an awesome comment,, I am so happy that you found the time, in your busy calendar to tell me that you think my server room is noisy,, this is going to be helping scientist, forward in the years to come.
Hi Stefano Alfredo La Spina There is quite a lot of people that has responded that this has helped them :-/ So you might have missed some crucial bit of complexity. And Dave Jones has linked a twitt where I Use his "term" so I would claim that I have a registered version of DaveCAD :-) Thank you for watching! :-)
Hi +Lord Xelous No I am running a cracked version of Dave CAD,, It is almost as good, just does not always looks as good. :-) Thank you for watching! :-)
Hi +Dustin Marklow Can your HP card not present the OS with single drived,, Like I do in this video : ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Zw99g_MJa4AT.htmlhank you for watching! :-)
+My PlayHouse (Morten Hjorth) Hi that's how I tried it it doesn't pick up the raid card it says no disks found please install drives then try again. I really need to get a new cpu for the dl320 G3 to support VMware I can't even get 4.0 on the damn thing if I could I would use VMware to setup syonlogy lol. But no go I like it b/c it's easy on the system freenas is very demanding and hard on the system.
Hi Dustin Marklow That server is just a bit to old to be fun,, you need something that can run ESXi 6.0,, like an old IBM x3650 M1 or a HP dl 380 G5/6,,, but they are to expensive to have running 24/7 for a storages server. Thank you for watching! :-)
My PlayHouse And I kno I just need to find something that can use esxi plus have the 133MhZ 64bit pcix slot even if it has one. Don't want to blow a ton of money at once. 😩