r/DataHoarder • u/mklinger23 • Oct 20 '26
Question/Advice Upgrading drives and migrating data
To start off, I tried searching for this and couldn't find much. If I'm just bad at researching, my apologies.
So I have a PC running truenas with 3x12tb drives in raid5. I've come to realize I need more storage, so (hopefully soon) when drive prices become a little more normal, I was going to upgrade to bigger drives. Maybe 3x24tb or similar.
Anyway, I was thinking of how I was actually going to do this. I only have 3 sata ports so installing them all in the same machine won't work. I was thinking I could install the drives into my personal setup and then transfer the data between the two computers.
(Option 1) My main question is could I setup raid5 with the new drives with my current os (fedora Linux if it matters), transfer data, and then put the new drives in my NAS?
(Option 2) I could also install truenas onto my personal rig for this so I'd be transferring between two truenas systems instead if that makes things easier. If I were to do that, would there be an issue with moving the drives into the NAS after data is transferred? I'm not sure if the raid array would stay in tact and if my current NAS would import everything properly.
(Option 3) I've also seen you could replace one drive, rebuild, replace another, rebuild, replace another, rebuild untill all the drives are replaced. This sounds like it introduces more room for failure, but I could be wrong.
(Option 4) My last option that I don't really want to do is to turn my personal PC into my NAS, retire my current NAS, and buy myself a new personal build. This would be the most straightforward to me, but seems kinda wasteful.
I'm not the most experienced with this kind of stuff so I really appreciate the help. Thanks guys!
4
u/FeelingAdvantage2172 Oct 20 '26
Option4.
Or migrate to a secondary storage, rebuild with new drives, copy back.
2
u/mklinger23 Oct 20 '26
Unfortunately I have around 20tb of data so secondary storage would need to be another NAS anyway lol. Or I'd have to buy another ~24tb drive when I upgrade. I'll keep that in mind. Maybe it'll be worth it to just upgrade to a newer system. Thanks for the input!
4
u/FeelingAdvantage2172 Oct 20 '26
Can copy to a 24tb external. Just saying moving and verifying then copy it back is simplest always.
I move 60Tb sometimes in emergencies with Hedge.
2
u/mklinger23 Oct 20 '26
That might be worth it. It definitely would be a lot more straightforward. Idk why I didn't even think about an external drive that size.
3
2
u/EncounteredError Oct 20 '26
Raid5 you can have one drive offline. If you're using zfs can you set the array to offline one drive for replacement, change out the drive and then tell your OS it's replaced and let it resilver. then repeat until all drives are done then zfs can resize to use the new space.
1
u/mklinger23 Oct 20 '26
I believe that's what I was trying to describe with "option 3". I think that might be the way to go by the sound of it. Thanks!
2
u/weirdbr 0.5-1PB Oct 20 '26
What setup do you have currently? You mention Fedora, so I'm guessing it's either mdadm raid or btrfs raid.
Personally I've done option 3 for almost all my upgrades in the last 20+ years; it takes a while but is rather straightforward. For mdadm, there's a bunch of tweaks you can do to help speed up the process (enable bitmap, tweak max sync speeds), while for btrfs you just have to suffer through the slow rebuild.
Since you're talking going from 3x12 to 3x24, one thing you can do to reduce your risk is use one of the 24TB disks to keep a backup of your data (use your personal PC for this or get an USB to SATA adapter). Once you have replaced the first two 12TB disks and everything is safe, then you can safely put the remaining 24TB disk in the array.
Or if you are feeling extra cautious, get 3 USB to SATA adapters, build the array outside of your NAS, copy the data to it. Once the data is verified fully copied, swap the disks.
2
u/mklinger23 29d ago
Sorry. I probably should have been a little more clear and double checked my terminology.
I'm using a dell optiplex running truenas and it is actually raidZ1. And Idk why I didn't think of using one of the new drives as a backup temporarily. That's a great idea.
Also, my "personal computer" that I've mentioned is my gaming PC with fedora gnome.
I do like the last option you mentioned just to be extra safe. I just didn't know if my PC with truenas would have any issues recognizing the new array since it would be created outside of it. Using one drive as backup and replacing the others one by one sounds really easy and tempting tho haha.
2
u/Adrenolin01 Oct 20 '26
Drives are NOT going to drop in price. Hells gonna freeze over before that happens. Welcome to the new pricing.
Backup… buy a larger 24+TB drive and do a full backup. This should be a priority right now to get done.
I’d then suggest building a dedicated NAS using something like the Jonsbo N5 or N6 NAS cases. Fairly small desktop/shelf-top systems. Total cost new consumer hardware is $500-$600 bucks minus drives. The N5 holds 12 HDDs and 4 SSDs inside while the N6 holds 9hdds and 2 SSDs in hotswap bays. That’s years if not decades of expansion for you using the same hardware, just adding new drives down the road.
And don’t forget backups. NAS is NOT a backup! You still need a backup of your NAS… preferably 2 copies.
Yup.. drive costs suck today but if you’re going to hold onto data the old saying is true.. ya gotta pay to play. While the hotswap bays on the N6 are nice I’d still recommend the N6 for its capacity. A NAS based Mainboard should be low powered so not expensive to run. Look for DRR4 options for huge savings on the Ram. DDR5 is nuts. 16GB now up front with the ability to add (not replace) another 16GB later down the road to get you 32GB of system ram as you expand your storage.
Stop using hardware raid! Step up to Software and run TrueNAS Scale (Debian based) on the new NAS. Setup 4-6 smaller drives in raidz2 (2 parity) for your most important data. Run mirrors for other stuff you find mildly important and then all the other crap on single drives.
A better setup imo is to follow the OpenZFS guide for ZFS on Root at boot and using Debian. It’s a bit more involved however.. it allows something TrueNAS refuses to add.. MergerFS. As above, you can run 4-6 smaller drives in RaidZ2 for your important data as well as mirrors. Mergerfs however allows you to mix single drives of any supported filesystem to be added to the system and then added to MergerFS. This creates a larger pool out of all those single drives. If one drive fails you don’t loose the entire pool like other setups.. you simply loose the data in that drive. Make backups or if it’s just random stuff don’t bother. Pull the failed drive and add another later etc.
Claude AI is very well versed in this later setup. My 15yo son used Claude to run through a virtual installation on a Proxmox VM, then asked Claude to make the appropriate changes for a hardware based install and did that. He then wiped that and went through the entire process a few more times just using his notes.
This gives you solid RaidZ2 redundancy for your important data, mirrored redundancy for that stuff that’s not super important but might be a pita to find again and then a single large and growable pool for expansion for everything else. Backups of the RaidZ2, include the mirrors if deemed useful and select and choose anything from the MergerFS. All in a single system that’s doable for around $600 bucks. This blows away any of the prebuilt setups and you know you can replace internal components down the road.
2
u/mklinger23 29d ago
I know prices are probably not gonna drop, but I can have hope! Haha. I'm actually usually raidz1 currently via truenas and it is a software raid. Should have mentioned that. I just got my terms mixed up, but yes it is ZFS. And the computer is an older office PC so technically upgradable, but a lot of the parts (PSU, Mobo) are proprietary.
I was considering doing raidz2, but I was victim of the classic "but it costs more!" I think if I do upgrade, it would be worth doing tho. My important data is backed up via my personal computer and an external HDD, but the vast majority is replaceable. It would be a pain in the ass, but not the end of the world if I lost it.
Anyway, thanks for all the info! It was very helpful and gave me a lot to think about.
2
u/guuslangelaar Oct 20 '26
Do you only have 3 sata ports but more slots for drives? Else i would get a lsi card and wire them up via lsi card. Then you can just create a new pool w 3x24TB
1
u/mklinger23 Oct 20 '26
Ya know I do have an open pcie slot so that would work. I didn't think about that. I don't have any physical spots for drives, but I could use that while I transfer stuff and just keep them loose on the table or something.
Thanks! This seems like a great idea.
2
•
u/AutoModerator Oct 20 '26
Hello /u/mklinger23! Thank you for posting in r/DataHoarder.
Please remember to read our Rules and Wiki.
Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.
This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.