Newly replaced disk in 2 disk Mirror appears to have been Striped

Andy · January 20, 2022, 2:18pm

Hi Community,

I’m hoping there is a solution to this problem that doesn’t involve a rebuild.

I have FreeNas 11.3 with 2 disks in mirror layout. One disk degraded and i detached/exported it then added a new replacement disk via Storage/Pools/Options Cog/Extend. When in Extend screen, adding the disk to vdev it only offered “stripe” as the layout and now i can see in Storage screen that the available storage has increased by the size of the new disk. This is the concern as i expected resilvering process to include the new disk into a mirror layout and the available storage to show the new disk has mirrored the data on the existing disk. I can’t see anywhere in the UI that tells me what layout the disks are in, or how to make the new disk mirror the data.

Thanks in advance!

danb35 · January 21, 2022, 4:50pm

“Extend” is not the way to replace a disk, “replace” is. Why would you think that “extend” would replace a disk?

…which turned your disk into a single-disk pool.

That would be the Pool Status page, which you had to have found in order to detach the failed disk. Here’s how you get there:

And here’s what it should look like:

What you should have done first was offline the bad disk, rather than detach it. It’s still done at the pool status page:

Once it’s offline (and its replacement installed, if necessary), still from the pool status page, replace the disk:

Select the replacement, and click Replace Disk:

But you didn’t do that. As a result, as you suspect, your pool now consists of two disks striped, with no redundancy–when one of those disks fails, you’ll lose your pool. And you can’t fix it with 11.3. You can, however, fix it in TrueNAS 12.0 by removing the newly-added disk from the pool, and then adding it as a mirror of the other disk. This can all be done in the GUI of 12.0, but it isn’t possible in 11.3.

Andy · January 21, 2022, 5:15pm

Thanks Dan, I suspected that was the case after I detached the degraded disk. I don’t see any updates in the GUI for later versions of Freenas/Truenas. Is that a potential hardware spec limitation or do I need to build Truenas 12 from scratch?

Thanks again

danb35 · January 21, 2022, 6:12pm

You’ll need to set the update train to TrueNAS-12.0-stable:

Andy · January 24, 2022, 12:57pm

Hi Dan,

I’m now on TrueNas 12.0 train and in Pools/Status but not seeing options to detach/remove the new disk. The closest is to “Offline” the disk but it just throws up the following error message… “[EZFS_NOREPLICAS] no valid replicas”.

Do you know how I go about detaching and then adding the new disk into Mirror please?

Thanks again.

Andy · January 27, 2022, 10:56am

Hi Dan,

Please could you take a look at my previous question on this post as I can’t find a way around this error message to remove the ew drive to then reattach in mirror?

Thanks again for your help, it’s greatly appreciated.

Andy

danb35 · January 28, 2022, 6:29pm

Hmmm. I know the option is there in 12.0; perhaps it only shows up when your pool is mirrors rather than single disks. So in that case, you’re going to need to do it from the CLI. So let’s suppose I want to remove da2 from my pool. First, I need to find the gptid for da2:

root@freenas[~]# glabel status
                                      Name  Status  Components
gptid/03fc8bdc-7ad0-11ec-89be-5183cd5b8f47     N/A  da0p1
                           iso9660/FREENAS     N/A  cd0
gptid/9429193d-7ad3-11ec-bc7b-e584edbb2f19     N/A  da1p2
gptid/9c89e19d-7ad2-11ec-bc7b-e584edbb2f19     N/A  da2p2

Then run zpool remove with that gptid:

root@freenas[~]# zpool remove tank gptid/9c89e19d-7ad2-11ec-bc7b-e584edbb2f19
root@freenas[~]#

Monitor the status using zpool status tank:

root@freenas[~]# zpool status tank
  pool: tank
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
	still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
	the pool may no longer be accessible by software that does not support
	the features. See zpool-features(5) for details.
remove: Evacuation of /dev/gptid/9c89e19d-7ad2-11ec-bc7b-e584edbb2f19 in progress since Fri Jan 28 10:24:07 2022
	1.55G copied out of 2.20G at 32.3M/s, 70.14% done, 0h0m to go
config:

	NAME                                          STATE     READ WRITE CKSUM
	tank                                          ONLINE       0     0     0
	  gptid/9c89e19d-7ad2-11ec-bc7b-e584edbb2f19  ONLINE       0     0     0
	  gptid/9429193d-7ad3-11ec-bc7b-e584edbb2f19  ONLINE       0     0     0

errors: No known data errors
root@freenas[~]#

Once it completes, go back to the pool status page, click the kebab menu next to da1, and select extend:

Select da2 as the new disk:

And then click Extend. The new disk will be added as a mirror:

Andy · January 30, 2022, 9:39am

Thanks Dan, this has worked and mirror has re-silvered successfully. Thank you for your help!

tcripe · September 21, 2024, 12:27am

Dan, I’ve followed your steps above to remove an ‘extended’ hard drive from my pool, but I receive the following message: cannot open ‘tank’ : no such pool. I’m not sure what I’m typing incorrectly in the code, can you take a look at the attached? Thank you!