Linux Software RAID
From FGARWiki
Linux Software RAID
Creating a new array
# mdadm --create md3 --level=6 --raid-devices=12 --spare-devices=1 /dev/sd[bcdefghiklmno] mdadm: Defaulting to version 1.2 metadata mdadm: array /dev/md/md3 started.
Rebuilding a degraded array after a disk as failed
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 430116864 (410.19 GiB 440.44 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 8
Total Devices : 8
Persistence : Superblock is persistent
Update Time : Tue May 31 20:51:49 2011
State : clean, degraded
Active Devices : 7
Working Devices : 7
Failed Devices : 1
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 1124
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
7 0 0 7 removed
7 66 48 - faulty spare /dev/sdaj
# mdadm --manage -r /dev/md2 /dev/sdaj
mdadm: hot removed /dev/sdaj from /dev/md2
# mdadm --manage -a /dev/md2 /dev/sdad
mdadm: added /dev/sdad
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 430116864 (410.19 GiB 440.44 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 8
Total Devices : 8
Persistence : Superblock is persistent
Update Time : Tue May 31 20:59:26 2011
State : clean, degraded, recovering
Active Devices : 7
Working Devices : 8
Failed Devices : 0
Spare Devices : 1
Layout : left-symmetric
Chunk Size : 512K
Rebuild Status : 0% complete
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 1129
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
8 65 208 7 spare rebuilding /dev/sdad
Adding several disks to an array
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 430116864 (410.19 GiB 440.44 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 8
Total Devices : 8
Persistence : Superblock is persistent
Update Time : Wed Jun 1 00:38:06 2011
State : clean
Active Devices : 8
Working Devices : 8
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 1152
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
8 65 208 7 active sync /dev/sdad
# mdadm --manage /dev/md2 -a /dev/sdae /dev/sdaf /dev/sdai /dev/sdah /dev/sdag /dev/sdaj
mdadm: added /dev/sdae
mdadm: added /dev/sdaf
mdadm: added /dev/sdai
mdadm: added /dev/sdah
mdadm: added /dev/sdag
mdadm: re-added /dev/sdaj
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 430116864 (410.19 GiB 440.44 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 8
Total Devices : 14
Persistence : Superblock is persistent
Update Time : Wed Jun 1 00:39:48 2011
State : clean
Active Devices : 8
Working Devices : 14
Failed Devices : 0
Spare Devices : 6
Layout : left-symmetric
Chunk Size : 512K
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 1158
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
8 65 208 7 active sync /dev/sdad
7 66 48 - spare /dev/sdaj
9 65 224 - spare /dev/sdae
10 65 240 - spare /dev/sdaf
11 66 32 - spare /dev/sdai
12 66 16 - spare /dev/sdah
13 66 0 - spare /dev/sdag
# mdadm --grow /dev/md2 -n14
mdadm: Need to backup 6144K of critical section..
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 430116864 (410.19 GiB 440.44 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 14
Total Devices : 14
Persistence : Superblock is persistent
Update Time : Wed Jun 1 00:40:22 2011
State : clean, recovering
Active Devices : 14
Working Devices : 14
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Reshape Status : 0% complete
Delta Devices : 6, (8->14)
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 1166
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
8 65 208 7 active sync /dev/sdad
7 66 48 8 active sync /dev/sdaj
13 66 0 9 active sync /dev/sdag
12 66 16 10 active sync /dev/sdah
11 66 32 11 active sync /dev/sdai
10 65 240 12 active sync /dev/sdaf
9 65 224 13 active sync /dev/sdae
Wait for the resync to complete...
# mdadm -D /dev/md2
/dev/md2:
Version : 1.2
Creation Time : Mon May 30 21:29:25 2011
Raid Level : raid6
Array Size : 860233728 (820.38 GiB 880.88 GB)
Used Dev Size : 71686144 (68.37 GiB 73.41 GB)
Raid Devices : 14
Total Devices : 14
Persistence : Superblock is persistent
Update Time : Wed Jun 1 09:01:09 2011
State : clean
Active Devices : 14
Working Devices : 14
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Name : nassrv01:3 (local to host nassrv01)
UUID : ee56e8d5:95aa1c04:970bb90c:8c0c5224
Events : 2553
Number Major Minor RaidDevice State
0 65 96 0 active sync /dev/sdw
1 65 112 1 active sync /dev/sdx
2 65 128 2 active sync /dev/sdy
3 65 144 3 active sync /dev/sdz
4 65 160 4 active sync /dev/sdaa
5 65 176 5 active sync /dev/sdab
6 65 192 6 active sync /dev/sdac
8 65 208 7 active sync /dev/sdad
7 66 48 8 active sync /dev/sdaj
13 66 0 9 active sync /dev/sdag
12 66 16 10 active sync /dev/sdah
11 66 32 11 active sync /dev/sdai
10 65 240 12 active sync /dev/sdaf
9 65 224 13 active sync /dev/sdae
# pvresize /dev/md2
Physical volume "/dev/md2" changed
1 physical volume(s) resized / 0 physical volume(s) not resized
# pvs
PV VG Fmt Attr PSize PFree
/dev/md0 pool0 lvm2 a- 752.01g 0
/dev/md1 pool0 lvm2 a- 820.38g 0
/dev/md2 pool0 lvm2 a- 820.38g 410.19g
/dev/sda2 system lvm2 a- 8.32g 0
# lvextend pool0/lv00 -l+100%FREE
Extending logical volume lv00 to 2.34 TiB
Logical volume lv00 successfully resized
# resize2fs /dev/pool0/lv00
resize2fs 1.41.14 (22-Dec-2010)
Filesystem at /dev/pool0/lv00 is mounted on /srv/backup; on-line resizing required
old desc_blocks = 124, new_desc_blocks = 150
Performing an on-line resize of /dev/pool0/lv00 to 627249152 (4k) blocks.