First, make sure a new HDD replaced and initialized correctly. In my example it’s \/dev\/sdc.<\/p>\n
Creating linux primary partition, formating as xfs and mounting to the same mount point as it was before: [2017-05-17 23:57:24.089817] W [socket.c:611:__socket_rwv] 0-management: readv on \/var\/run\/6a4503614e8aae691f635297ed0dca19.socket failed (Invalid argument) “[2017-05-17 23:35:29.656007] E [posix.c:5604:init] 0-gfsvol-posix: Extended attribute trusted.glusterfs.volume-id is absent” – here it is. Let’s add extended attribute.<\/p>\n Just to confirm: Check if it’s getting synced: Start heal process again Links: https:\/\/serverfault.com\/questions\/710220\/how-do-you-add-a-replacement-hdd-to-a-glusterfs-volume<\/a> First, make sure a new HDD replaced and initialized correctly. In my example it’s \/dev\/sdc. Creating linux primary partition, formating as xfs and mounting to the same mount point as it was before: parted -a optimal \/dev\/sdc mkpart primary 0% 100% mkfs.xfs -i size=512 \/dev\/sdc1 mount \/dev\/sdc1 \/export\/sdc1 mkdir -p \/export\/sdc1\/brick1 gluster volume info gfsvol […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[231],"tags":[212,220,32,28,14,11],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/posts\/709"}],"collection":[{"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/comments?post=709"}],"version-history":[{"count":7,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/posts\/709\/revisions"}],"predecessor-version":[{"id":716,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/posts\/709\/revisions\/716"}],"wp:attachment":[{"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/media?parent=709"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/categories?post=709"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/trichev.com\/blog\/wp-json\/wp\/v2\/tags?post=709"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nparted -a optimal \/dev\/sdc mkpart primary 0% 100%
\nmkfs.xfs -i size=512 \/dev\/sdc1
\nmount \/dev\/sdc1 \/export\/sdc1
\nmkdir -p \/export\/sdc1\/brick1<\/code><\/p>\ngluster volume info gfsvol<\/code> – BrickN server1-gluster:\/export\/sdc1\/brick1 should be listed here<\/p>\nVolume Name: gfsvol
\nType: Replicate
\nVolume ID: def9e71b-e3cd-4d25-a604-e53aa717e744
\nStatus: Started
\nNumber of Bricks: 1 x 2 = 2
\nTransport-type: tcp
\nBricks:
\nBrick1: server1-gluster:\/export\/sdc1\/brick1
\nBrick2: server2-gluster:\/export\/sdc1\/brick1<\/code><\/p>\ngluster volume heal gfsvol full<\/code>
\nAnother transaction is in progress for gfsvol. Please try again after sometime.<\/p>\nls -ltr \/var\/log\/glusterfs<\/code><\/p>\ncat etc-glusterfs-glusterd.vol.log<\/p>\n
\nThe message \"I [MSGID: 106005] [glusterd-handler.c:4142:__glusterd_brick_rpc_notify] 0-management: Brick server1-gluster:\/export\/sdc1\/brick1 has disconnected from glusterd.\" repeated 39 times between [2017-05-17 23:55:27.065833] and [2017-05-17 23:57:24.091004]
\n[2017-05-17 23:57:27.090603] W [socket.c:611:__socket_rwv] 0-management: readv on \/var\/run\/6a4503614e8aae691f635297ed0dca19.socket failed (Invalid argument)
\n[2017-05-17 23:57:27.091934] I [MSGID: 106005] [glusterd-handler.c:4142:__glusterd_brick_rpc_notify] 0-management: Brick server1-gluster:\/export\/sdc1\/brick1 has disconnected from glusterd.
\n[2017-05-17 23:57:30.091171] W [socket.c:611:__socket_rwv] 0-management: readv on \/var\/run\/6a4503614e8aae691f635297ed0dca19.socket failed (Invalid argument)<\/code><\/p>\ngluster volume heal gfsvol full<\/code>
\nCommit failed on server2-gluster. Please check log file for details.<\/p>\ncat \/var\/log\/glusterfs\/bricks\/export-sdc1-brick1.log<\/code><\/p>\n[2017-05-17 23:35:29.469536] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-\/usr\/sbin\/glusterfsd: Started running \/usr\/sbin\/glusterfsd version 3.6.1 (args: \/usr\/sbin\/glusterfsd -s server1-gluster --volfile-id gfsvol.server1-gluster.export-sdc1-brick1 -p \/var\/lib\/glusterd\/vols\/gfsvol\/run\/server1-gluster-export-sdc1-brick1.pid -S \/var\/run\/6a4503614e8aae691f635297ed0dca19.socket --brick-name \/export\/sdc1\/brick1 -l \/var\/log\/glusterfs\/bricks\/export-sdc1-brick1.log --xlator-option *-posix.glusterd-uuid=c876c33a-3605-4c5c-b773-8d5e85655111 --brick-port 49153 --xlator-option gfsvol-server.listen-port=49153)
\n[2017-05-17 23:35:29.608846] I [graph.c:269:gf_add_cmdline_options] 0-gfsvol-server: adding option 'listen-port' for volume 'gfsvol-server' with value '49153'
\n[2017-05-17 23:35:29.608880] I [graph.c:269:gf_add_cmdline_options] 0-gfsvol-posix: adding option 'glusterd-uuid' for volume 'gfsvol-posix' with value 'c876c33a-3605-4c5c-b773-8d5e85655111'
\n[2017-05-17 23:35:29.640944] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
\n[2017-05-17 23:35:29.641025] W [options.c:898:xl_opt_validate] 0-gfsvol-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
\n[2017-05-17 23:35:29.656007] E [posix.c:5604:init] 0-gfsvol-posix: Extended attribute trusted.glusterfs.volume-id is absent
\n[2017-05-17 23:35:29.656026] E [xlator.c:425:xlator_init] 0-gfsvol-posix: Initialization of volume 'gfsvol-posix' failed, review your volfile again
\n[2017-05-17 23:35:29.656034] E [graph.c:322:glusterfs_graph_init] 0-gfsvol-posix: initializing translator failed
\n[2017-05-17 23:35:29.656041] E [graph.c:525:glusterfs_graph_activate] 0-graph: init failed
\n[2017-05-17 23:35:29.656750] W [glusterfsd.c:1194:cleanup_and_exit] (--> 0-: received signum (0), shutting down
\n<\/code><\/p>\ngrep volume-id \/var\/lib\/glusterd\/vols\/gfsvol\/info | cut -d= -f2 | sed 's\/-\/\/g'
\ndef9e71be3cd4d25a604e53aa717e744<\/code><\/p>\nsetfattr -n trusted.glusterfs.volume-id -v 0xdef9e71be3cd4d25a604e53aa717e744 \/export\/sdc1\/brick1
\n<\/code>
\nservice glusterd restart<\/code><\/p>\n
\ngetfattr -d -m . -e hex \/export\/sdc1\/brick1<\/code><\/p>\n
\nwhile [ 1 ]; do du -sh \/export\/sdc1\/brick1; sleep 30; done<\/code><\/p>\n
\ngluster volume heal gfsvol full<\/code><\/p>\ngluster volume heal gfsvol info<\/code><\/p>\n
\nhttps:\/\/joejulian.name\/blog\/replacing-a-brick-on-glusterfs-340\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"