Task:
Recently I was assigned a task to remove 10 old unused LUN from ESXi 5.0 Hosts.
Issue:
when I tried to detach first 3 LUN, it was successful but when I tried 4th LUN, task bar shows LUN detaching in progress for 30 Min's and Host Disconnected from vcenter.
After that I SSH to the host and tried to execute esxcli commands. but unfortunately the whole command module was not available I cannot execute any cli esxcli commands. I re-started the management network and tried to rejoin back to vcenter but all failed.
Temporary solution:
I informed all the server owner and got downtime to shutdown all the VM's and rebooted the ESXi Hosts and re-connected to vcenter
up on checking the logs it's shown as below
Recently I was assigned a task to remove 10 old unused LUN from ESXi 5.0 Hosts.
Issue:
when I tried to detach first 3 LUN, it was successful but when I tried 4th LUN, task bar shows LUN detaching in progress for 30 Min's and Host Disconnected from vcenter.
After that I SSH to the host and tried to execute esxcli commands. but unfortunately the whole command module was not available I cannot execute any cli esxcli commands. I re-started the management network and tried to rejoin back to vcenter but all failed.
Temporary solution:
I informed all the server owner and got downtime to shutdown all the VM's and rebooted the ESXi Hosts and re-connected to vcenter
up on checking the logs it's shown as below
2014-09-28T00:34:35.293Z cpu21:2263260)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:34:35.294Z cpu11:5668140)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:34:55.304Z cpu18:6691338)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:34:55.306Z cpu18:6691338)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:35:05.311Z cpu4:4316)PowerPath: EmcpEsxLogEvent:1252:
Info:emcp:MpxEsxVolProbe: Wait for volume to be unquiesced 2014-09-28T00:35:05.312Z
cpu4:4316)PowerPath: EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for
volume to be unquiesced 2014-09-28T00:35:15.319Z cpu13:6692663)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:35:15.321Z cpu25:5114901)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:35:25.326Z cpu25:5114901)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:35:35.334Z cpu7:6692369)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:36:05.354Z cpu38:6692663)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:36:45.378Z cpu34:6692369)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be
unquiesced 2014-09-28T00:36:55.384Z cpu22:5668140)PowerPath:
EmcpEsxLogEvent:1252: Info:emcp:MpxEsxVolProbe: Wait for volume to be unquiesced
2014-09-28T00:36:55.385Z cpu13:2263260)PowerPath: EmcpEsxLogEvent:1252:
Info:emcp:MpxEsxVolProbe: Wait for volume to be unquiesced
2014-09-28T00:37:05.969Z cpu15:6691610)PowerPath: EmcpEsxLogEvent:1252:
Info:emcp:MpxEsxVolProbe: Wait for volume to be unquiesced
2014-09-28T00:37:15.972Z cpu23:6691610)PowerPath: EmcpEsxLogEvent:1252:
Info:emcp:MpxEsxVolProbe: Wait for volume to be unquiesced
Solution: Up on checking VMware KB, it shows that this issue is not related to VMware and it's related to Powerpath.
http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2016567
I upgraded the Power path to latest version and now I can able to detach the LUN with out any issue.
