UNSOLVED

felixzhou

updated

13 years ago

F

felixzhou

10 Posts

0

5164

December 11th, 2013 14:00

VNX5300 upgrade stuck on CS1 upgrade....

I attemped to upgrade my VNX5300 (7.1.71-1/5.32.0.206-->7.1.72-1/5.32.0.207) by using USM. Things looked OK until started CS1 upgrade. Now the upgrade is stuck on CS1 upgrade. Does anyone have any idea? Thanks in advance.

Here is the details:

Now when i log in, i will got following warning.

Warning!!upgrade is in progress from 7.1.71-1 to 7.1.72-1

Warning!!Please log off IMMEDIATELY if you are not performing the operation on the Celerra

Looks i have blades upgraded, i ignored the warning and upgraded the SPs without issue. But i still see above message when i log in.

From upgrade log, i got following. (confirmed i have enough space on CS1 !)

...... unpack package on CS1...

.......

22:15 Checking CS1 Upgrade status

2013-12-09 22:15:21  -

CS1 Upgrade in-progress...

2013-12-09 22:15:27  -
22:15:18 [ 47/52 ]  build administrator profile         1  second
2013-12-09 22:15:42  -
22:15 Checking CS1 Upgrade status
22:15 CS1 Upgrade IM status: Error establishing connection: Connection refused
2013-12-09 22:16:12  -
22:16 CS1 Upgrade IM status: Error establishing connection: Connection refused
2013-12-09 22:16:48  -
CS1 Upgrade starting...this takes a few minutes.
2013-12-09 22:18:03  -
22:18 Checking CS1 Upgrade status

2013-12-09 22:18:09  -

CS1 Upgrade starting...this takes a few minutes.
.....

  • Vipin VK

    2 Intern

    •

    812 Posts

    1243

    0

    Posted December 11th, 2013 19:00

    Consider moving this discussion to VNX Support Forum ( Select Move from Actions).

    Have you tried closing the window and resuming the upgrade ?

  • felixzhou

    10 Posts

    1243

    1

    Posted December 12th, 2013 06:00

    Yes, since the current upgrade is still in process. The resume is being blocked.

    thanks

  • felixzhou

    10 Posts

    1243

    0

    Posted December 12th, 2013 12:00

    After rebooted CS1, now i am able to resume the upgrade and complete both file and block upgrade. when i loged in this time, i didn't see the message "upgrade is in process" any more.

    For some reason, the Unishpere is still showing old file version but not from #nas_version. Any idea?

  • Ybfx

    24 Posts

    1247

    0

    Posted December 13th, 2013 01:00

    please try to restart the management server of both SPs...and if still the same issue check emc299249...

  • felixzhou

    10 Posts

    1247

    0

    Posted December 13th, 2013 06:00

    Thanks for reply.

    Unfortunately, it didn’t fix the issue by either restarting SP management server or reboot CS.

  • felixzhou

    10 Posts

    1249

    0

    Posted December 13th, 2013 09:00

    I did get correct numbers for block from both SPs and files from nas_version.

    The only issue is the Unishpere didn’t get right version for file.

  • Ybfx

    24 Posts

    1249

    1

    Posted December 13th, 2013 09:00

    1. Log in to the Control Station as nasadmin/root and run the following commands to confirm that one storage processor (SP) is detecting the wrong OE version.

      $ nas_storage -info id=1 | grep -i microcode
      microcode_version     = 05.31.000.5.509  <<< SP A is showing the wrong OE version. The getagent command will confirm code level is correct on the SP.
      microcode_version     = 05.31.000.5.720
    2. If one entry has the wrong OE version, enter the following commands. If both OE versions are all correct, please call the EMC Support Center and quote this solution ID (emc299249).

      $ nas_storage -sync -all
      $ nas_storage -check -all
      $ nas_storage -failback id=1
    3. Run the first command again and check if OE version is displayed correctly:

      $ nas_storage -info id=1 | grep -i microcode
      microcode_version     = 05.31.000.5.720 
      microcode_version     = 05.31.000.5.720
  • christopher_ime

    6 Operator

    •

    1962 Posts

    1249

    0

    Posted December 14th, 2013 11:00

    While I'll assume in the meantime you also have an SR open with support to review, do you mind providing a screenshot(s) of what you see in Unisphere and also could you provide the output of the following:

    (I'll assume CS0 is currently the primary Control Station)

    1) CS0

    nas_version

    2) CS1

    /nasmcd/bin/nas_version

    - Would of course also work on the primary CS

    3) CS0 (version of data movers)

    server_version ALL

    Also, I'll assume you are pointing your browser to the primary Control Station, could you instead point your browser to the IP of one of the SP's and log into Unisphere?  Do you also see the same version of VNX OE for File of the Control Station(s) being reported in the GUI?

  • felixzhou

    10 Posts

    1249

    0

    Posted December 14th, 2013 20:00

    $ nas_version

    7.1.72-1

    $

    $ /nasmcd/bin/nas_version

    7.1.72-1

    $

    $ server_version ALL

    server_2 : Product: EMC File Server Version: T7.1.72.1

    server_3 : Product: EMC File Server Version: T7.1.72.1

    $

    If I pointed Unishpere to SP’s, I got same old version information.

  • felixzhou

    10 Posts

    406

    0

    Posted December 14th, 2013 21:00