UNSOLVED

Frederic Nass

updated

4 years ago

0

427

March 3rd, 2023 05:00

Dell PX02SMF020 seen as "Not Certified" after BIOS upgrade from 2.13.0 to 2.16.0 (R730xd)

Hello,

We've lost 2 SSD drives this morning after upgrading a R730xd BIOS from BIOS 2.13.0 to BIOS 2.16.0.

These SSD drives now appear as "Not Certified" and are totally unusable (in failed state). No issues whatsoever with the other 14 HDDs that the PERC H730p mini controller handles.

Reverting to BIOS 2.13 did not help.

These Dell PX02SMF020 drives were provided along with the server so we're sure that they are certified drives.
They've been working fine for years and the only operation that makes them both fail at the same time and appear as "Not Certified" is this morning BIOS upgrade.

Does that ring any bell on your side?

Regards,

Frédéric.

  • 307

    0

    Posted March 3rd, 2023 06:00

    This is the omreport from a failed SSD drive in server A :

    ID : 0:1:12
    Status : Critical
    Name : Physical Disk 0:1:12
    State : Failed
    Power Status : Spun Up
    Bus Protocol : SAS
    Media : HDD
    Part of Cache Pool : Not Applicable
    Remaining Rated Write Endurance : Not Applicable
    Failure Predicted : No
    Revision : A3B3
    Driver Version : Not Applicable
    Model Number : Not Applicable
    T10 PI Capable : No
    Certified : No
    Encryption Capable : No
    Encryption Protocol : Not Applicable
    Encrypted : Not Applicable
    Progress : Not Applicable
    Mirror Set ID : Not Applicable
    Capacity : 0.00 GB (0 bytes)
    Used RAID Disk Space : 0.00 GB (0 bytes)
    Available RAID Disk Space : 0.00 GB (0 bytes)
    Hot Spare : No
    Vendor ID : DELL(tm)
    Product ID : PX02SMF020
    Serial No. : Y4L0A04BT0RB
    Part Number : PH0K41XJ264024BL03DNA00
    Negotiated Speed : Not Available
    Capable Speed : Not Available
    PCIe Negotiated Link Width : Not Applicable
    PCIe Maximum Link Width : Not Applicable
    Sector Size : 512B
    Device Write Cache : Not Applicable
    Manufacture Day : 00
    Manufacture Week : 47
    Manufacture Year : 2014
    SAS Address : 50000395EC892976
    WWN : 50000395EC892976
    Non-RAID HDD Disk Cache Policy : Not Applicable
    Disk Cache Policy : Not Applicable
    Sub Vendor : Not Available
    Available Spare : Not Available
    Cryptographic Erase Capable : No

    This is the omreport from a the exact same SSD in server B :

    ID : 0:1:12
    Status : Ok
    Name : Physical Disk 0:1:12
    State : Online
    Power Status : Not Applicable
    Bus Protocol : SAS
    Media : SSD
    Part of Cache Pool : Not Applicable
    Remaining Rated Write Endurance : 97%
    Failure Predicted : No
    Revision : A3B3
    Driver Version : Not Applicable
    Model Number : Not Applicable
    T10 PI Capable : No
    Certified : Yes
    Encryption Capable : No
    Encryption Protocol : Not Applicable
    Encrypted : Not Applicable
    Progress : Not Applicable
    Mirror Set ID : Not Applicable
    Capacity : 185.75 GB (199447543808 bytes)
    Used RAID Disk Space : 185.75 GB (199447543808 bytes)
    Available RAID Disk Space : 0.00 GB (0 bytes)
    Hot Spare : No
    Vendor ID : DELL(tm)
    Product ID : PX02SMF020
    Serial No. : Y4L0A04FT0RB
    Part Number : PH0K41XJ264024BL03EFA00
    Negotiated Speed : 12.00 Gbps
    Capable Speed : 12.00 Gbps
    PCIe Negotiated Link Width : Not Applicable
    PCIe Maximum Link Width : Not Applicable
    Sector Size : 512B
    Device Write Cache : Not Applicable
    Manufacture Day : 00
    Manufacture Week : 47
    Manufacture Year : 2014
    SAS Address : 50000395EC892986
    WWN : 50000395EC892986
    Non-RAID HDD Disk Cache Policy : Not Applicable
    Disk Cache Policy : Not Applicable
    Sub Vendor : Not Available
    Available Spare : Not Available
    Cryptographic Erase Capable : No

    When the server starts, both SSD drives show up as "Drive XX in disk drive bay 1 is operating normally." but 15 seconds later, they show up as "Fault detected on drive XX in disk drive bay 1".

    Also the battery of the controller now appears in failed state. Could it be related?

  • DELL-Charles R

    Moderator

    •

    4730 Posts

    •

    25476 Points

    293

    1

    Posted March 3rd, 2023 11:00

    Hello Frederic Nass,

     

    I'm sorry to see that. So far I have not found any other reference to this issue.

     

    Do you have a backup of the data? If it is critical data and you don't have a backup you may need to consider a data recovery company. Dell does not have a data recovery service.

     

    I don't think the BIOS update had anything to do with it.

    The controller needing a battery replaced should not have had anything to do with it either. If the battery is bad the controller automatically changes to Write-Through and does not rely on the battery backed cache.

     

    It looks like they failed. You can see Capacity : 0.00 GB (0 bytes).

     

    Let's try to get them back up.

    Try a flea power drain, remove the drives, boot up and update the PERC controller firmware, reinstall disks and see if they import ok.

     

    *Drain flea power (shut down, disconnect power cables and Network cables, hold in power button 20 seconds with cords removed).  After flea power drain, system has to set for 3 minutes for DRAC to reset without any power plugged in.

    *Remove the ssd drives.

    *Then plug in NIC and power but wait 2 minutes before power on to give DRAC time to initialize.

    *Reinstall ssd drives

     

    DELL-Charles R

    Social Media and Communities Professional
    Dell Technologies | Enterprise Support Services
    #IWork4Dell

    Did I answer your query? Please click on ‘Accept as Solution’. ‘Thumbs up’ the posts you like!

  • Praveen.Singh

    4 Apprentice

    •

    489 Posts

    •

    17 Points

    450

    0

    Posted March 6th, 2023 00:00

    Do a power drain and check it came up its luck else replace the disk.

    Read the articles why SSDs went to failed after any of the upgrades there are several cases i saw not in Dell or other OEM as well.

  • 423

    0

    Posted March 8th, 2023 08:00

    Hi Charles, Praveen,

    Thank you for providing these steps. I followed them carefully but unfortunately I couldn't get these SSDs back to life. Replacing the controller battery did not help either. We had to replace both SSDs. Still wondering how can 2 SSDs drives fail at the same time...

    No data loss.

    Bests,
    Frédéric.

  • JasonFrost

    1 Message

    353

    0

    Posted March 27th, 2023 23:00

    This situation happened with us on 2 identical R730xd's.  The 200GB SSDs now show failed immediately after the 2.16 BIOS update (there was one in each server).  This is definitely suspicious.  On the next server, I will verify the drive is functional and then remove it prior to updating the BIOS (also, I'll try another server's drive in one of these 2 updated servers).  We'll narrow this down a little at least.