DStringers

updated

6 years ago

D

DStringers

1 Rookie

•

15 Posts

0

3070

October 1st, 2020 23:00

"Faliure Predicted" on recently rebuilt drive

Hi all,

I recently replaced a RAID1 OS drive for a R320. The previous drive was marked as "Failure Predicted". Since installing the new device and monitoring the rebuild process, the device is still showing "Failure Predicted". I assume this could indicate an issue with the controller, which is a H310 Mini? 

I did install perccli and have been using it to try and get some debug info. I have included some output here, and can supply more.

The output of perccli /c0 show is:

TOPOLOGY :
========

-----------------------------------------------------------------------------
DG Arr Row EID:Slot DID Type State BT Size PDC PI SED DS3 FSpace TR
-----------------------------------------------------------------------------
0 - - - - RAID1 Optl N 278.875 GB dflt N N dflt N N
0 0 - - - RAID1 Optl N 278.875 GB dflt N N dflt N N
0 0 0 32:0 0 DRIVE Onln N 278.875 GB dflt N N dflt - N
0 0 1 32:1 1 DRIVE Onln N 278.875 GB dflt N N dflt - N
-----------------------------------------------------------------------------

VD LIST :
=======

-------------------------------------------------------------------------
DG/VD TYPE State Access Consist Cache Cac sCC Size Name
-------------------------------------------------------------------------
0/0 RAID1 Optl RW Yes NRWTD - OFF 278.875 GB Virtual Disk 0
-------------------------------------------------------------------------

PD LIST :
=======

------------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type
------------------------------------------------------------------------------
32:0 0 Onln 0 278.875 GB SAS HDD N N 512B ST300MP0026 U -
32:1 1 Onln 0 278.875 GB SAS HDD N N 512B ST300MP0026 U -
------------------------------------------------------------------------------

This output seems to indicate that everything is working as expected? The only thing that concerns me is that in the Topology table, one of the disks is not marked as part of a RAID1 array? Or is that just indicating the device in use by the OS? 

Some clarification/assistance would be greatly appreciated.

Thanks,

David

  • DiegoLopez

    6 Operator

    •

    2668 Posts

    2048

    1

    Posted October 2nd, 2020 04:00

    Hello @DStringers,

     

    Welcome to the Dell Community!

     

    Ok, so let's rewind a little bit. When you said: "The previous drive was marked as "Failure Predicted". Since installing the new device and monitoring the rebuild process..." What was exactly the procedure you followed to replace the disk? As you may know a pred fail error means the disk is about to fail. But is still working and is part of the RAID. So before replacing it you need to mark it as offline. As this procedure explains:

     

    PowerEdge HDD: What is predicted Drive Failure and How to solve it?

     

    Dell PowerEdge: How to switch offline a hard disk using OpenManage Server Administrator

     

    - Can you confirm me if you followed this procedure for the disk replacement?

     

    Anyway, I've seen this error on the past (pred fail error persist after disk has been replaced). Normally it is solved by updating PERC firmware.

     

    - Can you let me know what is the PERC firmware and the OS?

     

    For your message, I guess you don't have Open Manage Server Administrator. I strongly recommend you to install it. It is Windows and Linux compatible.

     

    Support for Dell EMC OpenManage Server Administrator (OMSA)

     

     

    Hope this helps. Please let me know if you have any more questions.

    Regards.

  • DStringers

    1 Rookie

    •

    15 Posts

    1975

    0

    Posted October 7th, 2020 21:00

    Interestingly, the OSMA and the blinking drive are both now happy, no blinking lights or reporting. But in the iDrac for the device the status is still marked as Warning. So unsure what's going on there.

  • DStringers

    1 Rookie

    •

    15 Posts

    1982

    0

    Posted October 7th, 2020 21:00

    Hi Diego!

    So yeah I can confirm that I certainly didn't follow that procedure. I just pulled the drive out and put the new one in (I am aware in hindsight should be more careful. Another disk in this unit has just failed so I'll even have a chance to put it into practice soon enough :P). 

    The firmware info from OSMA (which I do have installed, I used the CLI trying to drill down a bit further into what's going on) shows it is out of date so I'll go ahead and upgrade that as a first step:

    • Firmware Version: 20.13.0-0007
    • Minimum Required: 20.13.1-0001
    • Driver Version: 07.700.00.00-rc1

    Thanks so much for your help, hopefully it'll be resolved after this!

  • DELL-Joey C

    Moderator

    •

    4170 Posts

    •

    20965 Points

    1963

    0

    Posted October 7th, 2020 23:00

    Hello,

     

    Good to know that the array has rebuild with the replacement drive. In iDRAC, does it say where the warning is? Do you have a screenshot of the warning status? Is the replacement drive a Dell drive? The iDRAC may report a warning if the drive firmware is not detect, but that's my assumption. Have you updated the iDRAC and LCC?

     

    Let us know more. 

    DELL-Joey C

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’ if I did. 

  • DStringers

    1 Rookie

    •

    15 Posts

    1927

    0

    Posted October 11th, 2020 20:00

    No it's not giving me any information, just a warning triangle next to the status, as follows:

    DStringers_0-1602474785708.png

    The replacement was purchased straight from Dell yes. I will update iDRAC and LCC now and see what happens, thank you for the suggestion.

  • DELL-Joey C

    Moderator

    •

    4170 Posts

    •

    20965 Points

    1922

    0

    Posted October 11th, 2020 21:00

    Hi,

     

    Let us know the outcome after the firmware updates. 

     

    How about the right side of the column in the screenshot that you did, is the info populated there? Like the firmware revision, part number and other info. 

     

    We probably might need to look into further details of the PERC log if you want to find out what's the cause of the alert status. https://dell.to/371GOMF. Let us know if you've done the exported logs, you can either private message Diego or me the service tag after you have uploaded the logs at https://dell.to/30ZK6w2;

     

    Let us know.

    DELL-Joey C

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’ if I did. 

  • DStringers

    1 Rookie

    •

    15 Posts

    1919

    0

    Posted October 11th, 2020 22:00

    Hi again.

    I'm waiting for the firmware to update as we speak. In regards to the rest of the info please see the following image (sorry I thought I got it before but it must have been cut off.)

    DStringers_0-1602480165267.png

    The support assist option is not available on my outdate iDrac version, so I will complete the update then perform the support assist when available.

    Thanks!

    David

  • DELL-Joey C

    Moderator

    •

    4170 Posts

    •

    20965 Points

    1912

    0

    Posted October 11th, 2020 22:00

    Hi,

     

    I just notice, the drive firmware is KT39. There is an update to KT3A, https://dell.to/3iQzkyb . Probably you might want to look into that. Though, if it involves updating a drive, I would highly suggest to do a data backup before proceeding to update. 

    DELL-Joey C

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’ if I did. 

  • DStringers

    1 Rookie

    •

    15 Posts

    1905

    0

    Posted October 11th, 2020 23:00

    The firmware update has done the trick. Will try to keep on top of it in future.

    Thanks guys for all your help! 

  • DStringers

    1 Rookie

    •

    15 Posts

    295

    0

    Posted October 12th, 2020 21:00

    Okay guys just wanted to make a followup. 

    I've been progressively updating the iDRAC but some later upgrades have resulted in errors. I have tried using the rollback but that is only good for one downgrade. Is it possible to manually downgrade by running the "Upgrade" dialog with an older system image?

     

    Thanks,

    David