mhyll

updated

22 days ago

M

mhyll

1 Rookie

•

3 Posts

•

10 Points

0

88

October 26th, 2026 23:09

R640 10x2.5" + HBA330 Mini + 8xNVME Enablement = NO NVME DRIVES working

I can see NVMe drives in DEVICE SETUP, but can't see them in iDRAC, nor in Proxmox. Drives are BLINKING and in Proxmox grep i am getting "resetting controller due to persistent internal error" errors constantly... any help?

 

 

  • DellMartinS

    Moderator

    •

    3883 Posts

    •

    25810 Points

    4

    0

    Posted October 27th, 2026 12:35

    with kind regards Martin/ Liebe Grüße Martin

     

    Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!

     

    DELL-Martin S

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell


  • DellMartinS

    Moderator

    •

    3883 Posts

    •

    25810 Points

    3

    0

    Posted October 27th, 2026 07:17

    Hi,

    Your NVMe drives are failing due to a hardware constraint or a firmware conflict:
    • Missing Second CPU: In the 10x2.5" chassis, NVMe bays 6–9 are wired directly to CPU 2. If you only have one CPU installed, these bays lack PCIe lanes, causing the drives to blink and fail. You can only use bays 2–5.
    • Drive Firmware Bug: Certain enterprise NVMe drives (like the Western Digital/HGST SN200 series) have a known bug with Dell 14G servers and Linux. They get stuck in a boot loop, causing the resetting controller due to persistent internal error message. They must be updated to the latest firmware on a different machine.

     

    please check linux power management too

    with kind regards Martin/ Liebe Grüße Martin

     

    Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!

     

    DELL-Martin S

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell


  • mhyll

    1 Rookie

    •

    3 Posts

    •

    10 Points

    4

    0

    Posted October 27th, 2026 07:29

    @DellMartinS​ The HW config is like this:

     

    2x Xeon Gold 6230R

    3x DIMM's per socket (A1,2,3 and B1,2,3) for now, will add another later

    2x SAS 200GB SSD for Proxmox OS in slot 0,1 (these are working perfectly)

    2x U.2 NVME 3.84TB for VM's (model HUSMR7638BDP3Y1)

     

    NVMe drives were OK, until i first launched Proxmox 9.2 on it (proxmox offered them for install), but after installation and reboot at the end, drives ended up in this state. How to fix this and where to get the latest FW? I have 113 on them. Can I use live Windows running from USB on the same server to fix that? How can i connect them on different machine?

    (edited)

  • DellMartinS

    Moderator

    •

    3883 Posts

    •

    25810 Points

    2

    0

    Posted October 27th, 2026 11:37

    Because these are generic HGST/WD drives, Dell iDRAC cannot update them. You must download the latest firmware binary and the HGST Device Manager (HDM) or WD Dashboard utility directly from Western Digital's enterprise support portal.
     
    Can You Use Live Windows on the R640?
    Yes, but you must hot-plug them. If they are plugged in during boot, the server PCIe bridge will freeze them.
    1. Pull both NVMe drives out by an inch so they disconnect.
    2. Boot your Live Windows USB on the R640.
    3. Once Windows is fully loaded, push the drives back in (hot-plug).
    4. Run the WD firmware tool to update them.
     
    How to Connect to Another Machine
    Because these are U.2 drives, you cannot plug them into standard M.2 slots without an adapter. You need a U.2 to PCIe x4 adapter card (costs ~$10). Install the drive onto the card, plug it into an open PCIe slot on a standard Windows desktop, and run the firmware update there.
     
    Temporary Proxmox Fix
    To stop the blinking and loops right now so you can boot Proxmox:
    1. Press e at the Proxmox GRUB boot menu.
    2. Add pcie_aspm=off nvme_core.default_ps_max_latency_us=0 to the end of the linux line.
    3. Press Ctrl+X to boot.

    with kind regards Martin/ Liebe Grüße Martin

     

    Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!

     

    DELL-Martin S

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell


  • mhyll

    1 Rookie

    •

    3 Posts

    •

    10 Points

    3

    0

    Posted October 27th, 2026 12:14

    @DellMartinS​ but where can i find firmware BIN file for update. :( will HDM or WD Dashboard download it for me?

    (edited)