iDRAC9: impossible to modify Fan Response for 3rd Party PCI cards
Hello all,
We are facing an annoying issue with our brand new T640 when we try to put Nvidia 1080Ti cards in it: all the 6 fans dedicated to PCI slots are running full speed.
After some fruitful searches, we found that this is a somewhat default behavior of Dell servers when inserting 3rd party PCI cards, but we also found that this default response can be modified using some 'racadm' tricks (see here and here). We found that it's also possible with some IPMI raw commands as mentionned there
That command is not valid for an iDRAC9. You can reference the iDRAC9 RACADM CLI guide starting on page 229. The PCIe Linear Feet per Minute commands are covered in that section. The LFM control can be disabled. It is set to automatic by default. Set to automatic the behavior will be to increase the LFM if a third party device is detected.
Out T640 is now much quieter. For those interesting in the solution, here is the list of required 'racadm' commands:
racadm get System.PCIESlotLFM // List all available PCI slots
// For us, only the third one was of interest
racadm set System.PCIESlotLFM.3.LFMMode 2 // Custom
After a reboot, all the PCI fans were running at 12%, which is almost inaudible.
We also tried to modify this property using the iDRAC WebGUI as mentionned here. We were able to see that the 'PCIe Airflow Settings' was set to 'Custom' on the startpage, but there was no modifiable option in Cooling ->Fan Overview -> Configure Fans.
We still have a question: After setting the LFMMode to 'Custom' or 'Disabled', can you ensure that the fan will still adapt their speed to the temperature, as they should normally do?
Anyway, thank you again for your very helpful response. Cheers, Michael
@Michael.A wrote: We still have a question: After setting the LFMMode to 'Custom' or 'Disabled', can you ensure that the fan will still adapt their speed to the temperature, as they should normally do?
This is answered in FAQ number 3 of the 14G thermal document linked previously. There are no configuration options available that will allow you to stop normal fan response from occurring. The options available only allow you to stop the potential over-cooling of third party fan response or create a custom over-cooling. No option will allow you to stop or reduce fan response below normal operation levels.
Hi Michael - We are trying to enable two GTX 1080 Ti on Dell T640 Tower Server. The problem that we are facing is that as soon as we restart the system after installing the drivers, the drivers disappear and we are not able to enable the GPUs. I know that GTX 1080 Ti isn't compatible with T640 but I am sure that there must be some workaround as I see you using those. Can you please help us figure out this? Thanks much!
We have an R7415 with a really like GT730 GPU in it that came out of an R630 and functioned fine but on this model I can't get it to put the fans at any less than 100% it just refuses to accept any other value.
I've contacted Dell pro support who tell me there is an ipmi command but the software team are not willing to share it.
The LFM option discussed in this thread allows you to disable extra cooling. When unsupported hardware is installed that the iDRAC does not have a thermal profile for it will be cautious and over-cool. If you don't feel that is necessary then you can disable over-cooling with the commands discussed.
Disabling over-cooling will not stop the system from normal fan response. GPUs create a lot of heat, the fan speeds throughout the system should increase to remove that heat. So, I would expect an increase in fan speed whether LFM response is adjusted or not.
If there is an issue with the thermal profile then the troubleshooting steps would be:
Enable Collect System Inventory on Reboot
Remove power connectors for about 60 seconds to drain volatile memory
Use LifeCycle controller to wipe iDRAC or other methods to reset the iDRAC to defaults
Those steps will allow the hardware to be detected again, clear any configuration that is resident in memory, and create a new configuration file. If there are issues with old settings not be overwritten or updating then those steps should help fix that problem.
Daniel My
12 Elder
•
6205 Posts
18752
0
Posted February 27th, 2018 11:00
Thank you for the service tag.
That command is not valid for an iDRAC9. You can reference the iDRAC9 RACADM CLI guide starting on page 229. The PCIe Linear Feet per Minute commands are covered in that section. The LFM control can be disabled. It is set to automatic by default. Set to automatic the behavior will be to increase the LFM if a third party device is detected.
http://www.dell.com/support/home/product-support/product/idrac9-lifecycle-controller-v3.00.00.00/
You may also be able to modify the fan response in the web GUI discussed in FAQ 10 of this article on 14th generation thermals:
http://en.community.dell.com/techcenter/extras/m/white_papers/20444245/
Thanks