More info....when the server boots back up, it acts as if it is finding the NIC for the first time, so you go through that wizard.  Then when you try to IP it to the correct IP, it says another NIC already has that IP, so it remembers it from somewhere. 

 

This ONLY happened on PE 2900 servers with added on Intel Fiber NICs, even though other server models were also forcefully shutdown.  Is it a 2900 problem?

 

The driver you referred me to is a Broadcom. 

I've got the same issue on a PE2950.  It happened to my 2 Intel Pro/1000 PCI-E cards.  They should be fixed IP, but reverted back to DHCP after a power failure.  The onboard broadcom kept it's fixed IP.  (my server is triple-NIC'd)

 

Have you had any luck finding a solution to this issue?

Nope.  I have a multitude of other systems to maintain, so I haven't had time to do any more digging.  When I get time, I will probably call support, but until then, I just hope the power does not fail again.  The servers in question run public safety applications and must be up 24x7, so I can't even do any testing.