MD3220 DAS VMWare ESXi 4.1 Shared storage configuration for HA/Vmotion
Can't seem to get this right so I am looking for a little help.
Here are the components:
1 x MD3220 DAS Dual Controller
2 x R710 Dual Dual Port 6Gb SAS HBA's
VMWare ESXi 4.1 u1
Controller 0 owner of Virtual Disk 1 -> Connected to R710-1 (VMWare Fixed Multipath policy)
R710-1 hba3 -> Controller 0 (preferred)
R710-1 hba2 -> Controller 1
Controller 1 owner of Virtual Disk 2 -> Connected to R710-2 (VMWare Fixed Multipath policy)
R710-2 hba2 -> Controller 1 (preferred)
R710-2 hba3 -> Controller 0
MD3220 Mappings -
Virtual disk 1 accessible by R710-1
Virtual disk 2 accessible by R710-2
This setup works just fine. The problem now is I want to configure VMWare HA and Vmotion which requires the storage to be shared. R710-1 needs to be able to see Virtual Disk 2 and R710-2 needs to be able to see Virtual Disk 1.
So I created a Cluster Group on the MD3220 and added both R710's to it. I then changed the mapping for Virtual Disk 1 to the new Cluster Group. I then rescanned my HBA's in VMWare and am able to then see Virtual Disk 1 from both R710's. The problem I am seeing is as soon as this happens, the disk latency on both R710's skyrockets and the VM's crawl to a halt until I remove the mapping. Also, the controller ownership bounces back and forth between controller 0 and 1. What am I doing wrong? Since controller 0 owns Virtual Disk 1, what should my HBA preference look like for R710-2? Should it prefer hba3 since it has a direct connection to Controller 0?
Could it be a LUN number issue? Currently both virtual disks are lun 0 and when I change the mapping to the cluster group it requires that I change the lun for the virtual disk.
Think I may have figured out my issue but won't know until this weekend whether or not it is actually the problem. I think what I was doing was giving preferred paths to the virtual disk over separate controllers. So R710-1 had a preferred path to virtual disk 1 over controller 0 and R710-2 had a preferred path to virtual disk 1 over controller 1, and since only one controller can access a virtual disk at the same time, this may explain why it was flopping. Each server was accessing the virtual disk simultaneously and therefore the controller ownership had to switch back and forth. Sound about right?
Ok, I was able to play with it this morning and got it going. The issue was that I was preferring paths to the same virtual disk over 2 different controllers. Once I drew it all out and took my time I was able to get the multipath settings correct in vm.
The only remaining issue I have is this...
Since both R710's now access the same virtual disk over the same controller, what happens when I unplug one of the HBA's from one of the R710's? What I assume will happen is the R710 that I unplugged the HBA from will use the secondary HBA to access the virttual disk, and that path is on the other controller. So that HBA will be accessing the virtual disk over one controller and the other R710 will be accessing the virtual disk over the other controller. Won't this once again cause the controllers to start flapping?
Hello. I am interested in knowing if you were able to test this controller flapping issue any further. I want to use the MD3220 DAS in a VMWare HA configuration, but am worried about your last scenario. Dell/VMWare are not coming right out and saying it is not supported, but are also not saying it will not work. Thanks, Jason
Oh, I just noticed I hadn't updated this with my most recent experience, I had been running Fixed which was working fine, until I vmotion'd a few vm's over to another host. As long as I moved all the vm's from one host to another it was ok. But it seemed as if I only moved a few or only moved a few back, the controller thrashing started and everything grinded to a hault. This is when I discovered I shouldn't be using the fixed policy at all, and plan to change to MRU.
Jason, I had been hoping to get a maintenance window in order to change my multipath configurations to MRU, but have been unable get the time. I hope by next weekend I can try it out. According to the vmware hardware compatability list, MRU is the preferred multipath method, which I have not tried yet. I was using fixed. I sure hope that does the trick, otherwise the SAN is useless and won't do any good for vmotion, HA, fault tolerance etc. I will update this and let you know how it goes.
acom
17 Posts
•
5 Points
559
0
Posted June 16th, 2011 08:00
That is what it defaults to when I rescan the HBA's and it bounces as well.