I have two MD3000i boxes. On one, I have several MD600 blades with Broadcom 5708 NICs that map to it.
On the other, I have a couple of R900's and added Broadcom 5709C w/ TOE & iSCSI offload.
Each MD3000i connects through two PowerConnect 5448 switches to their respective hosts (4 switches total).
I have enabled Jumbo frames on all server NICs (well, the iSCSI NICs that is), all switches, and all RAID controller ports on both MD3000i units.
I eventually fumbled my way through getting the iSCSI offload working (at least according to BACS3)... The documentation for this is pretty much non-existant as far as I can tell! So on the MD3000 with the regular 5708's hanging off of it, if I go into iSCSI statistics, I see the Jumbo Frame tally racking up lots of hits. If I do the same on the one that has the servers with the 5709C's hanging off of it, I can't seem to come up with any combination of settings that makes a single jumbo frame register. These are dual-port NICs, but I currently have just 1 port from each mapping to both controllers (4 sessions total).
I'm about to tear it all down and reconfigure with not using the iSCSI offload MAC/engine just to tripple-check that all of the pieces are configured right. But wanted to throw this out there and see if anyone can tell me if these two options are mutually exclusive or something and I'm fighting with something that's not even possible! I'd also be very thankful if anyone has found any official documentation on configuring iSCSI offload with Broadcom NICs and Windows. Pretttttty sure I'm doing it right, but only because it connects. :)
The two (and only two) servers on the problem SAN are both Windows 2k3 64-bit Enterprise.
Hmm. I think I found my answer. Along with the what I mentioned above, I was also finding that I was having problems keeping persistent connections established on the setup with the 5709's. They'd be fine for several hours, then the next morning I'd be missing one or two, so I was researching that in parallel.
I assumed too much and didn't give the support matrix a deep enough read before ordering. According to the Dec 08 MD3000i support matrix:
Page 7: "* iSCSI offload feature of the Broadcom NetXtreme II 5709 is not compatible with the MD3000i (both generations)"
Wow, that was pretty crazy timing. :) Thanks Dave, I had just come across that myself and am working on undoing it. Should have bought 5708's I guess as they are supported. Bummer..................
Your actual problem is that while the 5709 supports jumbo frames, and the 5709 does iSCSI offload it cannot do both at the same time. You have to go to the 10GbE Broadcom cards to get support for both at the same time.
The iSCSI offload capabilities of the 5708 and 5709 aren't really much of a performance gain or processor cycle savings. I haven't played with the 10Gbit/s Broadcom NICs yet, so maybe there's a bigger difference in performance with those, but current NIC drivers with current processing power makes the processor utilization of the software iSCSI initiator not really much of a performance-limiting impact.
JOHNADCO
2 Intern
•
847 Posts
610
0
Posted February 6th, 2009 15:00
Dang no responses yet.... I'd be currious as well.
We use ESX default initiators, so I am not the one to answer here.