UNSOLVED

jas0420

updated

18 years ago

J

jas0420

10 Posts

0

26574

February 5th, 2009 16:00

iSCSI offload + Jumbo frames??

Hi all,

I have two MD3000i boxes.  On one, I have several MD600 blades with Broadcom 5708 NICs that map to it. 

On the other, I have a couple of R900's and added Broadcom 5709C w/ TOE & iSCSI offload. 

Each MD3000i connects through two PowerConnect 5448 switches to their respective hosts (4 switches total).

I have enabled Jumbo frames on all server NICs (well, the iSCSI NICs that is), all switches, and all RAID controller ports on both MD3000i units.

I eventually fumbled my way through getting the iSCSI offload working (at least according to BACS3)...  The documentation for this is pretty much non-existant as far as I can tell!  So on the MD3000 with the regular 5708's hanging off of it, if I go into iSCSI statistics, I see the Jumbo Frame tally racking up lots of hits.  If I do the same on the one that has the servers with the 5709C's hanging off of it, I can't seem to come up with any combination of settings that makes a single jumbo frame register.  These are dual-port NICs, but I currently have just 1 port from each mapping to both controllers (4 sessions total).

I'm about to tear it all down and reconfigure with not using the iSCSI offload MAC/engine just to tripple-check that all of the pieces are configured right.  But wanted to throw this out there and see if anyone can tell me if these two options are mutually exclusive or something and I'm fighting with something that's not even possible!  I'd also be very thankful if anyone has found any official documentation on configuring iSCSI offload with Broadcom NICs and Windows.  Pretttttty sure I'm doing it right, but only because it connects.  :)

The two (and only two) servers on the problem SAN are both Windows 2k3 64-bit Enterprise.

MS iSCSI Initiator:  2.08

BACS:  11.6.10.0

5709C bxvbda.sys driver:  4.4.50.0

5709C bxnd52a.sys driver:  4.4.15.0

PowerConnect 5448 firmware:  2.0.0.32

MD3000i firmware:  7.35.22.60

Thanks!!

  • JOHNADCO

    2 Intern

    •

    847 Posts

    610

    0

    Posted February 6th, 2009 15:00

    Dang no responses yet....  I'd be currious as well.

     

    We use ESX default initiators,  so I am not the one to answer here.

  • jas0420

    10 Posts

    610

    0

    Posted February 7th, 2009 09:00

    Hmm.  I think I found my answer.  Along with the what I mentioned above, I was also finding that I was having problems keeping persistent connections established on the setup with the 5709's.  They'd be fine for several hours, then the next morning I'd be missing one or two, so I was researching that in parallel.

    I assumed too much and didn't give the support matrix a deep enough read before ordering.  According to the Dec 08 MD3000i support matrix:

    Page 7: "* iSCSI offload feature of the Broadcom NetXtreme II 5709 is not compatible with the MD3000i (both generations)"

    http://support.dell.com/support/edocs/systems/md3000i/en/SUPPORTMATRIX/MD3000i_SupportMatrixA12.pdf

  • jas0420

    10 Posts

    610

    0

    Posted February 7th, 2009 09:00

    Wow, that was pretty crazy timing.  :)  Thanks Dave, I had just come across that myself and am working on undoing it.  Should have bought 5708's I guess as they are supported.  Bummer..................

  • dzenz

    175 Posts

    610

    0

    Posted February 7th, 2009 09:00

    Crazy timing indeed! ;-)

    Dave

     

  • dzenz

    175 Posts

    610

    0

    Posted February 7th, 2009 09:00

    Please reference the MD3000i Support Matrix document, there's a ton of useful data in it.

    http://support.dell.com/support/edocs/systems/md3000i/en/SUPPORTMATRIX/MD3000i_SupportMatrixA12.pdf

    Specifically it states:

    * iSCSI offload feature of the Broadcom NetXtreme II 5709 is not compatible with the MD3000i (both generations)

    So the fix would be not use the iSCSI offload feature.

    Dave

     

  • elec999

    37 Posts

    610

    0

    Posted April 12th, 2011 09:00

    Is this still valid or dell fixed the issue?

  • jabuzz

    1 Rookie

    •

    36 Posts

    •

    30 Points

    610

    0

    Posted April 13th, 2011 03:00

    Your actual problem is that while the 5709 supports jumbo frames, and the 5709 does iSCSI offload it cannot do both at the same time. You have to go to the 10GbE Broadcom cards to get support for both at the same time.

  • Dev Mgr

    6 Operator

    •

    9308 Posts

    •

    3 Points

    610

    0

    Posted April 13th, 2011 06:00

    The iSCSI offload capabilities of the 5708 and 5709 aren't really much of a performance gain or processor cycle savings. I haven't played with the 10Gbit/s Broadcom NICs yet, so maybe there's a bigger difference in performance with those, but current NIC drivers with current processing power makes the processor utilization of the software iSCSI initiator not really much of a performance-limiting impact.