UNSOLVED

victory_is_mine

updated

12 years ago

V

victory_is_mine

2 Intern

•

236 Posts

1

3285

January 19th, 2015 12:00

Deduplication on block LUNs for VMware

Hi All,

Is it a best practice to enable Deduplication on the block pool LUNs in VMware environment?

Any input is appreciated.

  • kelleg

    6 Operator

    •

    4537 Posts

    1402

    0

    Posted January 19th, 2015 13:00

    Please see KB 188409 - this is a list of KB Articles about Deduplication and best practices for setting up deduplication.

    You should also read the White Paper for Depuplication prior to setting up dedup. There are restrictions that you should be aware for first. Also, see this document for a quick overview of deduplication:

    glen

    1 Attachment

  • brettesinclair

    2 Intern

    •

    715 Posts

    1402

    0

    Posted January 19th, 2015 13:00

    It's not necessarily best practice, but an optional practice

    There seems to be a fair amount of angst on the implementation of dedup in VNX due to there being numerous identified issues experienced by early adopters. Each new release of block OE seems to bring a raft of fixes and updates.

    Keep in mind the following points;

    • All dedup'd LUN's are located into a new deduplication 'Container' owned by a single SP. This means all dedup'd LUNS will be owned by the same SP, which can require management/intervention to avoid saturating this single SP
    • It is post process, not inline and uses thin LUN's. Any thick LUN's you enable dedup on will be migrated to thin.
    • There may be a performance impact, there is definitely an overhead.
    • Update to the latest Block OE to ensure you have the most up-to-date featureset
    • test on some non-tier1/non-mission critical LUN's

    Check out the guide for some good reference  https://www.emc.com/collateral/white-papers/h12209-vnx-deduplication-compression-wp.pdf

    In theory, vm's are a good candidate for space savings, but like always, test thoroughly.

    EDIT: all these empty auto-responses from 'beautifial' are getting a bit nuts!

  • victory_is_mine

    2 Intern

    •

    236 Posts

    1403

    0

    Posted January 19th, 2015 16:00

    Thanks Glen

  • dynamox

    11 Legend

    •

    20419 Posts

    •

    87439 Points

    1403

    0

    Posted January 19th, 2015 16:00

    Brett@S wrote:

    It's not necessarily best practice, but an optional practice

    There seems to be a fair amount of angst on the implementation of dedup in VNX due to there being numerous identified issues experienced by early adopters. Each new release of block OE seems to bring a raft of fixes and updates.

    Keep in mind the following points;

    • All dedup'd LUN's are located into a new deduplication 'Container' owned by a single SP. This means all dedup'd LUNS will be owned by the same SP, which can require management/intervention to avoid saturating this single SP

    to add on Brett's last point, if you have multiple pools than you will be able to utilize multiple SPs. One pool's lun will be stacked on SPA and other on SPB. I still hate this  because it will be come so imbalanced.  No dedupe on VNX for me anytime soon, this should not have been released in its current state. Who in their right mind would want to place all their LUNs on one SP.

  • victory_is_mine

    2 Intern

    •

    236 Posts

    1402

    0

    Posted January 19th, 2015 16:00

    Thanks Brett

  • victory_is_mine

    2 Intern

    •

    236 Posts

    1403

    0

    Posted January 20th, 2015 07:00

    I am not going with deduplication for block on VNX then, at least not for production.

  • 1403

    0

    Posted January 20th, 2015 07:00

    +1 to Brett and Dynamox.

    We had multiple issues with Deduped LUNs from our VNX2 series arrays with LUNs presented to ESX hosts - and once we migrated them to different pools (and re-balanced all pools out), the issues no longer persist.

    It is definitely a deal breaker with assigning LUNs per SP for utilizing the dedupe functionalities in the VNX arrays. Until a fix is available, I wouldn't want to venture into using it.

    My $0.02

  • fvo

    3 Posts

    1403

    0

    Posted March 3rd, 2015 09:00

    Hi akc5247,

    Can you describe the issues you experienced with dedupe luns presented to ESX hosts?  We are looking to test this setup and any info you could pass along would be greatly helpful.

    Re,

    -F

  • kelleg

    6 Operator

    •

    4537 Posts

    1403

    0

    Posted March 3rd, 2015 14:00

    Be sure to read all the documents that have been attached to this discussion. One major point is the amount of Writes to the LUNs - if you get over 30%, performance will suffer. You really need to know what the IO profile of the LUNs will be before you try deduping them.

    glen

  • sk_

    1 Rookie

    •

    104 Posts

    391

    0

    Posted March 4th, 2015 01:00

    Hi fvo,

    We started our VNX5400 usage by enabling Dedup on most of the LUNs (VMware).

    But dedup causes quite big performance issues, both write and read. Especially the allocation of new data slices within dedup container is quite problematic currently, it doesn't spread out to whole pool/tier in same way like Thick LUNs.

    Due to these performance issues, we had to move away from dedup/thin LUNs to using Thick LUNs. Only using DeDup for some EOL/Archive date.

    Also, there is still open defect where dedup process can make autotier rebalancing fail.

    -sk