EMC Isilon provides an enterprise grade scale-out data lake to help protect, manage and secure all unstructured data. We are reinforcing our data lake with new announcements that include – 2 new platforms, new solutions, new access methods and SmartFlash Flash as Cache. Join us to learn more about our strategy and what’s new at Isilon.
Your hosts:
Nicholas Kirschis the Chief Technology Officer and Vice President of the Isilon Storage Division at EMC. His primary focus is extending EMC Isilon's lead in Scale-Out NAS products, technologies and market solutions. Nick is currently responsible for both product and technology strategy for Isilon's integrated storage appliance and the OneFS distributed file system. He also drives advanced development and strategic acquisitions.
Nick joined Isilon Engineering in 2002 as a Software Engineer for OneFS before serving as the Director of Software Engineering through 2007. He built and led Isilon's Product Management organization as Senior Director of Product Management through 2012. Nick holds Bachelor of Science degrees in Computer Science and Mathematics from the University of Puget Sound and a Master's degree in Computer Science from the University of Washington.
This discussion will take place July 8 - 25.
Share this event on Twitter:
>> Join Ask the Expert, EMC Isilon scale-out Data Lake http://bit.ly/1mGPlqD #EMCATE <<
The term data lake is new to me. Can you briefly describe it in the context of the storage industry, in general, and specifically in the context of Isilon scale-out NAS. Thanks!
(I copied this from the RSVP thread - hopefully you saw it there earlier!)
My apologies on the delay - we just finished the Seoul, Korea edition of the MegaLaunch and had a wonderful time redefining possible. As I see it in the most general context, a data lake is a shared storage infrastructure which enables a multitude of different applications and workloads to interact seamlessly. This naturally applies primarily to unstructured data (since storage systems can have knowledge of this information) and demands scalable technologies (since scale of performance and capacity are both critical requirements.)
In the context of Isilon’s Scale-Out data lake, we indeed provide a large scalable storage infrastructure for unstructured data - and more specifically, we provide seamless and shared access to applications which communicate via NFS, SMB (Windows), FTP/HTTP, HDFS (Hadoop), and (coming soon) OpenStack Swift. This is an extremely powerful combination of access methods, as it enables applications designed and written for a variety of purposes to co-exist peacefully - or more interestingly, interact (without data movement or additional copies.) Imagine (as an example) logging network access via traditional UNIX applications over NFS, using Hadoop MapReduce to find potential intrusion points, and generating graphical reports that can be viewed via a Windows workstation.
Added benefits of Isilon’s approach to the data lake is that the enterprise capabilities around storage, security, performance, and information management can all be applied uniformly to any or all of the application data. A few fun examples include the ability to provide secure multi-tenancy for Hadoop applications, de-dupe between Openstack Swift objects and NFS files, and see advanced performance details on simultaneous access (across all these protocols) to the same files!
I could go on, but I hope this explanation provides a strong foundation and sparks more curiosity.
What kind of performance improvements can we expect from the SmartFlash feature? Also, in what situations would GNA be a better choice for performance over SmartFlash and vice versa?
One of the many amazing things that only Isilon can do is provide a unified security context for these next-generation protocols (such as HDFS and OpenStack Swift).
This means that authentication services are provided by proven Enterprise frameworks (such as Active Directory, LDAP/Kerberos, or NIS) and permissions models are shared across emerging (HDFS/Swift) and traditional NAS (NFS/SMB) protocols.
In addition, OneFS brings support for multi-tenancy and encryption (via SEDs and local key management) easily to these emerging environments.
This makes it not only easy to expand the set of applications and workloads, create shared pipelines and workflows, but to do so in a way that will please even the most stringent security administrator.
Jim_Cahill
4 Posts
2238
1
Posted July 8th, 2014 11:00
The term data lake is new to me. Can you briefly describe it in the context of the storage industry, in general, and specifically in the context of Isilon scale-out NAS. Thanks!