Describe Azure Data Lake Storage Gen2

Azure Data Lake Storage Gen2 is more than just another data storage option; it’s a large-scale data lake solution tailored for big data analytics. Gen2 enhances the core capabilities of Azure Data Lake Storage Gen1, coupling the benefits of Azure blob storage capabilities with addi-tional and robust data analytics features. As you venture into this, you’ll uncover the depth and breadth of features designed to assist you.

Key enhancements of Azure Data Lake (Gen2)

Azure Data Lake Storage, in its second-generation incarnation, has significantly improved features. Designed to be the optimum solution for big data analytics, Gen2 not only augments

Skill 3.1: Describe capabilities of Azure Storage      CHAPTER 3        81

its original functionalities but also integrates seamlessly with various Azure services. Here are the key enhancements that distinguish Azure Data Lake Storage Gen2 from its predecessor:

• Performance: The second version has enhanced data analytics performance and management ease due to Azure Blob storage capabilities.
• Hierarchical namespaces: This unique feature facilitates data organization and fine-tuned data access management. With this, you can efficiently manage and organize your data into folders and subfolders.

• Security: Enhanced security features include POSIX-compliant access control lists (ACLs) and Azure Active Directory (Azure AD)–based authentication and role-based access control. (POSIX is a set of standards defined by the IEEE to ensure compatibility between operating systems. The intent is that developers can write applications that are portable, meaning they can be run on various operating systems without modifications. An ACL is a list of permissions attached to an object, such as a file or directory. These permissions dictate what actions a user, or a group of users, can perform on that object.)

• Scalability and durability: Built on Azure Blob storage, Azure Data Lake Storage Gen2 guarantees high availability, disaster recovery, and backup.