Azure Data Lake Storage Gen2 Architecture

9 minutes to read.
Azure data lake storage gen2 architecture. Azure data lake storage immutable storage is now in preview. For more information see the product page. Data from various sources lands in azure data lake storage gen2 via azure data factory and other data movement tools. Azure data lake storage gen1 is an enterprise wide hyper scale repository for big data analytic workloads.
The diagram above shows a reference architecture for the modern data warehouse pipeline built on azure data lake storage gen2 and azure serverless components. Azure data lake enables you to capture data of any size type and ingestion speed in one. Data lake analytics gives you power to act on. It combines the power of a hadoop compatible file system with integrated hierarchical namespace with the massive scale and economy of azure blob storage to help speed your transition from proof of concept to production.
Azure data factory azure synapse analytics preview azure data lake storage gen2 is a set of capabilities dedicated to big data analytics built into azure blob storage it allows you to interface with your data using both file system and object storage paradigms. Data lake is a key part of cortana intelligence meaning that it works with azure synapse analytics power bi and data factory for a complete cloud big data and advanced analytics platform that helps you with everything from data preparation to doing interactive analytics on large scale datasets. Azure data lake storage gen2. Its set of capabilities consists of the best features from azure blob storage and azure data lake.
Azure data lake storage gen2 access control list recursive update in public preview. Load data into azure data lake storage gen2 with azure data factory. Data lake storage gen2 is an additional capability for big data analytics built on top of azure blob storage. While there are many benefits in leveraging existing platform components of blobs to create and operate data lakes for analytics it does lead to multiple concepts describing the same shared things.
Azure blob soft delete for containers public preview. Azure data lake storage gen2. Built on azure blob the azure data lake storage gen2 offers capabilities like file system semantics directory file level security low cost tiered storage high availability disaster recovery and scalability. Azure data lake storage gen2 is the world s most productive data lake.
4 minutes to read 5. Azure data lake storage gen2 builds azure data lake storage gen1 capabilities file system semantics file level security and scale into azure blob storage with its low cost tiered storage high. Azure data lake storage lifecycle management is now generally available.