The Azure data lakehouse toolkit : building and scaling data lakehouses with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake / Ron L'Esteve.

Design and implement a modern data lakehouse on the Azure Data Platform using Delta Lake, Apache Spark, Azure Databricks, Azure Synapse Analytics, and Snowflake. This book teaches you the intricate details of the Data Lakehouse Paradigm and how to efficiently design a cloud-based data lakehouse usin...

Full description

Saved in:
Bibliographic Details
Main Author: L'Esteve, Ron
Format: eBook
Language:English
Published: [United States] : Apress, 2022.
Subjects:
Online Access:Click for online access

MARC

LEADER 00000cam a2200000 a 4500
001 on1336459705
003 OCoLC
005 20240808213014.0
006 m o d
007 cr un|---aucuu
008 220718s2022 xxu o 001 0 eng d
040 |a YDX  |b eng  |c YDX  |d ORMDA  |d GW5XE  |d EZ9  |d EBLCP  |d OCLCF  |d N$T  |d OCLCQ  |d OCLCO 
019 |a 1336590483  |a 1336990616 
020 |a 9781484282335  |q (electronic bk.) 
020 |a 1484282337  |q (electronic bk.) 
020 |z 1484282329 
020 |z 9781484282328 
024 7 |a 10.1007/978-1-4842-8233-5  |2 doi 
035 |a (OCoLC)1336459705  |z (OCoLC)1336590483  |z (OCoLC)1336990616 
037 |a 9781484282335  |b O'Reilly Media 
050 4 |a TK5105.88813 
072 7 |a COM021000  |2 bisacsh 
072 7 |a UN  |2 bicssc 
072 7 |a UN  |2 thema 
049 |a HCDD 
100 1 |a L'Esteve, Ron. 
245 1 4 |a The Azure data lakehouse toolkit :  |b building and scaling data lakehouses with Delta Lake, Apache Spark, Databricks, Synapse Analytics, and Snowflake /  |c Ron L'Esteve. 
260 |a [United States] :  |b Apress,  |c 2022. 
300 |a 1 online resource 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
347 |a text file 
347 |b PDF 
520 |a Design and implement a modern data lakehouse on the Azure Data Platform using Delta Lake, Apache Spark, Azure Databricks, Azure Synapse Analytics, and Snowflake. This book teaches you the intricate details of the Data Lakehouse Paradigm and how to efficiently design a cloud-based data lakehouse using highly performant and cutting-edge Apache Spark capabilities using Azure Databricks, Azure Synapse Analytics, and Snowflake. You will learn to write efficient PySpark code for batch and streaming ELT jobs on Azure. And you will follow along with practical, scenario-based examples showing how to apply the capabilities of Delta Lake and Apache Spark to optimize performance, and secure, share, and manage a high volume, high velocity, and high variety of data in your lakehouse with ease. The patterns of success that you acquire from reading this book will help you hone your skills to build high-performing and scalable ACID-compliant lakehouses using flexible and cost-efficient decoupled storage and compute capabilities. Extensive coverage of Delta Lake ensures that you are aware of and can benefit from all that this new, open source storage layer can offer. In addition to the deep examples on Databricks in the book, there is coverage of alternative platforms such as Synapse Analytics and Snowflake so that you can make the right platform choice for your needs. After reading this book, you will be able to implement Delta Lake capabilities, including Schema Evolution, Change Feed, Live Tables, Sharing, and Clones to enable better business intelligence and advanced analytics on your data within the Azure Data Platform. What You Will Learn Implement the Data Lakehouse Paradigm on Microsoft's Azure cloud platform Benefit from the new Delta Lake open-source storage layer for data lakehouses Take advantage of schema evolution, change feeds, live tables, and more Write functional PySpark code for data lakehouse ELT jobs Optimize Apache Spark performance through partitioning, indexing, and other tuning options Choose between alternatives such as Databricks, Synapse Analytics, and Snowflake Who This Book Is For Data, analytics, and AI professionals at all levels, including data architect and data engineer practitioners. Also for data professionals seeking patterns of success by which to remain relevant as they learn to build scalable data lakehouses for their organizations and customers who are migrating into the modern Azure Data Platform. 
505 0 |a Part I: Getting Started -- Chapter 1: The Data Lakehouse Paradigm -- Part II: Data Platforms -- Chapter 2: Snowflake -- Chapter 3: Databricks -- Chapter 4: Synapse Analytics -- Part III: Apache Spark ELT -- Chapter 5: Pipelines and Jobs -- Chapter 6: Notebook Code -- Part IV: Delta Lake.-Chapter 7: Schema Evolution -- Chapter 8: Change Feed -- Chapter 9: Clones -- Chapter 10: Live Tables -- Chapter 11: Sharing -- Part V: Optimizing Performance -- Chapter 12: Dynamic Partition Pruning for Querying Star Schemas -- Chapter 13: Z-Ordering & Data Skipping -- Chapter 14: Adaptive Query Execution -- Chapter 15: Bloom Filter Index -- Chapter 16: Hyperspace -- Part VI: Advanced Capabilities -- Chapter 17: Auto Loader -- Chapter 18: Python Wheels -- Chapter 19: Security & Controls. 
500 |a Includes index. 
650 0 |a Microsoft Azure (Computing platform) 
650 0 |a Cloud computing. 
650 0 |a Electronic data processing. 
650 0 |a Databases. 
650 7 |a Cloud computing  |2 fast 
650 7 |a Databases  |2 fast 
650 7 |a Electronic data processing  |2 fast 
650 7 |a Microsoft Azure (Computing platform)  |2 fast 
776 0 8 |i Print version:  |z 1484282329  |z 9781484282328  |w (OCoLC)1310397015 
856 4 0 |u https://holycross.idm.oclc.org/login?auth=cas&url=https://link.springer.com/10.1007/978-1-4842-8233-5  |y Click for online access 
903 |a SPRING-COMPUTING2022 
994 |a 92  |b HCD