Airbyte is an open-source data integration platform that syncs data from applications, APIs & databases to data warehouses, lakes, and other destinations. Delta Lake is an open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python. Together they can help address many data integration issues.
In today’s session, Simon Späti from Airbyte and Denny Lee, Delta Lake maintainer from Databricks discuss data integration with Airbyte and Delta Lake. From ELT vs. ETL to normalization of data to orchestration, we will discuss the complexities and potential solutions to simplify your data integration.
Denny Lee is a Developer Advocate at Databricks. He is a hands-on distributed systems and data sciences engineer with extensive experience developing internet-scale infrastructure, data platforms, and predictive analytics systems for both on-premise and cloud environments. He also has a Masters of Biomedical Informatics from Oregon Health and Sciences University and has architected and implemented powerful data solutions for enterprise Healthcare customers. His current technical focuses include Distributed Systems, Apache Spark, Deep Learning, Machine Learning, and Genomics.