Join us for a live tech talk! After the presentation, we’ll have time for questions. Excited to have you join us!
Change data capture is a popular method for unobtrusively ingesting data from SQL sources. In this talk, we will show how to easily incorporate your SQL data sources in near-real-time into Databricks and Delta Lake on Google Cloud. We will provide a short introduction to change-data-capture, Google Datastream (serverless CDC on Google Cloud), Databricks, and Delta Lake. In addition, we will also give a walk-through of our new open source Spark Structured Streaming connector which provides an easy-to-use / configure method of linking Datastream to Delta Lake.
Badal.io
Data Engineer
U of T Computer Science graduate with roughly 10 years experience. Worked in a range of projects in the areas including adtech (Realtime bidding) and fraud detection / prevention. Experienced in data processing frameworks like Apache Spark / Beam and recently turned focus on the GCP ecosystem. I enjoy learning and programming in Scala. In my free time, I enjoy photography / travel and obsessin…
U of T Computer Science graduate with roughly 10 years experience. Worked in a range of projects in the areas including adtech (Realtime bidding) and fraud detection / prevention. Experienced in data processing frameworks like Apache Spark / Beam and recently turned focus on the GCP ecosystem. I enjoy learning and programming in Scala. In my free time, I enjoy photography / travel and obsessing over basketball (Toronto Raptors) I also am trying to learn videography.
Databricks
Community Program Manager
Databricks
Developer Advocate
Denny Lee is a Developer Advocate at Databricks. He is a hands-on distributed systems and data sciences engineer with extensive experience developing internet-scale infrastructure, data platforms, and predictive analytics systems for both on-premise and cloud environments. He also has a Masters of Biomedical Informatics from Oregon Health and Sciences University and has architected and implemented powerful data solutions for enterprise Healthcare customers. His current technical focuses include Distributed Systems, Apache Spark, Deep Learning, Machine Learning, and Genomics.
Delta Lake Community Advocate
Marketing Manager