Join us for a live tech talk! After the presentation, we’ll have time for questions. Excited to have you join us!
Change data capture is a popular method for unobtrusively ingesting data from SQL sources. In this talk, we will show how to easily incorporate your SQL data sources in near-real-time into Databricks and Delta Lake on Google Cloud. We will provide a short introduction to change-data-capture, Google Datastream (serverless CDC on Google Cloud), Databricks, and Delta Lake. In addition, we will also give a walk-through of our new open source Spark Structured Streaming connector which provides an easy-to-use / configure method of linking Datastream to Delta Lake.
Badal.io
Data Engineer
U of T Computer Science graduate with roughly 10 years experience. Worked in a range of projects in the areas including adtech (Realtime bidding) and fraud detection / prevention. Experienced in data processing frameworks like Apache Spark / Beam and recently turned focus on the GCP ecosystem. I enjoy learning and programming in Scala. In my free time, I enjoy photography / travel and obsessin…
Databricks
Community Program Manager
Databricks
Developer Advocate
Delta Lake Community Advocate
Marketing Manager