In this talk, we will take a look at how we use Spark on our own Databricks platform with Burak Yavuz. Source: Databricks’ Data Pipeline: Journey and Lessons Learned