We’re the meetup for everything Databricks: Apache Spark, Delta Lake, MLflow, the Lakehouse-and all the other goodies that are part of, support or integrate with Databricks.
We post recordings of past events on this channel.
Our events are hybrid or virtual. You’re welcome to come in-person in Melbourne (should that ever be possible again), or you can join virtually from anywhere.
We meet the first Thursday of each month at 6 pm, Melbourne time (AEST or AEDT).
Hi Jonathan, thanks for this demo, this is fantastic. few things have changed in this 2 years but the basics are same. When are you going to show us the remaining two parts like integration testing and data quality testing? or if you already have those videos can you please upload them to your channel. Thanks.
@@yoshitjuh, actually there's an update to the databricks-connect package so that it now supports runtime 10.4 LTS, but databricks apparently recommends not using it and rather use dbx by databrickslab to setup a project, run all unit testing locally and supply convenient command line functions for deployment and running jobs. Still not sure about testing during pull requests and stuff like that.
