Demo app for Spark 3.1.1 to demonstrate the new method observe
in the dataset API (since Spark 3.0)
- Compile with
mvn clean package
- Run in Batch-mode:
spark-submit target/spark-observe-0.1.0-SNAPSHOT.jar
- Run in Streaming-mode:
spark-submit --class com.github.kevinwallimann.SparkObserveStreaming target/spark-observe-0.1.0-SNAPSHOT.jar