karthik
070a7c7c1b
Tests / reset-status (push) Successful in 2s
Details
Tests / tests (push) Successful in 4m50s
Details
Tests / build (push) Successful in 3m42s
Details
|
||
---|---|---|
.gitea/workflows | ||
gradle | ||
src | ||
.gitignore | ||
README.md | ||
build.gradle.kts | ||
gradle.properties | ||
gradlew | ||
gradlew.bat | ||
settings.gradle.kts |
README.md
Spark Boilerplate
This is a boilerplate project for Apache Spark. The related blog post can be found at https://www.barrelsofdata.com/spark-boilerplate-using-scala
Build instructions
From the root of the project execute the below commands
- To clear all compiled classes, build and log directories
./gradlew clean
- To run tests
./gradlew test
- To build jar
./gradlew build
Run
spark-submit --master yarn --deploy-mode cluster build/libs/spark-boilerplate-1.0.0.jar