25 lines
1022 B
Markdown
25 lines
1022 B
Markdown
[](https://git.barrelsofdata.com/barrelsofdata/spark-boilerplate/actions?workflow=workflow.yaml)
|
|
[](https://git.barrelsofdata.com/barrelsofdata/spark-boilerplate/actions?workflow=workflow.yaml)
|
|
|
|
# Spark Boilerplate
|
|
This is a boilerplate project for Apache Spark. The related blog post can be found at [https://www.barrelsofdata.com/spark-boilerplate-using-scala](https://www.barrelsofdata.com/spark-boilerplate-using-scala)
|
|
|
|
## Build instructions
|
|
From the root of the project execute the below commands
|
|
- To clear all compiled classes, build and log directories
|
|
```shell script
|
|
./gradlew clean
|
|
```
|
|
- To run tests
|
|
```shell script
|
|
./gradlew test
|
|
```
|
|
- To build jar
|
|
```shell script
|
|
./gradlew build
|
|
```
|
|
|
|
## Run
|
|
```shell script
|
|
spark-submit --master yarn --deploy-mode cluster build/libs/spark-boilerplate-1.0.0.jar
|
|
``` |