When contributing to this repository, please check the issues first, and post a new one if relevant.
-
Clone the forked repository (change the URL of the
git clone
for yours)
git clone https://github.com/vemonet/setup-spark.git
cd setup-spark
- Create a new branch from the
main
branch, and go to this branch 🕊️
git checkout -b my-branch
Checkout the only important file! The mighty src/setup-spark.ts
✨. The Spark installation has been inspired by the jupyter/docker-stack pyspark Dockerfile
- Install dependencies:
npm install
- Build the
dist/index.js
file with vercel/ncc:
npm run build
- Commit and push the generated
dist/index.js
file with the rest of the modified files
We use the test.yml
GitHub Actions workflow in .github/workflows
to test setting up Spark versions. If you are making a substantive change try to link to a successful run that utilizes the changes you are working on.
Install act
to test running the action locally:
act -j test-setup-spark-scala
# Build and run act:
npm run dev
Format the code with prettier:
npm run fmt
Run eslint checks:
npm run test
Third party dependencies licenses are checked automatically by a GitHub Action workflow using Licensed.
Update dependencies to latest version:
npm update
Check for vulnerabilities:
npm audit
Fix dependencies with vulnerabilities:
npm audit fix --force
Commit, push and check if the GitHub action tests are passing.
-
Update version in
package.json
-
Create a new release on GitHub for this new tag
-
Then update the
v1
tag to the latest commit (v1
should always be sync to the latest version)npm run release