Integrate sparkMeasure for Enhanced Performance Monitoring
- sudo access
- golang 1.23.4+ (set path:
export PATH=$(go env GOPATH)/bin:/usr/local/go/bin:$PATH
) - docker 26.1.3+
It will install a local Kubernetes cluster running:
- argocd
- prometheus
- spark-operator
- a spark job using spark-measure
git clone https://github.com/k8s-school/demo-sparkmeasure.git
cd demo-sparkmeasure
# Install and run everything from scratch
run-all.sh
# Access the spark pods
kubectl get pods -n spark