Skip to main content

⏳ Estimated read time: 1 min read

Apache Spark

Metrics

For a bitnami helm chart based spark deployment add the following snippet to the values.yaml file of the spark deployment:

metrics:

  enabled: true
  masterAnnotations:
    prometheus.io/scrape: 'true'
    prometheus.io/path: '/metrics/'
    prometheus.io/port: '{{ .Values.master.containerPorts.http }}'
  workerAnnotations:
    prometheus.io/scrape: 'true'
    prometheus.io/path: '/metrics/'
    prometheus.io/port: '{{ .Values.worker.containerPorts.http }}'

Metrics