/integrations/sparkProcessing
Spark with Convalesce
A listener that tells Convalesce about every application, job and SQL query as it runs, in Spark's own words. It reads none of your data and changes nothing about how a job runs.
spark.jars.packages io.convalesce:convalesce-emit-spark:0.2.1spark.extraListeners io.convalesce.emit.spark.ConvalesceSparkListenerCONVALESCE_INGEST_KEY=<your key>● first run reports itselfWhat it reads
- Applications, jobs and stages
- SQL queries
- Failures, including PySpark driver failures
It reads none of your data and changes nothing about how a job runs.
How it connects
- 1Install the plugin where it runs
- 2Set your ingest key on every worker
- 3Run something and watch the first event arrive
Each release is listed in the changelog.
