Apache SparkApache Spark
Apache SparkCertified

Tasks that submit Apache Spark jobs and run Spark CLI commands.

Provide the Spark master/cluster config, application artifact (JAR, Python file, or R script), main class or entry point, and args to launch jobs with optional driver/executor settings; SparkCLI lets you run ad-hoc spark-submit commands and capture logs for orchestration.

tasks

JarSubmit

Submit a Spark job to a remote cluster using a JAR file.

io.kestra.plugin.spark.JarSubmit
PythonSubmit

Submit a PySpark job to a remote cluster.

io.kestra.plugin.spark.PythonSubmit
RSubmit

Submit an R job to a remote cluster.

io.kestra.plugin.spark.RSubmit
SparkCLI

Execute Spark CLI commands.

io.kestra.plugin.spark.SparkCLI

Create automations with Spark Plugins

Clone a Git repository with PySpark code and run a Spark job using the Spark Submit CLI
Data

More Plugins in this Category

Azure
Azure

Leverage Microsoft Azure services within Kestra data workflows.

CloudMessagingStorageBatchTool

37 Tasks

2 Blueprints

Google Cloud (EE)
Google Cloud
Enterprise

Integrate Google Cloud Platform services with Kestra data workflows.

StorageCloudAlertingBatch

4 Tasks

Apache Flink
Apache Flink

Tasks that submit, monitor, cancel, and trigger savepoints for Apache Flink jobs over the REST API.

TransformationBatch

5 Tasks

OVERVIEW
Versions
1.1.1
Latest
January 1, 2026 Release Notes Min. Compatible Kestra Version: 1.0.0
Previous Versions
1.1.0November 3, 2025 Min. Compatible Kestra Version: 1.0.0
1.0.0September 8, 2025 Min. Compatible Kestra Version: [1.0,)
0.24.0August 5, 2025 Min. Compatible Kestra Version: [0.24,)
0.24.0-rc1-SNAPSHOTJuly 31, 2025 Min. Compatible Kestra Version: [0.24,)
0.24.0-rc0-SNAPSHOTJuly 29, 2025 Min. Compatible Kestra Version: [0.23,)
0.23.0June 17, 2025 Min. Compatible Kestra Version: [0.23,0.24)
0.23.0-rc5-SNAPSHOTJune 16, 2025 Min. Compatible Kestra Version: [0.23,0.24)
0.23.0-rc4-SNAPSHOTJune 12, 2025 Min. Compatible Kestra Version: [0.23,0.24)
0.23.0-rc3-SNAPSHOTJune 10, 2025 Min. Compatible Kestra Version: [0.23,0.24)
0.23.0-rc2-SNAPSHOTJune 9, 2025 Min. Compatible Kestra Version: [0.20,)
0.23.0-rc1-SNAPSHOTJune 4, 2025 Min. Compatible Kestra Version: [0.20,)
0.23.0-rc0-SNAPSHOTJune 3, 2025 Min. Compatible Kestra Version: [0.20,)
0.22.0April 1, 2025 Min. Compatible Kestra Version: [0.20,)
0.22.0-rc4-SNAPSHOTMarch 31, 2025 Min. Compatible Kestra Version: [0.20,)
0.22.0-rc2-SNAPSHOTMarch 28, 2025 Min. Compatible Kestra Version: [0.20,)
0.22.0-rc1-SNAPSHOTMarch 25, 2025 Min. Compatible Kestra Version: [0.20,)
0.21.1February 25, 2025 Min. Compatible Kestra Version: [0.20,)
0.21.0February 4, 2025 Min. Compatible Kestra Version: [0.20,)
0.21.0-rc2-SNAPSHOTFebruary 3, 2025 Min. Compatible Kestra Version: [0.20,)
0.21.0-rc1-SNAPSHOTJanuary 31, 2025 Min. Compatible Kestra Version: [0.20,)
0.21.0-rc0-SNAPSHOTJanuary 29, 2025 Min. Compatible Kestra Version: [0.20,)
0.20.0December 3, 2024 Min. Compatible Kestra Version: [0.20,)
0.19.0October 1, 2024 Min. Compatible Kestra Version: [0.18,)
0.18.2August 8, 2024 Min. Compatible Kestra Version: [0.18,)
0.18.0August 7, 2024 Min. Compatible Kestra Version: [0.18,)
0.17.0June 4, 2024 Min. Compatible Kestra Version: [0.17,)
0.16.1April 30, 2024 Min. Compatible Kestra Version: [0.16,)
0.16.0April 11, 2024 Min. Compatible Kestra Version: [0.16,)
0.15.0February 29, 2024 Min. Compatible Kestra Version: [0.15,)

Created by

Kestra Core Team

Managed by

Kestra Core Team
Plugin Type
Batch
Links & Resources
GitHub