Dataproc Batches

Dataproc Batches

Certified

Run Spark and Hadoop jobs on-demand without managing clusters. Process large-scale data with Dataproc Batches.

tasks

PySparkSubmit
io.kestra.plugin.gcp.dataproc.batches.PySparkSubmit
RSparkSubmit
io.kestra.plugin.gcp.dataproc.batches.RSparkSubmit
SparkSqlSubmit
io.kestra.plugin.gcp.dataproc.batches.SparkSqlSubmit
SparkSubmit
io.kestra.plugin.gcp.dataproc.batches.SparkSubmit

How to use this plugin

See it in action

More Plugins in this Category

MongoDB
MongoDB

Tasks that query and manipulate MongoDB collections.

Data

8 tasks

3 blueprints

Transform
Transform

Transform typed records, variables, and Ion data.

CoreData

6 tasks