SparkSubmit icon
SlackIncomingWebhook icon
gcp icon
Schedule icon

Run a Spark Batch on Dataproc Serverless

Schedule and orchestrate Spark jobs on Google Cloud Dataproc Serverless with Kestra. No cluster to manage, automatic retries, and Slack alerts on every run.

Categories
CloudData

More Cloud Blueprints

Extract a CSV file via HTTP API and upload it to S3 by using scheduled
Download icon
ArchiveDecompress icon
Upload icon
Schedule icon
CloudCore
High-Performance Computing, Run Parallel Python Workloads on AWS Batch with ECS Fargate
WorkingDirectory icon
Clone icon
TerraformCLI icon
Script icon
Docker icon
Parallel icon
+2
CloudCoreInfrastructure
Publish Application and System Events to AWS EventBridge for Event-Driven Architectures
PutEvents icon
Download icon
JsonToIon icon
Cloud

More Data Blueprints

Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
Build an ETL Pipeline with Airbyte Cloud and dbt Core for SaaS Analytics
Parallel icon
Sync icon
WorkingDirectory icon
Clone icon
Build icon
Docker icon
Data
AI-Powered Inventory Demand Forecasting, Auto-Generate Purchase Orders with OpenAI
Parallel icon
Request icon
ChatCompletion icon
Script icon
If icon
ForEach icon
+3
AIBusinessData
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started