WorkingDirectory icon
Clone icon
SparkCLI icon

Clone a Git repository with PySpark code and run a Spark job using the

Clone a Git repository and run a PySpark job using Spark Submit with Kestra. Automate distributed Python workloads as part of data engineering pipelines.

Categories
Data

More Data Blueprints
AI-Powered Inventory Demand Forecasting — Auto-Generate Purchase Orders with OpenAI
Parallel icon
Request icon
ChatCompletion icon
Script icon
If icon
ForEach icon
+3
AIBusinessData
Sync Postgres records to Algolia index
Trigger icon
ForEach icon
Index icon
Query icon
postgresql icon
BusinessData
Extract data, transform it, and load it in parallel to S3 and Postgres — in less than 7 seconds!
Download icon
JsonToIon icon
IonToJson icon
FileTransform icon
Parallel icon
Sequential icon
+4
Data
See How

New to Kestra?

Use blueprints to kickstart your first workflows.

Get Started