Google Cloud

CLI

Execute any Google Cloud CLI command directly from your workflows. Automate GCP operations using the full power of the gcloud CLI.

DataForm

Automate data transformation workflows with DataForm. Execute SQL-based ELT pipelines with built-in lineage and testing.

Dataproc Clusters

Create and manage Dataproc clusters for distributed data processing. Orchestrate complex analytics workloads at scale.

BigQuery

Build high-performance data pipelines with BigQuery. Query, transform, and load data at scale without infrastructure management.

Kubernetes Engine (GKE)

Deploy and manage containerized applications on GKE. Orchestrate Kubernetes workloads alongside your data pipelines.

Vertex AI

Integrate machine learning models into your workflows. Train, deploy, and invoke ML models with Vertex AI.

Dataproc Batches

Run Spark and Hadoop jobs on-demand without managing clusters. Process large-scale data with Dataproc Batches.

Google Cloud Function

Trigger serverless functions and orchestrate event-driven computing. Execute code without provisioning or managing servers.

Firestore

Access and manage Firestore databases directly from your workflows. Store and retrieve structured data with serverless simplicity.

Pub/Sub

Process real-time data streams with Google Cloud Pub/Sub. Build event-driven workflows that respond instantly to your data.

Cloud Monitoring (Observability)

Integrate Google Cloud Monitoring metrics and logs into your workflows. Build monitoring and alerting directly into your orchestration.

Cloud Storage (GCS)

Store, manage, and access files in Google Cloud Storage. Move data reliably between systems with simple file operations.

Authentication

This sub-group of plugins contains tasks to manage authentication for Google Cloud.

How to use this plugin

Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

CoreStorageScript

PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Database

SurrealDB

Tasks that run SurrealQL queries against SurrealDB.