Create | Kestra

Create

Create a Dataproc cluster

yaml
type: io.kestra.plugin.gcp.dataproc.clusters.Create

Examples

yaml
id: gcp_dataproc_cluster_create
namespace: company.team

tasks:
  - id: cluster_create
    type: io.kestra.plugin.gcp.dataproc.clusters.Create
    clusterName: YOUR_CLUSTER_NAME
    region: YOUR_REGION
    zone: YOUR_ZONE
    masterMachineType: n1-standard-2
    workerMachineType: n1-standard-2
    workers: 2
    bucket: YOUR_BUCKET_NAME

yaml
id: gcp_dataproc_cluster_create
namespace: company.team

tasks:
  - id: create_cluster_with_certain_disk_size
    type: io.kestra.plugin.gcp.dataproc.clusters.Create
    clusterName: YOUR_CLUSTER_NAME
    region: YOUR_REGION
    zone: YOUR_ZONE
    masterMachineType: n1-standard-2
    masterDiskSizeGB: 500
    workerMachineType: n1-standard-2
    workerDiskSizeGB: 200
    workers: 2
    bucket: YOUR_BUCKET_NAM

Properties

clusterName *string

Min length1

region *string

Min length1

bucket string

imageVersion string

impersonatedServiceAccount string

masterDiskSizeGB integerstring

masterMachineType string

projectId string

scopes array

SubTypestring

Default["https://www.googleapis.com/auth/cloud-platform"]

serviceAccount string

workerDiskSizeGB integerstring

workerMachineType string

workers integerstring

zone string

Outputs

clusterName string

created boolean

Defaultfalse

Plugin Weaviate for Kestra

Connect and query Apache Pinot databases using Kestra's JDBC plugin.

Plugin DataHub for Kestra

Create Create a Dataproc cluster

More Plugins in this Category

Create

Create a Dataproc cluster