Create
Create a Google Cloud Dataproc cluster.
Create
Create a Google Cloud Dataproc cluster.
Create a Google Cloud Dataproc cluster.
yaml
type: "io.kestra.plugin.gcp.dataproc.clusters.Create"Examples
Creates a cluster in Google Cloud Dataproc.
yaml
id: gcp_dataproc_cluster_create
namespace: company.team
tasks:
- id: cluster_create
type: io.kestra.plugin.gcp.dataproc.clusters.Create
clusterName: YOUR_CLUSTER_NAME
region: YOUR_REGION
zone: YOUR_ZONE
masterMachineType: n1-standard-2
workerMachineType: n1-standard-2
workers: 2
bucket: YOUR_BUCKET_NAME
Creates a cluster in Google Cloud Dataproc with specific disk size.
yaml
id: gcp_dataproc_cluster_create
namespace: company.team
tasks:
- id: create_cluster_with_certain_disk_size
type: io.kestra.plugin.gcp.dataproc.clusters.Create
clusterName: YOUR_CLUSTER_NAME
region: YOUR_REGION
zone: YOUR_ZONE
masterMachineType: n1-standard-2
masterDiskSizeGB: 500
workerMachineType: n1-standard-2
workerDiskSizeGB: 200
workers: 2
bucket: YOUR_BUCKET_NAM
Properties
clusterName*Requiredstring
Min length
1region*Requiredstring
Min length
1The region.
bucketstring
The GCS bucket name.
imageVersionstring
The Dataproc image URI.
The Compute Engine image resource used for cluster instances.
impersonatedServiceAccountstring
The GCP service account to impersonate.
masterDiskSizeGBintegerstring
The disk size in GB for each master node.
masterMachineTypestring
The master machine type.
projectIdstring
The GCP project ID.
scopesarray
SubTypestring
Default
["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used.
serviceAccountstring
The GCP service account.
workerDiskSizeGBintegerstring
The disk size in GB for each worker node.
workerMachineTypestring
The worker machine type.
workersintegerstring
The number of workers.
zonestring
The zone.
Outputs
clusterNamestring
The cluster name.
createdboolean
Default
falseWhether cluster was created successfully.
