CreateCluster

CreateCluster
Certified
Create a Databricks cluster

yaml
type: io.kestra.plugin.databricks.cluster.CreateCluster

Examples

yaml
id: databricks_create_cluster
namespace: company.team

tasks:
  - id: create_cluster
    type: io.kestra.plugin.databricks.cluster.CreateCluster
    authentication:
      token: "{{ secret('DATABRICKS_TOKEN') }}"
    host: <your-host>
    clusterName: kestra-demo
    nodeTypeId: n2-highmem-4
    numWorkers: 1
    sparkVersion: 13.0.x-scala2.12

Properties

clusterName *string

sparkVersion *string

accountId string

authentication

Definitions

io.kestra.plugin.databricks.AbstractTask-AuthenticationConfig

authTypestring

azureClientIdstring

azureClientSecretstring

azureTenantIdstring

clientIdstring

clientSecretstring

googleCredentialsstring

googleServiceAccountstring

passwordstring

tokenstring

usernamestring

autoTerminationMinutes integerstring

configFile string

host string

maxWorkers integerstring

minWorkers integerstring

nodeTypeId string

numWorkers integerstring

pluginDefaultsRef string

Outputs

clusterId string

clusterState string

Possible Values

ERRORPENDINGRESIZINGRESTARTINGRUNNINGTERMINATEDTERMINATINGUNKNOWN

clusterURI string

Formaturi

Clickhouse

Tasks that connect to ClickHouse via JDBC to run queries and loads.

Data

Weaviate

Tasks that manage and query vectors in Weaviate.

DataAI

CreateClusterCertifiedCreate a Databricks cluster

More Plugins in this Category

Clickhouse

Weaviate

CreateCluster
Certified
Create a Databricks cluster