Google Cloud LaunchTemplate

Google Cloud LaunchTemplate

Certified

Launch a Classic Template Dataflow job from a GCS path

Starts a Dataflow pipeline defined as a Classic Template stored in Google Cloud Storage.

yaml
type: io.kestra.plugin.gcp.dataflow.LaunchTemplate

Launch a Classic Template job.

yaml
id: dataflow_classic_template
namespace: company.team

inputs:
  - id: input_path
    type: STRING

tasks:
  - id: launch
    type: io.kestra.plugin.gcp.dataflow.LaunchTemplate
    projectId: "{{ secret('GCP_PROJECT_ID') }}"
    location: us-central1
    jobName: my-etl-job
    gcsPath: gs://my-bucket/templates/my-template
    parameters:
      inputFile: "{{ inputs.input_path }}"
      outputTable: my-project:my_dataset.my_table
Properties

The Cloud Storage path to the Classic Template

The unique job name

The regional endpoint (e.g. us-central1)

Template runtime environment options

The GCP service account to impersonate

Template parameters

Reference (ref) of the pluginDefaults to apply to this task.

The GCP project ID

SubTypestring
Default["https://www.googleapis.com/auth/cloud-platform"]

The GCP scopes to be used

The GCP service account

The launched job ID

The job state