Google Cloud LaunchTemplate
CertifiedLaunch a Classic Template Dataflow job from a GCS path
Google Cloud LaunchTemplate
Launch a Classic Template Dataflow job from a GCS path
Starts a Dataflow pipeline defined as a Classic Template stored in Google Cloud Storage.
type: io.kestra.plugin.gcp.dataflow.LaunchTemplateExamples
Launch a Classic Template job.
id: dataflow_classic_template
namespace: company.team
inputs:
- id: input_path
type: STRING
tasks:
- id: launch
type: io.kestra.plugin.gcp.dataflow.LaunchTemplate
projectId: "{{ secret('GCP_PROJECT_ID') }}"
location: us-central1
jobName: my-etl-job
gcsPath: gs://my-bucket/templates/my-template
parameters:
inputFile: "{{ inputs.input_path }}"
outputTable: my-project:my_dataset.my_table
Properties
gcsPath *string
The Cloud Storage path to the Classic Template
jobName *string
The unique job name
location *string
The regional endpoint (e.g. us-central1)
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150environment object
Template runtime environment options
impersonatedServiceAccount string
The GCP service account to impersonate
parameters object
Template parameters
projectId string
The GCP project ID
scopes array
["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used
serviceAccount string
The GCP service account
Outputs
jobId string
The launched job ID
jobState string
The job state
