Google Cloud LaunchFlexTemplate
CertifiedLaunch a Flex Template Dataflow job
Google Cloud LaunchFlexTemplate
Certified
Launch a Flex Template Dataflow job
Starts a Dataflow pipeline defined as a Flex Template packaged in a Docker container image.
yaml
type: io.kestra.plugin.gcp.dataflow.LaunchFlexTemplateExamples
Launch a Flex Template job.
yaml
id: dataflow_flex_template
namespace: company.team
tasks:
- id: launch
type: io.kestra.plugin.gcp.dataflow.LaunchFlexTemplate
projectId: "{{ secret('GCP_PROJECT_ID') }}"
location: us-central1
jobName: my-flex-job
containerSpecGcsPath: gs://my-bucket/flex-templates/spec.json
parameters:
inputSubscription: projects/my-project/subscriptions/my-sub
outputTable: my-project:my_dataset.my_table
environment:
maxWorkers: 10
Properties
containerSpecGcsPath *Requiredstring
The Cloud Storage path to the Flex Template container spec JSON file
jobName *Requiredstring
The unique job name
location *Requiredstring
The regional endpoint (e.g. us-central1)
environment object
Template runtime environment options
impersonatedServiceAccount string
The GCP service account to impersonate
parameters object
Template parameters
pluginDefaultsRef Non-dynamicstring
Reference (ref) of the pluginDefaults to apply to this task.
projectId string
The GCP project ID
scopes array
SubTypestring
Default
["https://www.googleapis.com/auth/cloud-platform"]The GCP scopes to be used
serviceAccount string
The GCP service account
Outputs
jobId string
The launched job ID
jobState string
The job state
