CreateRun

type: "io.kestra.plugin.azure.datafactory.CreateRun"

Create a Pipeline run from an Azure Data Factory.

Launch an Azure DataFactory pipeline from Kestra. Data Factory contains a series of interconnected systems that provide a complete end-to-end platform for data engineers.

Examples

id: azure_datafactory_create_run
namespace: company.team

tasks:
  - id: create_run
    type: io.kestra.plugin.azure.datafactory.CreateRun
    factoryName: exampleFactoryName
    pipelineName: examplePipeline
    resourceGroupName: exampleResourceGroup
    subscriptionId: 12345678-1234-1234-1234-12345678abc
    tenantId: "{{ secret('DATAFACTORY_TENANT_ID') }}"
    clientId: "{{ secret('DATAFACTORY_CLIENT_ID') }}"
    clientSecret: "{{ secret('DATAFACTORY_CLIENT_SECRET') }}"

Properties

subscriptionId

• Type: string
• Dynamic: ✔️
• Required: ✔️

Subscription ID

tenantId

• Type: string
• Dynamic: ✔️
• Required: ✔️
• Default: ``

Tenant ID

clientId

• Type: string
• Dynamic: ✔️
• Required: ❌
• Default: ``

Client ID

Client ID of the Azure service principal. If you don't have a service principal, refer to create a service principal with Azure CLI.

clientSecret

• Type: string
• Dynamic: ✔️
• Required: ❌
• Default: ``

Client Secret

Service principal client secret. The tenantId, clientId and clientSecret of the service principal are required for this credential to acquire an access token.

factoryName

• Type: string
• Dynamic: ✔️
• Required: ❌

Factory name

parameters

• Type: object
• Dynamic: ✔️
• Required: ❌
• Default: {}

Pipeline parameters.

pemCertificate

• Type: string
• Dynamic: ✔️
• Required: ❌
• Default: ``

PEM Certificate

Your stored PEM certificate.

The tenantId, clientId and clientCertificate of the service principal are required for this credential to acquire an access token.

pipelineName

• Type: string
• Dynamic: ✔️
• Required: ❌

Pipeline name

resourceGroupName

• Type: string
• Dynamic: ✔️
• Required: ❌

Resource Group name

wait

• Type:
  • boolean
  • string
• Dynamic: ✔️
• Required: ❌

Outputs

runId

• Type: string
• Required: ❌

Run ID

The ID of the pipeline run created in Azure Data Factory

uri

• Type: string
• Required: ❌
• Format: uri

URI of a kestra internal storage file containing the activities and their inputs/outputs.