Azure CreateDataAsset

Azure CreateDataAsset

Certified

Register a data asset version in Azure Machine Learning

Creates a new version of a data asset (URI_FILE, URI_FOLDER or MLTABLE) pointing to an existing datastore path. Data asset versions are immutable: set dataVersion explicitly to control it, or leave it empty to auto-increment from the asset's latest version.

yaml
type: io.kestra.plugin.azure.ml.CreateDataAsset
yaml
id: azure_ml_create_data_asset
namespace: company.team

tasks:
  - id: register_dataset
    type: io.kestra.plugin.azure.ml.CreateDataAsset
    tenantId: "{{ secret('AZURE_TENANT_ID') }}"
    clientId: "{{ secret('AZURE_CLIENT_ID') }}"
    clientSecret: "{{ secret('AZURE_CLIENT_SECRET') }}"
    subscriptionId: "{{ secret('AZURE_SUBSCRIPTION_ID') }}"
    resourceGroupName: ml-rg
    workspaceName: ml-workspace
    dataName: training-dataset
    dataAssetType: URI_FOLDER
    uri: "azureml://datastores/workspaceblobstore/paths/data/training"
Properties
Possible Values
URI_FILEURI_FOLDERMLTABLE

Data asset type

Kind of data referenced by uri

Data asset name

Resource group name

Resource group containing the Machine Learning workspace

Subscription ID

Azure subscription GUID that owns the Machine Learning workspace

Azure AD tenant ID (GUID)

Data URI

Storage URI for the data, e.g. azureml://datastores/<name>/paths/<path>

Workspace name

Name of the Azure Machine Learning workspace

Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.

Definitions
assetFailureBehaviorstring
Possible Values
IGNOREFAILWARN

Asset failure behavior

Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.

enableAutobooleanstring

Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.

inputsarray

The assets consumed as inputs.

id*string
Min length1
typestring
outputs

The assets produced as outputs.

id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*object
descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150
id*string
Min length1
Max length150
type*string
Min length1

Custom asset type

descriptionstring
displayNamestring
metadataobject
Default{}
namespacestring
Min length1
Max length150

Client ID of the Azure AD application

Application (client) ID used for service principal authentication.

Client secret for the Azure AD application

Secret value associated with the client ID; store in a Kestra secret.

Description

Free-text description stored with the data asset version

Data asset version

Explicit version to register; when not set, the next version is computed automatically from the asset's current latest version

PEM-encoded certificate content for client authentication

PEM text for certificate-based auth; alternative to clientSecret.

Data asset name

Formaturi

Data URI

Storage URI backing this data asset version

Data asset version

Version registered, either the explicit version or the auto-incremented one