Serialization InferAvroSchemaFromIon
CertifiedInfer an Avro schema from an ION file
Serialization InferAvroSchemaFromIon
Infer an Avro schema from an ION file
Scans up to numberOfRowsToScan rows of an ION file and infers a compatible Avro schema, writing the result as an .avsc file in Kestra's internal storage. The output URI can be passed directly to IonToAvro or IonToParquet as a schema reference.
type: io.kestra.plugin.serdes.avro.InferAvroSchemaFromIonExamples
Infer an Avro schema from an ION file
id: infer_avro_schema
namespace: company.team
tasks:
- id: infer
type: io.kestra.plugin.serdes.avro.InferAvroSchemaFromIon
from: "{{ outputs.previous_task.uri }}"
numberOfRowsToScan: 100
Properties
from *string
ION source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150numberOfRowsToScan integerstring
100The number of rows that will be scanned; the larger the number of rows, the more precise the output schema will be
Outputs
uri string
uriAvro schema file URI
