Serialization AvroToIon
CertifiedConvert an Avro file to the Amazon Ion format
Serialization AvroToIon
Convert an Avro file to the Amazon Ion format
Validates field types and null constraints against the embedded Avro schema during deserialization. Use onBadLines to control whether type mismatches or null violations fail the task (ERROR), log a warning (WARN), or are silently skipped (SKIP).
type: io.kestra.plugin.serdes.avro.AvroToIonExamples
Convert an Avro file to the Amazon Ion format.
id: avro_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/avro/products.avro
- id: to_ion
type: io.kestra.plugin.serdes.avro.AvroToIon
from: "{{ outputs.http_download.uri }}"
onBadLines: WARN
Properties
from *string
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150onBadLines string
ERRORERRORWARNSKIPHow to handle bad records (e.g., null values in non-nullable fields or type mismatches)
Outputs
size integer
0The number of records converted
uri string
uriURI of the output Ion file
Metrics
records counter
Number of records converted
