Serialization AvroToIon

Serialization AvroToIon

Certified

Convert an Avro file to the Amazon Ion format

Validates field types and null constraints against the embedded Avro schema during deserialization. Use onBadLines to control whether type mismatches or null violations fail the task (ERROR), log a warning (WARN), or are silently skipped (SKIP).

yaml
type: io.kestra.plugin.serdes.avro.AvroToIon

Convert an Avro file to the Amazon Ion format.

yaml
id: avro_to_ion
namespace: company.team
tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/avro/products.avro
  - id: to_ion
    type: io.kestra.plugin.serdes.avro.AvroToIon
    from: "{{ outputs.http_download.uri }}"
    onBadLines: WARN
Properties

Source file URI

DefaultERROR
Possible Values
ERRORWARNSKIP

How to handle bad records (e.g., null values in non-nullable fields or type mismatches)

Reference (ref) of the pluginDefaults to apply to this task.

Default0

The number of records converted

Formaturi

URI of the output Ion file

Number of records converted

More Plugins in this Category

Core Plugins and tasks
Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

Core

122 tasks

398 blueprints

Liquibase
Liquibase

Tasks that run Liquibase change management commands.

Data

2 tasks