Serialization InferAvroSchemaFromIon

Serialization InferAvroSchemaFromIon
Certified
Infer an Avro schema from an ION file

Scans up to numberOfRowsToScan rows of an ION file and infers a compatible Avro schema, writing the result as an .avsc file in Kestra's internal storage. The output URI can be passed directly to IonToAvro or IonToParquet as a schema reference.

yaml
type: io.kestra.plugin.serdes.avro.InferAvroSchemaFromIon

Examples

Infer an Avro schema from an ION file

yaml
id: infer_avro_schema
namespace: company.team

tasks:
  - id: infer
    type: io.kestra.plugin.serdes.avro.InferAvroSchemaFromIon
    from: "{{ outputs.previous_task.uri }}"
    numberOfRowsToScan: 100

Properties

from *string

ION source file URI

Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.

numberOfRowsToScan integerstring

Default100

The number of rows that will be scanned; the larger the number of rows, the more precise the output schema will be

pluginDefaultsRef string

Reference (ref) of the pluginDefaults to apply to this task.

Outputs

uri string

Formaturi

Avro schema file URI

Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

Core

Clickhouse

Tasks that connect to ClickHouse via JDBC to run queries and loads.

Data

Serialization InferAvroSchemaFromIonCertifiedInfer an Avro schema from an ION file

Serialization InferAvroSchemaFromIon

More Plugins in this Category

Core Plugins and tasks

Clickhouse

Serialization InferAvroSchemaFromIon
Certified
Infer an Avro schema from an ION file