Serialization
Certified
Tasks that convert data (SerDes) between common formats for Kestra workflows.

Use format-specific tasks to transform files among JSON, CSV, Avro, Parquet, Excel, Protobuf, XML, Markdown, and YAML (via ION), with options for schema validation, bad-line handling, and output destinations.

XML

Tasks that convert between XML and ION.

CSV

Tasks that convert between CSV and ION.

Excel

Tasks that convert between Excel and ION.

YAML

Tasks that convert between YAML and ION/JSON.

Avro

Tasks that convert to/from Apache Avro and validate schemas.

Markdown

Tasks that convert Markdown to text or HTML.

Parquet

Tasks that convert between Parquet and ION.

JSON

Tasks that convert JSON and JSONL to/from ION.

Protobuf

Tasks that convert Protocol Buffers messages to/from ION.

How to use the Serdes plugin

Convert files between data formats — CSV, JSON, Avro, Parquet, Excel, XML, YAML, Protobuf, and Markdown — from Kestra flows.

Tasks

All tasks require from (a kestra:// URI pointing to the source file) and return uri (the converted file in Kestra's internal storage), except where noted.

CSV

csv.CsvToIon converts a CSV file to ION — set from. Control parsing with header (default true), fieldSeparator (default ,), textDelimiter (default "), skipEmptyRows (default false), skipRows (default 0), charset (default UTF-8), and onBadLines (default ERROR; also WARN or SKIP).

csv.IonToCsv converts an ION file to CSV — set from. Control output with header (default true), fieldSeparator (default ,), textDelimiter (default "), lineDelimiter (default \n), quoteMode (ALWAYS, REQUIRED, or NON_NUMERIC), and charset (default UTF-8). Inherits date/time formatting from the base writer.

JSON

json.JsonToIon converts a JSON or JSONL file to ION — set from. Set newLine: true (default) for JSONL input.

json.IonToJson converts an ION file to JSON — set from. Set newLine: true (default) to produce JSONL. Set shouldKeepAnnotations: false (default) to strip ION annotations.

json.JsonToJsonl converts a JSON array file to JSONL — set from.

json.JsonToYaml converts JSON to YAML — set from. Set jsonl: true if the input is JSONL (default false).

Avro

avro.AvroToIon converts an Avro file to ION — set from. Set onBadLines to control error handling (default ERROR).

avro.IonToAvro converts an ION file to Avro — set from. Optionally provide schema (Avro schema JSON). Configure type coercion with trueValues, falseValues, nullValues, decimalSeparator (default .), strictSchema (default false), and inferAllFields (default false).

avro.InferAvroSchemaFromIon infers an Avro schema from an ION file — set from. Control inference with numberOfRowsToScan (default 100).

Parquet

parquet.ParquetToIon converts a Parquet file to ION — set from.

parquet.IonToParquet converts an ION file to Parquet — set from. Control output with compressionCodec (default GZIP; also UNCOMPRESSED, SNAPPY, ZSTD), parquetVersion (default V2), rowGroupSize, pageSize, and dictionaryPageSize. Inherits Avro type coercion options.

Excel

excel.ExcelToIon converts an Excel file to ION — set from. Optionally filter by sheetsTitle (list of sheet names to include). Control rendering with valueRender (default UNFORMATTED_VALUE) and dateTimeRender (default UNFORMATTED_VALUE). Set header (default true) and skipEmptyRows (default false). The output includes uris (map of sheet name → ION file URI) and size.

excel.IonToExcel converts an ION file to Excel — set from. Set sheetsTitle (default Sheet), header (default true), and styles (default true). The output includes uri and size.