Serialization JsonToIon
CertifiedConvert a JSON file to the Amazon ION format
Serialization JsonToIon
Convert a JSON file to the Amazon ION format
Converts a JSON file to Amazon ION, Kestra's internal binary format used for passing data between tasks.
Two input formats are supported: one JSON object per line (JSONL), or a JSON array. Examples of each:
{"id": 1, "name": "Widget A", "category": "Electronics"}
{"id": 2, "name": "Widget B", "category": "Household"}
{"id": 3, "name": "Widget C", "category": "Furniture"}
[
{"id": 1, "name": "Widget A", "category": "Electronics"},
{"id": 2, "name": "Widget B", "category": "Household"},
{"id": 3, "name": "Widget C", "category": "Furniture"}
]
type: io.kestra.plugin.serdes.json.JsonToIonExamples
Convert a JSON file to the Amazon ION format.
id: json_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/json/products.json
- id: to_ion
type: io.kestra.plugin.serdes.json.JsonToIon
from: "{{ outputs.http_download.uri }}"
Properties
from *Requiredstring
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
charset string
UTF-8The name of a supported charset
Default value is UTF-8.
newLine booleanstring
trueWhether the file is newline-delimited JSON (JSONL)
Whether the file uses newline-delimited JSON. Warning: if not, the whole file will be loaded into memory and can lead to out-of-memory errors.
pluginDefaultsRef Non-dynamicstring
Reference (ref) of the pluginDefaults to apply to this task.
Outputs
size integer
0The number of records converted
uri string
uriURI of a temporary result file
Metrics
records counter
Number of records converted
