JsonToIon
Convert a JSON file into ION.
JsonToIon
Convert a JSON file into ION.
Convert a JSON file into ION.
We support one JSON dictionary/map per line as well as a JSON file in array format.
Here is how a sample JSON file content might look like:
text
{"product_id": "1","product_name": "streamline turn-key systems","product_category": "Electronics","brand": "gomez"},
{"product_id": "2","product_name": "morph viral applications","product_category": "Household","brand": "wolfe"},
{"product_id": "3","product_name": "expedite front-end schemas","product_category": "Household","brand": "davis-martinez"}
Here is how a sample JSON file in array format might look:
text
[
{"product_id": "1","product_name": "streamline turn-key systems","product_category": "Electronics","brand": "gomez"},
{"product_id": "2","product_name": "morph viral applications","product_category": "Household","brand": "wolfe"},
{"product_id": "3","product_name": "expedite front-end schemas","product_category": "Household","brand": "davis-martinez"}
]
yaml
type: "io.kestra.plugin.serdes.json.JsonToIon"Examples
Convert a JSON file to the Amazon Ion format.
yaml
id: json_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/json/products.json
- id: to_ion
type: io.kestra.plugin.serdes.json.JsonToIon
from: "{{ outputs.http_download.uri }}"
Properties
from*Requiredstring
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
charsetstring
Default
UTF-8The name of a supported charset
Default value is UTF-8.
newLinebooleanstring
Default
trueWhether the file is newline-delimited JSON (JSONL)
Whether the file uses newline-delimited JSON. Warning: if not, the whole file will be loaded into memory and can lead to out-of-memory errors.
Outputs
uristring
Format
uriURI of a temporary result file
Metrics
recordscounter
Number of records converted
