CsvToIon
CsvToIon
Convert a CSV file into ION.
yaml
type: "io.kestra.plugin.serdes.csv.CsvToIon"Examples
Convert a CSV file to the Amazon Ion format.
yaml
id: csv_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/products.csv
- id: to_ion
type: io.kestra.plugin.serdes.csv.CsvToIon
from: "{{ outputs.http_download.uri }}"
Properties
from*Requiredstring
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.
allowExtraCharsAfterClosingQuotebooleanstring
Default
falseAllow extra characters after a closing quote
charsetstring
Default
UTF-8The name of a supported charset
fieldSeparatorstring
Default
,The field separator character
headerbooleanstring
Default
trueSpecifies if the first line should be the header
maxBufferSizeintegerstring
Default
16777216Maximum CSV parser buffer size (bytes)
maxFieldSizeintegerstring
Default
16777216Maximum field size (characters)
onBadLinesstring
Default
ERRORPossible Values
ERRORWARNSKIPHow to handle bad lines (e.g., a line with too many fields).
skipEmptyRowsbooleanstring
Default
falseSpecifies if empty rows should be skipped
skipRowsintegerstring
Default
0Number of lines to skip at the start of the file
textDelimiterstring
Default
"The text delimiter character
Outputs
uristring
Format
uriURI of a temporary result file
Metrics
recordscounter
Number of records converted
