Serialization ParquetToIon

Serialization ParquetToIon
Certified
Convert a Parquet file to the Amazon ION format

Reads a Parquet file from Kestra internal storage and writes the rows as an Amazon ION file.

yaml
type: io.kestra.plugin.serdes.parquet.ParquetToIon

Examples

Convert a parquet file to the Amazon ION format.

yaml
id: parquet_to_ion
namespace: company.team

tasks:
  - id: http_download
    type: io.kestra.plugin.core.http.Download
    uri: https://huggingface.co/datasets/kestra/datasets/raw/main/parquet/products.parquet

  - id: to_ion
    type: io.kestra.plugin.serdes.parquet.ParquetToIon
    from: "{{ outputs.http_download.uri }}"

Properties

from *string

Source file URI

Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}.

pluginDefaultsRef string

Reference (ref) of the pluginDefaults to apply to this task.

Outputs

size integer

Default0

The number of records converted

uri string

Formaturi

URI of a temporary result file

Metrics

records counter

Number of records converted

Core Plugins and tasks

Tasks that provide Kestra's built-in orchestration, I/O, and observability capabilities.

Core

Liquibase

Tasks that run Liquibase change management commands.

Data

Serialization ParquetToIonCertifiedConvert a Parquet file to the Amazon ION format

Serialization ParquetToIon

More Plugins in this Category

Core Plugins and tasks

Liquibase

Serialization ParquetToIon
Certified
Convert a Parquet file to the Amazon ION format