Blueprints

Upload a Parquet file to Databricks

Source

yaml
id: upload-parquet-to-databricks
namespace: company.team

inputs:
  - id: my_file
    type: FILE

tasks:
  - id: upload_file
    type: io.kestra.plugin.databricks.dbfs.Upload
    authentication:
      token: "{{ secret('DATABRICKS_TOKEN') }}"
    host: "{{ secret('DATABRICKS_HOST') }}"
    from: "{{ inputs.my_file }}"
    to: /Shared/myFile.parquet
See more

About this blueprint

Databricks

This flow will upload a local Parquet file to Databricks File System (DBFS).

Upload

More Related Blueprints

pip Python Databricks

Run a SQL query on Databricks, output the result to a CSV file and read that CSV file in a Python script with Pandas

Python Outputs Databricks

Download a Parquet file from Databricks and use it in a Python script

Databricks

Run a task on an on-demand Databricks cluster

New to Kestra?

Use blueprints to kickstart your first workflows.

Get started with Kestra