ESC
All(0)
emoticon icon

No results found for the current search

  1. ⚡️ Kestra 0.21 adds no-code flows, custom dashboards & log shippers Learn More

Item 1 of 1
Kestra, Open source declarative data orchestration
  • Product

    • Open Source
      Explore Kestra's Core Capabilities

    • Enterprise Edition
      Security and Governance for Enterprise Needs

    • Cloud EditionPrivate Alpha
      Register for the Cloud Edition

    • Platform Overview
      Powerful capabilities from the UI

    • Start orchestrating your first workflows.

      Quickstart Guide

      • Workflow components
        Get to know the main orchestration components of a Kestra workflow

      • Videos tutorials
        Get started with our video tutorials

  • Solutions

      Features

    • Declarative Orchestration
      Infrastructure as Code for All Your Workflows

    • Automation Platform
      Scheduling and Automation Made Easy

    • Language Agnostic
      Separate your Business Logic from Orchestration Logic

    • Kestra's Terraform Provider
      Deploy and manage all Kestra resources with Terraform

    • API-First
      Learn more about Kestra’s API features

      Use Cases

    • For Data Engineers
      Orchestrate your Data Pipelines, Automate Processes, and Harness the Power of Your Data

    • For Software Engineers
      Boost Productivity, Simplify Processes, and Accelerate Microservice Deployment

    • For Platform Engineers
      Automate, Scale, Provision and Optimize Your Infrastructure

      Industries

    • For Retail
      Empower retail businesses with an event-driven, language-agnostic orchestration platform that scales

    • For Healthcare
      Streamline data processing, accelerate research, and enhance collaboration in healthcare

    • For Automotive
      Ensure seamless operations and optimized performance across all processes.

    • Explore blueprints

      Explore blueprints
      to kick-start
      your next flow.

      Explore
  • Resources

      RESOURCES

    • Blog
      Company news, product updates, and engineering deep dives

    • Video Tutorials
      Get started with our video tutorials

    • FAQ
      FAQ about the product and the company

      DISCOVER

    • Community Overview
      Ask any questions and share your feedback

    • Partners
      Use our partner ecosystem to accelerate your Kestra adoption

    • About Us
      Discover the team and values behind Kestra

    • Platform Overview

      Gorgias, Using Declarative
      Data Engineering
      Orchestration With Kestra

      Explore

      • Customer Stories
        Learn how Enterprises orchestrate their business-critical workflows

  • Docs
  • Plugins
  • Blueprints
  • Pricing
  • Star
    Talk to us Get Started Talk to Us

Product

  • Open Source
    Explore Kestra's Core Capabilities

  • Enterprise Edition
    Security and Governance for Enterprise Needs

  • Cloud EditionPrivate Alpha
    Register for the Cloud Edition

  • Platform Overview
    Powerful capabilities from the UI

Start
orchestrating your
first workflows.

Quickstart Guide

  • Workflow components
    Get to know the main orchestration components of a Kestra workflow

  • Videos tutorials
    Get started with our video tutorials

Features

  • Declarative Orchestration
    Infrastructure as Code for All Your Workflows

  • Automation Platform
    Scheduling and Automation Made Easy

  • Language Agnostic
    Separate your Business Logic from Orchestration Logic

  • Kestra's Terraform Provider
    Deploy and manage all Kestra resources with Terraform

  • API-First
    Learn more about Kestra’s API features

Use Cases

  • For Data Engineers
    Orchestrate your Data Pipelines, Automate Processes, and Harness the Power of Your Data

  • For Software Engineers
    Boost Productivity, Simplify Processes, and Accelerate Microservice Deployment

  • For Platform Engineers
    Automate, Scale, Provision and Optimize Your Infrastructure

Industries

  • For Retail
    Empower retail businesses with an event-driven, language-agnostic orchestration platform that scales

  • For Healthcare
    Streamline data processing, accelerate research, and enhance collaboration in healthcare

  • For Automotive
    Ensure seamless operations and optimized performance across all processes.

Explore blueprints

Explore blueprints to kick-start
your next flow.

Explore

RESOURCES

  • Blog
    Company news, product updates, and engineering deep dives

  • Video Tutorials
    Get started with our video tutorials

  • FAQ
    FAQ about the product and the company

DISCOVER

  • Community Overview
    Ask any questions and share your feedback

  • Partner
    Use our partner ecosystem to accelerate your Kestra adoption

  • About Us
    Discover the team and values behind Kestra

Platform Overview

Gorgias,
Using Declarative Data Engineering Orchestration
With Kestra

20 000+

executions per month

  • Customer Stories
    Learn how Enterprises orchestrate their business-critical workflows

Search

Ctrl + K
  • Core
    • Debug
      • Tasks
        • Echo
        • Return
    • Kv
      • Tasks
        • Delete
        • Get
        • GetKeys
        • Set
    • Output
      • Tasks
        • OutputValues
    • Log
      • Tasks
        • Fetch
        • Log
        • PurgeLogs
    • Runner
      • Task Runners
        • Process
    • Condition
      • Conditions
        • DateTimeBetween
        • DayWeek
        • DayWeekInMonth
        • ExecutionFlow
        • ExecutionLabels
        • ExecutionNamespace
        • ExecutionOutputs
        • ExecutionStatus
        • Expression
        • FlowCondition
        • FlowNamespaceCondition
        • HasRetryAttempt
        • MultipleCondition
        • Not
        • Or
        • PublicHoliday
        • TimeBetween
        • Weekend
    • Trigger
      • Tasks
        • Toggle
      • Triggers
        • Flow
        • Schedule
        • ScheduleOnDates
        • Webhook
    • Flow
      • Tasks
        • AllowFailure
        • Dag
        • EachParallel
        • EachSequential
        • ForEach
        • ForEachItem
        • If
        • LoopUntil
        • Parallel
        • Pause
        • Sequential
        • Sleep
        • Subflow
        • Switch
        • Template
        • WorkingDirectory
    • Namespace
      • Tasks
        • DeleteFiles
        • DownloadFiles
        • UploadFiles
    • Http
      • Tasks
        • Download
        • Request
      • Triggers
        • Trigger
    • Templating
      • Tasks
        • TemplatedTask
    • State
      • Tasks
        • Delete
        • Get
        • Set
    • Execution
      • Tasks
        • Assert
        • Count
        • Exit
        • Fail
        • Labels
        • PurgeExecutions
        • Resume
    • Storage
      • Tasks
        • Concat
        • DeduplicateItems
        • Delete
        • FilterItems
        • LocalFiles
        • PurgeCurrentExecutionFiles
        • Reverse
        • Size
        • Split
        • Write
  • Actian Vector
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Airbyte
    • Connections
      • Tasks
        • CheckStatus
        • Sync
  • Airflow
    • Tasks
      • TriggerDagRun
  • Amazon Redshift
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • AMQP
    • Tasks
      • Consume
      • CreateQueue
      • DeclareExchange
      • Publish
      • QueueBind
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Ansible
    • Tasks
      • AnsibleCLI
  • Apache Cassandra
    • Astradb
      • Tasks
        • Query
      • Triggers
        • Trigger
    • Standard
      • Tasks
        • Query
      • Triggers
        • Trigger
  • Apache Druid
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Apache Kafka
    • Tasks
      • Consume
      • Produce
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Apache Pinot
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Apache Pulsar
    • Tasks
      • Consume
      • Produce
      • Reader
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Apache Spark
    • Tasks
      • JarSubmit
      • PythonSubmit
      • RSubmit
      • SparkCLI
  • Apache Tika
    • Tasks
      • Parse
  • Arrow Flight SQL
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • AS400
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Atlassian Jira
    • Issues
      • Tasks
        • Create
        • CreateComment
        • UpdateFields
  • AWS
    • S3
      • Tasks
        • Copy
        • CreateBucket
        • Delete
        • DeleteList
        • Download
        • Downloads
        • List
        • Upload
      • Triggers
        • Trigger
    • Sns
      • Tasks
        • Publish
    • Emr
      • Tasks
        • CreateClusterAndSubmitSteps
        • DeleteCluster
        • SubmitSteps
    • Athena
      • Tasks
        • Query
    • Dynamodb
      • Tasks
        • DeleteItem
        • GetItem
        • PutItem
        • Query
        • Scan
    • Kinesis
      • Tasks
        • PutRecords
    • Lambda
      • Tasks
        • Invoke
    • Authentication
      • Tasks
        • EksToken
    • Eventbridge
      • Tasks
        • PutEvents
    • Sqs
      • Tasks
        • Consume
        • Publish
      • Triggers
        • RealtimeTrigger
        • Trigger
    • Ecr
      • Tasks
        • GetAuthToken
  • AWS (EE)
    • Task Runners
      • Batch
    • Log Exporters
      • LogExporter
  • Azure
    • Function
      • Tasks
        • HttpFunction
    • Table
      • Tasks
        • Bulk
        • Delete
        • Get
        • List
    • Authentication
      • Tasks
        • OauthAccessToken
    • Eventhubs
      • Tasks
        • Consume
        • Produce
      • Triggers
        • RealtimeTrigger
        • Trigger
    • Datafactory
      • Tasks
        • CreateRun
    • Adls
      • Tasks
        • Delete
        • DeleteFiles
        • List
        • Read
        • Reads
        • SharedAccess
        • Upload
        • Append
        • Lease
        • SetAccessControl
      • Triggers
        • Trigger
    • Job
      • Tasks
        • Create
    • Pool
      • Tasks
        • Resize
    • Blob
      • Tasks
        • Copy
        • Delete
        • DeleteList
        • Download
        • Downloads
        • List
        • SharedAccess
        • Upload
      • Triggers
        • Trigger
  • Azure (EE)
    • Tasks
      • Create
      • List
      • SharedAccess
    • Task Runners
      • Batch
    • Log Exporters
      • LogExporter
  • ClickHouse
    • Tasks
      • BulkInsert
      • ClickHouseLocalCLI
      • Queries
      • Query
    • Triggers
      • Trigger
  • CloudQuery
    • Tasks
      • CloudQueryCLI
      • Sync
  • Compression
    • Tasks
      • ArchiveCompress
      • ArchiveDecompress
      • FileCompress
      • FileDecompress
  • Couchbase
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Cryptography
    • Openpgp
      • Tasks
        • Decrypt
        • Encrypt
  • Databricks
    • SQL
      • Tasks
        • Query
    • DBFS
      • Tasks
        • Download
        • Upload
    • Job
      • Tasks
        • CreateJob
        • SubmitRun
    • Cluster
      • Tasks
        • CreateCluster
        • DeleteCluster
  • Datadog (EE)
    • Log Exporters
      • LogExporter
  • Dataform
    • Dataform CLI
      • Tasks
        • DataformCLI
  • DataHub
    • Tasks
      • Ingestion
  • DB2
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Dbt
    • Dbt CLI
      • Tasks
        • Build
        • Compile
        • DbtCLI
        • Deps
        • Freshness
        • List
        • Run
        • Seed
        • Setup
        • Snapshot
        • Test
    • Dbt Cloud
      • Tasks
        • CheckStatus
        • TriggerRun
  • Debezium DB2
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium Microsoft SQL Server
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium MongoDB
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium MySQL
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium Oracle
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Debezium PostgreSQL
    • Tasks
      • Capture
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Docker
    • Tasks
      • Build
      • Run
      • Stop
  • Dremio
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • DuckDB
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Elasticsearch
    • Tasks
      • Bulk
      • Esql
      • Get
      • Load
      • Put
      • Request
      • Scroll
      • Search
    • Log Exporters
      • LogExporter
  • File system
    • Ftps
      • Tasks
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Triggers
        • Trigger
    • Ftp
      • Tasks
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Triggers
        • Trigger
        • Trigger
    • Smb
      • Tasks
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Triggers
        • Trigger
    • Ssh
      • Tasks
        • Command
    • Sftp
      • Tasks
        • Delete
        • Download
        • Downloads
        • List
        • Move
        • Upload
        • Uploads
      • Triggers
        • Trigger
  • Fivetran
    • Connectors
      • Tasks
        • Sync
  • Git
    • Tasks
      • Clone
      • Push
      • PushFlows
      • PushNamespaceFiles
      • Sync
      • SyncFlows
      • SyncNamespaceFiles
  • GitHub
    • Tasks
      • Search
      • Search
      • Comment
      • Create
      • Search
      • Create
      • Search
      • Search
      • Search
      • Search
  • Google Cloud
    • Vertex AI
      • Tasks
        • ChatCompletion
        • CustomJob
        • MultimodalCompletion
        • TextCompletion
    • Dataproc Batches
      • Tasks
        • PySparkSubmit
        • RSparkSubmit
        • SparkSqlSubmit
        • SparkSubmit
    • Google Cloud Function
      • Tasks
        • HttpFunction
    • Firestore
      • Tasks
        • Delete
        • Get
        • Query
        • Set
    • Dataproc Clusters
      • Tasks
        • Create
        • Delete
    • Pub/Sub
      • Tasks
        • Consume
        • Publish
      • Triggers
        • RealtimeTrigger
        • Trigger
    • BigQuery
      • Tasks
        • Copy
        • CopyPartitions
        • CreateDataset
        • CreateTable
        • DeleteDataset
        • DeletePartitions
        • DeleteTable
        • ExtractToGcs
        • Load
        • LoadFromGcs
        • Query
        • StorageWrite
        • TableMetadata
        • UpdateDataset
        • UpdateTable
      • Triggers
        • Trigger
    • Kubernetes Engine (GKE)
      • Tasks
        • ClusterMetadata
    • Cloud Storage (GCS)
      • Tasks
        • Compose
        • Copy
        • CreateBucket
        • CreateBucketIamPolicy
        • Delete
        • DeleteBucket
        • DeleteList
        • Download
        • Downloads
        • List
        • UpdateBucket
        • Upload
      • Triggers
        • Trigger
    • Authentication
      • Tasks
        • OauthAccessToken
  • Google Cloud (EE)
    • Task Runners
      • Batch
      • CloudRun
    • Log Exporters
      • LogExporter
  • Google Workspace
    • Drive
      • Tasks
        • Create
        • Delete
        • Download
        • Export
        • List
        • Upload
    • Sheets
      • Tasks
        • CreateSpreadsheet
        • DeleteSpreadsheet
        • Load
        • Read
        • ReadRange
  • Grok
    • Tasks
      • TransformItems
      • TransformValue
  • Groovy
    • Tasks
      • Eval
      • FileTransform
  • Hightouch
    • Tasks
      • Sync
  • Hubspot
    • Tasks
      • Create
  • Huggingface
    • Tasks
      • Inference
  • JBang
    • Tasks
      • Commands
      • Script
  • JSONata
    • Tasks
      • TransformItems
      • TransformValue
  • Julia
    • Tasks
      • Commands
      • Script
  • Jython
    • Tasks
      • Eval
      • FileTransform
  • Kubernetes
    • Tasks
      • PodCreate
      • Apply
  • Kubernetes (EE)
    • Task Runners
      • Kubernetes
  • LDAP
    • Tasks
      • Add
      • Delete
      • IonToLdif
      • LdifToIon
      • Modify
      • Search
  • Linear
    • Tasks
      • Create
  • Malloy CLI
    • Tasks
      • CLI
  • MariaDB
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Meilisearch
    • Tasks
      • DocumentAdd
      • DocumentGet
      • FacetSearch
      • Search
  • Microsoft SQL Server
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • MinIO
    • Tasks
      • Copy
      • CreateBucket
      • Delete
      • DeleteList
      • Download
      • Downloads
      • List
      • Upload
    • Triggers
      • Trigger
  • Modal
    • Modal CLI
      • Tasks
        • ModalCLI
  • MongoDB
    • Tasks
      • Bulk
      • Delete
      • Find
      • InsertOne
      • Load
      • Update
    • Triggers
      • Trigger
  • MQTT
    • Tasks
      • Publish
      • Subscribe
    • Triggers
      • RealtimeTrigger
      • Trigger
  • MySQL
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Nashorn
    • Tasks
      • Eval
      • FileTransform
  • NATS
    • Tasks
      • Consume
      • Produce
      • CreateBucket
      • Delete
      • Get
      • Put
    • Triggers
      • RealtimeTrigger
      • Trigger
  • Neo4j
    • Tasks
      • Batch
      • Query
  • New Relic (EE)
    • Log Exporters
      • LogExporter
  • Node
    • Tasks
      • Node
      • Commands
      • Script
  • Notifications
    • Teams
      • Tasks
        • TeamsExecution
        • TeamsIncomingWebhook
    • Mail
      • Tasks
        • MailExecution
        • MailSend
    • Sentry
      • Tasks
        • SentryAlert
        • SentryExecution
    • Telegram
      • Tasks
        • TelegramExecution
        • TelegramSend
    • Twilio
      • Tasks
        • TwilioAlert
        • TwilioExecution
    • Google
      • Tasks
        • GoogleChatExecution
        • GoogleChatIncomingWebhook
    • Sendgrid
      • Tasks
        • SendGridMailExecution
        • SendGridMailSend
    • Pagerduty
      • Tasks
        • PagerDutyAlert
        • PagerDutyExecution
    • Slack
      • Tasks
        • SlackExecution
        • SlackIncomingWebhook
    • Opsgenie
      • Tasks
        • OpsgenieAlert
        • OpsgenieExecution
    • Whatsapp
      • Tasks
        • WhatsAppExecution
        • WhatsAppIncomingWebhook
    • Discord
      • Tasks
        • DiscordExecution
        • DiscordIncomingWebhook
    • Zenduty
      • Tasks
        • ZendutyAlert
        • ZendutyExecution
    • Zulip
      • Tasks
        • ZulipExecution
        • ZulipIncomingWebhook
  • OpenAI
    • Tasks
      • ChatCompletion
      • CreateImage
  • OpenSearch
    • Tasks
      • Bulk
      • Get
      • Load
      • Put
      • Request
      • Scroll
      • Search
  • Opentelemetry (EE)
    • Log Exporters
      • LogExporter
  • Oracle
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • PostgreSQL
    • Tasks
      • Batch
      • CopyIn
      • CopyOut
      • Queries
      • Query
    • Triggers
      • Trigger
  • Power BI
    • Tasks
      • RefreshGroupDataset
  • PowerShell
    • Tasks
      • Commands
      • Script
  • Python
    • Tasks
      • Python
      • Commands
      • Script
  • Redis
    • String
      • Tasks
        • Delete
        • Get
        • Set
    • List
      • Tasks
        • ListPop
        • ListPush
      • Triggers
        • RealtimeTrigger
        • Trigger
    • Pubsub
      • Tasks
        • Publish
  • Rockset
    • Tasks
      • Query
    • Triggers
      • Trigger
  • RScript
    • Tasks
      • Commands
      • Script
  • Ruby
    • Tasks
      • Commands
      • Script
  • Serialization
    • Xml
      • Tasks
        • IonToXml
        • XmlToIon
    • Csv
      • Tasks
        • CsvToIon
        • IonToCsv
    • Excel
      • Tasks
        • ExcelToIon
        • IonToExcel
    • Avro
      • Tasks
        • AvroToIon
        • IonToAvro
    • Parquet
      • Tasks
        • IonToParquet
        • ParquetToIon
    • Json
      • Tasks
        • IonToJson
        • JsonToIon
  • ServiceNow
    • Tasks
      • Post
  • Shell
    • Tasks
      • Bash
      • Commands
      • Script
  • Singer
    • Targets
      • Tasks
        • AdswerveBigQuery
        • Csv
        • DatamillCoPostgres
        • GenericTarget
        • Json
        • MeltanoSnowflake
        • Oracle
        • PipelinewisePostgres
        • PipelinewiseRedshift
        • PipelinewiseSnowflake
        • SqlServer
    • Taps
      • Tasks
        • BigQuery
        • BingAds
        • ChargeBee
        • ExchangeRateHost
        • FacebookAds
        • Fastly
        • GenericTap
        • GitHub
        • Gitlab
        • GoogleAdwords
        • GoogleAnalytics
        • GoogleSearchConsole
        • HubSpot
        • Marketo
        • Netsuite
        • PipelinewiseMongoDb
        • PipelinewiseMysql
        • PipelinewiseOracle
        • PipelinewisePostgres
        • PipelinewiseSqlServer
        • Quickbooks
        • Recharge
        • SageIntacct
        • Salesforce
        • Shopify
        • Slack
        • Stripe
        • Zendesk
        • Zoom
  • Snowflake
    • Tasks
      • Download
      • Queries
      • Query
      • Upload
    • Triggers
      • Trigger
  • Soda
    • Tasks
      • Scan
  • Solace
    • Tasks
      • Consume
      • Produce
    • Triggers
      • Trigger
  • SQLite
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • SQLMesh
    • SQLMesh CLI
      • Tasks
        • SQLMeshCLI
  • SurrealDB
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Sybase
    • Tasks
      • Queries
      • Query
    • Triggers
      • Trigger
  • Template
    • Tasks
      • BulkIndex
      • DocumentGet
      • DocumentIndex
      • FacetSearch
      • Search
  • Terraform
    • Tasks
      • TerraformCLI
  • Trino
    • Tasks
      • Query
    • Triggers
      • Trigger
  • Vertica
    • Tasks
      • Batch
      • Queries
      • Query
    • Triggers
      • Trigger
  • Weaviate
    • Tasks
      • BatchCreate
      • Delete
      • Query
      • SchemaCreate
  • Zendesk
    • Tasks
      • Create
plugins

Dataform​Dataform

Table of Contents
  • Dataform CLI
Contribute
  • Join us on Slack
  • YouTube
  • GitHub
  • Twitter
  • LinkedIn

Plugin Dataform for Kestra

Dataform CLI iconDataform CLI
Kestra's logo

Open Source Declarative Data Orchestration

Product
  • Platform Overview
  • Open Source
  • Enterprise Edition
  • Kestra Cloud
  • Pricing
Solutions
  • Use Cases
  • Declarative Orchestration
  • Automation Platform
  • API First
  • Code in Any Language
  • Terraform Provider
  • Airflow vs Kestra
  • Prefect vs Kestra
  • Dagster vs Kestra
Community
  • Community Overview
  • Blog
  • Write for Us
  • Slack
  • GitHub
Docs
  • Documentation
  • Plugins
  • Blueprints
  • Getting Started
  • Administrator Guide
  • FAQ
Company
  • About Us
  • Careers Hiring!
  • Contact Us
  • Customer Stories
  • Partners Ecosystem

© 2025 Kestra Technologies. Developed with on 🌎.

Privacy Policy / Cookie Policy

Slack