Sync

yaml
type: "io.kestra.plugin.airbyte.connections.Sync"

Examples

yaml
id: airbyte_sync
namespace: company.team

tasks:
  - id: sync
    type: io.kestra.plugin.airbyte.connections.Sync
    url: http://localhost:8080
    connectionId: e3b1ce92-547c-436f-b1e8-23b6936c12cd

yaml
id: airbyte_sync
namespace: company.team

tasks:
  - id: data_ingestion
    type: io.kestra.plugin.airbyte.connections.Sync
    connectionId: e3b1ce92-547c-436f-b1e8-23b6936c12ab
    url: http://host.docker.internal:8000/
    username: "{{ secret('AIRBYTE_USERNAME') }}"
    password: "{{ secret('AIRBYTE_PASSWORD') }}"

triggers:
  - id: every_minute
    type: io.kestra.plugin.core.trigger.Schedule
    cron: "*/1 * * * *"

Properties

connectionId *string

url *string

applicationCredentials

Definitions

io.kestra.plugin.airbyte.AbstractAirbyteConnection-ApplicationCredentials

clientId*string

clientSecret*string

failOnActiveSync booleanstring

Defaulttrue

httpTimeout string

DefaultPT10S

Formatduration

maxDuration string

DefaultPT1H

Formatduration

options

Definitions

io.kestra.core.http.client.configurations.HttpConfiguration

allowFailedbooleanstring

Defaultfalse

allowedResponseCodesarray

SubTypeinteger

auth

io.kestra.core.http.client.configurations.BasicAuthConfiguration

type*object

passwordstring

usernamestring

io.kestra.core.http.client.configurations.BearerAuthConfiguration

type*object

tokenstring

basicAuthPasswordstring

basicAuthUserstring

connectTimeoutstring

Formatduration

connectionPoolIdleTimeoutstring

Formatduration

defaultCharsetstring

DefaultUTF-8

java.nio.charset.Charset

followRedirectsbooleanstring

Defaulttrue

logLevelstring

Possible Values

ALLTRACEDEBUGINFOWARNERROROFFNOT_SPECIFIED

logsarray

SubTypestring

Possible Values

REQUEST_HEADERSREQUEST_BODYRESPONSE_HEADERSRESPONSE_BODY

maxContentLengthinteger

proxy

io.kestra.core.http.client.configurations.ProxyConfiguration

addressstring

passwordstring

portintegerstring

typestring

DefaultDIRECT

Possible Values

DIRECTHTTPSOCKS

usernamestring

proxyAddressstring

proxyPasswordstring

proxyPortinteger

proxyTypestring

Possible Values

DIRECTHTTPSOCKS

proxyUsernamestring

readIdleTimeoutstring

Formatduration

readTimeoutstring

Formatduration

ssl

io.kestra.core.http.client.configurations.SslOptions

insecureTrustAllCertificatesbooleanstring

timeout

io.kestra.core.http.client.configurations.TimeoutConfiguration

connectTimeoutstring

Formatduration

readIdleTimeoutstring

DefaultPT5M

Formatduration

password string

pollFrequency string

DefaultPT1S

Formatduration

token string

username string

wait booleanstring

Defaulttrue

Outputs

alreadyRunning boolean

jobId integer

Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations

Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources

Stripe

Tasks that interact with Stripe customers, payments, balances, and webhooks.

Tool

AWS

AWS plugin for Kestra

AlertingCloudMessagingStorageDatabaseScriptToolTransformation

Databricks

Databricks plugin for Kestra

ToolCloudStorage

Sync

Create automations with Airbyte Connections Sync

Build an ETL Pipeline with Parallel Airbyte Syncs and dbt Core Transformations

Run Parallel ETL Ingestion with Airbyte to Sync Multiple Data Sources

More Plugins in this Category

Stripe

AWS

Databricks

1.1.3