Capture

yaml
type: "io.kestra.plugin.debezium.mongodb.Capture"

Examples

yaml
id: mongo_replica_connection
namespace: company.team

tasks:
  - id: capture
    type: io.kestra.plugin.debezium.mongodb.Capture
    snapshotMode: INITIAL
    connectionString: "mongodb://mongo_user:{{secret('MONGO_PASSWORD')}}@mongodb0.example.com:27017/?replicaSet=rs0"
    maxRecords: 100

yaml
id: mongo_sharded_connection
namespace: company.team

tasks:
  - id: capture
    type: io.kestra.plugin.debezium.mongodb.Capture
    snapshotMode: INITIAL
    connectionString: "mongodb://mongo_user:{{secret('MONGO_PASSWORD')}}@mongos0.example.com:27017,mongos1.example.com:27017/"
    maxRecords: 100

yaml
id: mongo_replica_srv
namespace: company.team

tasks:
  - id: capture
    type: io.kestra.plugin.debezium.mongodb.Capture
    snapshotMode: INITIAL
    connectionString: "mongodb+srv://mongo_user:{{secret('MONGO_PASSWORD')}}@mongos0.example.com/?replicaSet=rs0"
    maxRecords: 100

yaml
id: mongo
namespace: company.team

tasks:
  - id: capture
    type: io.kestra.plugin.debezium.mongodb.Capture
    snapshotMode: INITIAL
    connectionString: "mongodb+srv://mongo_user:{{secret('MONGO_PASSWORD')}}@mongos0.example.com/"
    maxRecords: 100

Properties

connectionString *string

hostname *string

port *string

deleted string

DefaultADD_FIELD

Possible Values

ADD_FIELDNULLDROP

deletedFieldName string

Defaultdeleted

excludedCollections object

excludedColumns object

excludedDatabases object

excludedTables object

format string

DefaultINLINE

Possible Values

RAWINLINEWRAP

ignoreDdl booleanstring

Defaulttrue

includedCollections object

includedColumns object

includedDatabases object

includedTables object

key string

DefaultADD_FIELD

Possible Values

ADD_FIELDDROP

maxDuration string

Formatduration

maxRecords integerstring

maxSnapshotDuration string

DefaultPT1H

Formatduration

maxWait string

DefaultPT10S

Formatduration

metadata string

DefaultADD_FIELD

Possible Values

ADD_FIELDDROP

metadataFieldName string

Defaultmetadata

offsetsCommitMode string

DefaultON_STOP

Possible Values

ON_EACH_BATCHON_STOP

password string

properties object

SubTypestring

snapshotMode string

DefaultINITIAL

Possible Values

INITIALINITIAL_ONLYNO_DATAWHEN_NEEDED

splitTable string

DefaultTABLE

Possible Values

OFFDATABASETABLE

stateName string

Defaultdebezium-state

username string

Outputs

size integer

stateHistoryKey string

stateOffsetKey string

uris object

SubTypestring

Metrics

records counter

PostgreSQL

Tasks that connect to PostgreSQL via JDBC to run queries and loads.

Database

SurrealDB

Tasks that run SurrealQL queries against SurrealDB.

Database

Couchbase

Tasks that execute Couchbase N1QL queries and trigger Kestra flows from query results.

Database

Capture

More Plugins in this Category

PostgreSQL

SurrealDB

Couchbase