Apache Kafka ConnectorGetOffsets

Apache Kafka ConnectorGetOffsets

Certified

Get a Kafka Connect connector's offsets

Returns the connector's committed offsets (source partitions/offsets for a source connector, consumer group offsets for a sink connector). The output offsets has the same shape expected by ConnectorAlterOffsets, so it can be piped directly between the two tasks.

yaml
type: io.kestra.plugin.kafka.ConnectorGetOffsets

Inspect a connector's offsets

yaml
id: kafka_connector_get_offsets
namespace: company.team

tasks:
  - id: get_offsets
    type: io.kestra.plugin.kafka.ConnectorGetOffsets
    connectUrl: http://connect:8083
    connectorName: orders_jdbc_sink
Properties

Kafka Connect REST API base URL

For example http://connect: 8083. Kafka Connect has no dedicated Java admin client — every operation goes through this REST API.

Connector name

Additional HTTP headers

Sent on every request to the Connect REST API. Useful when the worker sits behind a reverse proxy or expects a bearer token, e.g. Authorization: Bearer ....

Basic auth password

Reference (ref) of the pluginDefaults to apply to this task.

Basic auth username

Required together with password when the Connect REST API is protected with HTTP basic auth. Leave both unset to call an unauthenticated worker — no Authorization header is sent in that case.

Connector name

SubTypeobject

Per-partition offsets

Each entry has a partition map and an offset map; their exact keys depend on the connector type (source vs sink).