Apache Kafka ConsumerGroupDescribe
CertifiedDescribe Kafka consumer groups
Apache Kafka ConsumerGroupDescribe
Describe Kafka consumer groups
Returns state, members and per-partition committed offset/lag for the given consumer groups using the Kafka AdminClient.
Fails with GroupIdNotFoundException if a group does not exist.
type: io.kestra.plugin.kafka.ConsumerGroupDescribeExamples
Check the lag of a tenant's processing consumer group
id: kafka_consumer_group_describe
namespace: company.team
tasks:
- id: describe_groups
type: io.kestra.plugin.kafka.ConsumerGroupDescribe
properties:
bootstrap.servers: localhost:9092
groupIds:
- tenant-acme-orders-processor
Properties
groupIds *array
Consumer group IDs to describe
properties *object
Kafka AdminClient properties
Must include bootstrap.servers; accepts any Kafka AdminClient config. Provide base64-encoded content for ssl.keystore.location and ssl.truststore.location when using SSL.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150callTimeout string
PT30SAdminClient call timeout
Maximum duration to wait for each AdminClient operation to complete before failing the task. Defaults to PT30S (30 seconds). Distinct from the task-level timeout, which lets the worker kill the task without retrying it.
Outputs
groups array
Described consumer groups
Each entry contains groupId, state, members (memberId, clientId, host, assignedPartitions) and offsets (topic, partition, currentOffset, endOffset, lag).
