Apache Kafka DescribeLogDirs
CertifiedDescribe Kafka broker log directories
Apache Kafka DescribeLogDirs
Describe Kafka broker log directories
Reports per-partition on-disk size and replica lag per broker log directory using the Kafka AdminClient, useful for metering per-tenant topic storage usage.
type: io.kestra.plugin.kafka.DescribeLogDirsExamples
Meter storage usage across the cluster
id: kafka_describe_log_dirs
namespace: company.team
tasks:
- id: describe_log_dirs
type: io.kestra.plugin.kafka.DescribeLogDirs
properties:
bootstrap.servers: localhost:9092
Properties
properties *object
Kafka AdminClient properties
Must include bootstrap.servers; accepts any Kafka AdminClient config. Provide base64-encoded content for ssl.keystore.location and ssl.truststore.location when using SSL.
assets
Assets this task consumes as inputs or produces as outputs, for lineage tracking and the asset graph (Enterprise Edition). A flow declaring this property on a task is rejected in the open-source edition.
io.kestra.core.models.assets.AssetsDeclaration
IGNOREFAILWARNAsset failure behavior
Behavior applied to the task state when a declared asset fails to render, emit, or be persisted (e.g. a lock conflict): FAIL escalates it to FAILED, WARN (default) warns it if it would otherwise succeed, IGNORE leaves the state untouched.
Whether to auto-register assets referenced dynamically at runtime that are not statically declared in inputs or outputs.
The assets consumed as inputs.
io.kestra.core.models.assets.AssetIdentifier
1The assets produced as outputs.
io.kestra.plugin.ee.assets.Dataset
1150{}1150io.kestra.plugin.ee.assets.File
1150{}1150io.kestra.plugin.ee.assets.Table
1150{}1150io.kestra.plugin.ee.assets.VM
1150{}1150io.kestra.core.models.assets.External
1150{}1150io.kestra.core.models.assets.Custom
11501Custom asset type
{}1150brokerIds array
[]Broker IDs to describe
Describes every broker in the cluster when unset.
callTimeout string
PT30SAdminClient call timeout
Maximum duration to wait for each AdminClient operation to complete before failing the task. Defaults to PT30S (30 seconds). Distinct from the task-level timeout, which lets the worker kill the task without retrying it.
Outputs
logDirs array
Per broker log directories
Each entry contains brokerId, path and partitions (topic, partition, size in bytes, offsetLag).
topicSizes object
Total on-disk size per topic, in bytes
Summed across all partitions and brokers.
