Apache Kafka DescribeLogDirs

Apache Kafka DescribeLogDirs

Certified

Describe Kafka broker log directories

Reports per-partition on-disk size and replica lag per broker log directory using the Kafka AdminClient, useful for metering per-tenant topic storage usage.

yaml
type: io.kestra.plugin.kafka.DescribeLogDirs

Meter storage usage across the cluster

yaml
id: kafka_describe_log_dirs
namespace: company.team

tasks:
  - id: describe_log_dirs
    type: io.kestra.plugin.kafka.DescribeLogDirs
    properties:
      bootstrap.servers: localhost:9092
Properties

Kafka AdminClient properties

Must include bootstrap.servers; accepts any Kafka AdminClient config. Provide base64-encoded content for ssl.keystore.location and ssl.truststore.location when using SSL.

SubTypeinteger
Default[]

Broker IDs to describe

Describes every broker in the cluster when unset.

Reference (ref) of the pluginDefaults to apply to this task.

DefaultPT30S

AdminClient call timeout

Maximum duration to wait for each AdminClient operation to complete before failing the task. Defaults to PT30S (30 seconds).

SubTypeobject

Per broker log directories

Each entry contains brokerId, path and partitions (topic, partition, size in bytes, offsetLag).

SubTypeinteger

Total on-disk size per topic, in bytes

Summed across all partitions and brokers.