Clear Pulsar backlogs held by subscriptions nobody consumes
Detect Apache Pulsar subscriptions with no consumers that still pin a large backlog, then clear or remove them behind a dry run, an approval pause and a live re-read that fails the run.
From automating data pipelines to accelerating machine learning model deployment, Kestra streamlines complex workflows across a wide range of industries and domains.
Say goodbye to delays in your pipeline as Kestra initiates workflows based on specific times or events, such as data arrivals or file uploads.
Efficiently manage and deploy machine learning models at scale using Kestra’s orchestration capabilities.
Move, prepare, and clean data, consolidating it into a single data mart for easy access.
Easily connect and integrate with various data sources, ensuring smooth data flow across your systems.
Automatically detect and process changes in data sources with change data capture, keeping your data up-to-date and accurate.
Configure Kestra to distribute reports via email or Slack, keeping your team informed.
Easily collect data from various sources and integrate it into your workflows.
Manage the entire data lifecycle, from ingestion to reporting, with Kestra’s powerful orchestration capabilities.
Detect Apache Pulsar subscriptions with no consumers that still pin a large backlog, then clear or remove them behind a dry run, an approval pause and a live re-read that fails the run.
Stream Apache Pulsar messages straight into MySQL in real time, one row per event.
Drain a multi-tenant Pulsar topic and route each batch by tenant priority tier, logging ENTERPRISE traffic and quarantining the rest, with a Slack report per run.
Non-destructively sample a Pulsar topic on a schedule with a non-durable reader and page Slack when it goes silent, floods, or the broker is unreachable.
Audit Apache Pulsar key-value changelog topics for uncompacted ledger bloat, trigger on-demand compaction, and verify convergence.
Process a list of CSV files in parallel, each in its own isolated Python and Pandas container.
Run a parametrized Python script in Kestra that emits downloadable files, named outputs, and custom metrics.
Fan out a list of data partitions and process each one in parallel with isolated Python scripts in Docker, capturing row-count and timing metrics.
Audit Qdrant vector collections for operational status degradation and HNSW indexing lag with automated Slack alerts.
Compare live embeddings with stored vectors and repair an approved batch only when held-out retrieval has degraded.
Trigger a Qlik Cloud app reload, classify the result OK, SLOW, or CRITICAL by outcome and duration, alert Slack, and log a governance audit trail.
Bootstrap a ClickHouse database and table, insert rows, and run a SQL query that stores results, all in one Kestra flow.
Query QuestDB's wal_tables() for suspended tables, alert Slack with the real table names, and optionally issue ALTER TABLE RESUME WAL over the REST API with a safe-character guard.
List the delete tasks still queued on a Quickwit index, alert Slack when the queue is too deep or too old, and log a governance audit trail.
Continuously audit Quickwit search indexes for missing retention policies, verify canary query health, and alert Slack on storage governance drift.
Read a Quickwit index's attached sources, alert Slack when the index has none or a source of an unapproved type, and optionally pause one named non-compliant source.
Monitor Quickwit search query latency against SLA budgets and detect error log volume spikes with automated Slack alerting.
Audit and safely execute Quickwit document deletions by verifying matched record blast radius and dry-run previews before queuing irreversible janitor tasks.
Detect stale Quickwit Kafka data and safely reset a stranded source checkpoint after approval.
Drain dead-lettered RabbitMQ messages, classify root causes into transient vs poison pills, safely replay recoverable messages, and isolate toxic payloads to S3.
Detect Apache Pulsar subscriptions with no consumers that still pin a large backlog, then clear or remove them behind a dry run, an approval pause and a live re-read that fails the run.
Stream Apache Pulsar messages straight into MySQL in real time, one row per event.
Drain a multi-tenant Pulsar topic and route each batch by tenant priority tier, logging ENTERPRISE traffic and quarantining the rest, with a Slack report per run.
Non-destructively sample a Pulsar topic on a schedule with a non-durable reader and page Slack when it goes silent, floods, or the broker is unreachable.
Audit Apache Pulsar key-value changelog topics for uncompacted ledger bloat, trigger on-demand compaction, and verify convergence.
Process a list of CSV files in parallel, each in its own isolated Python and Pandas container.
Built for Enterprises and SMBs, with strong governance, enterprise-grade security, seamless scalability, and dedicated enterprise support backed by SLAs.