PVCWatch - Kubernetes stuck PersistentVolumeClaim watcher
Watches Kubernetes PVCs and alerts on Slack when one gets stuck in Pending.
Audit Grafana Pyroscope ingester readiness, track continuous profiling app coverage, and dispatch Slack alerts on profiling dropouts.
Monitors standalone and cluster Grafana Pyroscope continuous profiling deployments in real time, verifying ingester readiness and asserting that expected microservice applications are actively streaming profiling data to prevent blind spots during performance investigations.
periodic_profiling_audit (io.kestra.plugin.core.trigger.Schedule) fires every 15 minutes with target connection details and coverage thresholds. Shipped disabled by default to facilitate safe initial verification.probe_pyroscope_readiness (io.kestra.plugin.core.http.Request) probes GET /ready to ensure the Pyroscope ingester ring and tenant distributors are fully operational.probe_active_apps (io.kestra.plugin.core.http.Request) queries GET /api/apps to retrieve the list of all currently reporting profiling applications.classify_pyroscope_status (io.kestra.plugin.core.flow.Switch) routes execution:INGESTER_DEGRADED: Triggers when /ready returns a non-200 status code (e.g. 503 during ingester ring backpressure or storage saturation), dispatching an urgent alert to #observability-alerts via io.kestra.plugin.slack.notifications.SlackIncomingWebhook.APPLICATION_COVERAGE_DEFICIT: Triggers when active application count is below min_expected_apps, dispatching a Slack warning alerting SREs to profiling agent dropouts.HEALTHY: Confirms ingester readiness and expected coverage, logging operational status via io.kestra.plugin.core.log.Log.log_audit_complete always records execution completion and active application counts for long-term auditability.errors block intercepts connection drops or socket errors to immediately notify on-call engineers when the Pyroscope container is unreachable.Continuous profiling is vital for root-cause latency analysis and memory leak detection, yet the profiling infrastructure itself is rarely monitored for coverage dropouts. Static ping checks cannot parse the active application array or assert whether required services are actively streaming profiles. Kestra provides declarative scheduling, robust error handling, secure credential management, and structured alerting.
grafana/pyroscope:latest) requiring no license key or paid account.SLACK_WEBHOOK_URL: Slack incoming webhook URL used by alert_ingester_degraded, alert_coverage_deficit, and the global errors handler.docker run -d --name pyroscope-test -p 4040:4040 grafana/pyroscope:latest
SLACK_WEBHOOK_URL secret in your Kestra namespace.min_expected_apps: 0).log_healthy_state logs nominal readiness.min_expected_apps: 5 and re-run to verify that APPLICATION_COVERAGE_DEFICIT alerts Slack when reporting services fall below threshold.periodic_profiling_audit once verified.io.kestra.plugin.core.flow.Loop to check for specific mandatory service names (e.g., checkout-service.cpu, auth-service.inuse_space).io.kestra.plugin.pagerduty.notifications.PagerDutyAlert when INGESTER_DEGRADED fires in critical production environments./metrics endpoint to monitor compactor block counts and long-term disk retention trends.