Hazelcast Cluster State & Partition Safety Sentinel
Continuously audit Hazelcast in-memory cluster safety, detect partition migration stalls and state degradation, and alert via Slack.
Audits Harbor container registry API to detect stalled garbage collection jobs and read-only lock freezes, alerting DevOps on Slack.
Automates continuous health and maintenance surveillance of Harbor enterprise container registry deployments. Interrogates the Harbor REST API to detect hung garbage collection (GC) executions, lingering read-only registry locks, and storage reclamation stalls before container image build pipelines and deployment rollouts freeze.
flowchart TD
A[periodic_harbor_audit Schedule Trigger] --> B[scan_harbor_gc_status Python Script]
B --> C[evaluate_stall_threshold Flowable If]
C -- GC Execution Stalled --> D[notify_slack_devops_team Slack Webhook]
C -- GC Operating Nominally --> E[log_nominal_harbor_state Core Log]
D --> F[emit_audit_manifest Debug Return]
E --> F
periodic_harbor_audit): Automated cron trigger executing regular surveillance sweeps across Harbor registry instances.scan_harbor_gc_status): Dockerized Python runtime querying Harbor REST APIs with connection timeout safeguards.evaluate_stall_threshold): Conditional branching logic isolating long-running GC stalls from routine pruning runs.notify_slack_devops_team): Formatted Slack webhook message delivering actionable telemetry and remediation runbooks.emit_audit_manifest): Standardized JSON output recording exact run parameters for compliance and reliability reporting.docker push commands.| Name | Type | Default | Description |
|---|---|---|---|
harbor_api_url |
STRING |
https://harbor.internal.enterprise.com/api/v2.0 |
Base HTTPS URL of the Harbor container registry REST API endpoint. |
max_execution_hours |
INT |
4 |
Maximum allowable duration in hours a garbage collection execution may remain running before alerting. |
alert_on_stall |
BOOL |
true |
Toggle whether Slack alerts are dispatched upon detecting stalled garbage collection executions. |
{{ outputs.scan_harbor_gc_status.vars.latest_execution_id }}: Integer identifier of the most recent Harbor garbage collection execution job.{{ outputs.scan_harbor_gc_status.vars.gc_job_status }}: Execution state string returned by Harbor (RUNNING, SUCCESS, ERROR, or STOPPED).{{ outputs.scan_harbor_gc_status.vars.execution_duration_hours }}: Calculated elapsed time in hours of the active garbage collection execution.{{ outputs.scan_harbor_gc_status.vars.is_read_only_locked }}: Boolean flag indicating whether the registry currently enforces a read-only lock.{{ outputs.scan_harbor_gc_status.vars.is_alerting }}: Boolean flag indicating whether observed execution metrics breached tolerance limits./system/gc endpoints.HARBOR_ADMIN_USERNAME: Secret username for authenticating to the Harbor REST API.HARBOR_ADMIN_PASSWORD: Secret password or token for authenticating to the Harbor REST API.SLACK_WEBHOOK_URL: Secret webhook URL for dispatching incident notifications to team Slack rooms.HARBOR_ADMIN_USERNAME, HARBOR_ADMIN_PASSWORD, and SLACK_WEBHOOK_URL secrets in Kestra.company.devops namespace.harbor_api_url with your internal Harbor service URL.periodic_harbor_audit trigger to commence automated background monitoring.requests accepts the custom CA bundle or set verify=False for internal endpoints.read_only was manually toggled by an administrator.jobservice container runs out of worker threads, GC executions will queue indefinitely without starting.PUT /system/gc/{id} to abort hung executions automatically.