Summary
- CI failure rate (last 20 runs of
ci.yml): 9 failures / 20 runs = 45% (plus 5 cancelled, 6 success)
- Consecutive failure streak: up to 3 in a row (runs #53234–#53236)
- Recommended action: Investigate — failure rate is well above the 10% threshold and includes a notable streak.
Failure Details
Top failure patterns (from 3 most recent failed runs):
- Integration test package failures with no individual test flagged as failed —
pkg/workflow (run #53241, job "Integration: Workflow Infra") and pkg/cli (run #53236, job "Integration: CLI Completion & Other") both ended with FAIL at the package level but the harness logged "⚠️ No individual test marked as failed!", suggesting a build/init issue or race condition rather than a simple assertion failure.
TestCacheMemoryMultipleIntegration failing intermittently in pkg/workflow (subtest single_cache-memory_(backward_compatible)), seen in run #53241.
TestInputValidation failing in pkg/cli (subtests around key=value parsing: invalid_input_without_equals, invalid_input_-_empty_key, mixed_valid_and_invalid), seen in run #53236.
These look like flaky/non-deterministic integration test behavior (race conditions or shared test state) rather than a single clear-cut regression, since the same suites intermittently pass in other runs.
Open regression/bug-labeled issues (labels: bug, regression, top 5):
None of these open issues directly cover the pkg/workflow/pkg/cli integration test flakiness identified above — this may warrant a new tracking issue.
Generated by 🧭 Daily Regression Audit · auto · 52 AIC · ⌖ 2.41 AIC · ⊞ 6.4K · ◷
Summary
ci.yml): 9 failures / 20 runs = 45% (plus 5 cancelled, 6 success)Failure Details
Top failure patterns (from 3 most recent failed runs):
pkg/workflow(run #53241, job "Integration: Workflow Infra") andpkg/cli(run #53236, job "Integration: CLI Completion & Other") both ended withFAILat the package level but the harness logged "TestCacheMemoryMultipleIntegrationfailing intermittently inpkg/workflow(subtestsingle_cache-memory_(backward_compatible)), seen in run #53241.TestInputValidationfailing inpkg/cli(subtests around key=value parsing:invalid_input_without_equals,invalid_input_-_empty_key,mixed_valid_and_invalid), seen in run #53236.These look like flaky/non-deterministic integration test behavior (race conditions or shared test state) rather than a single clear-cut regression, since the same suites intermittently pass in other runs.
Open regression/bug-labeled issues (
labels: bug, regression, top 5):None of these open issues directly cover the
pkg/workflow/pkg/cliintegration test flakiness identified above — this may warrant a new tracking issue.