You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Flaky: test_skill_listing_cost supplied_mtime test catches a stray config.json stat (Linux + Windows) #21079
test/test_skill_listing_cost.py::TestListingStaysCheapOnTheEventLoop::test_a_supplied_mtime_skips_the_frontmatter_cache_stat failed on 3 unrelated branches. It fails on both Linux and Windows, always in shard 3:
None of these branches touch skill listing. The test asserts that no stat happens on the event loop. The stat it catches is of a config.json under the pytest tmp dir, not a skill frontmatter file. That looks like a stat from some other path, like a config load in a background or earlier-scheduled task, landing inside the test's observation window. If so, the result depends on what else the worker ran first (determinism class 4, order dependence).
Likely fix direction
Narrow the stat spy to the frontmatter-cache paths the test is about. Or make sure nothing else on the loop loads config.json during the window, for example by pinning the config load before the spy starts.
AssertionError: assert ['C:\\Users\\...\\config.json'] == [] — the same stray config.json stat leaking from another xdist worker, Windows shard 3, matching this issue exactly.
Activity
dodgeblaster commentedon Oct 20, 2026
Recurrence on an unrelated branch (PR #22566,
kc-wt-15009, a dashboard skill-picker fix that touches none of this test or theconfig.jsonstat path):test/test_skill_listing_cost.py::TestListingStaysCheapOnTheEventLoop::test_a_supplied_mtime_skips_the_frontmatter_cache_statAssertionError: assert ['C:\\Users\\...\\config.json'] == []— the same strayconfig.jsonstat leaking from another xdist worker, Windows shard 3, matching this issue exactly.test(skills): scope supplied-mtime stat spy (kirodotdev#21079)
amadsalmon commentedon Oct 25, 2026
Seen on fork PR #9749 (
a99b1329aa), Linux, Backend Tests (3.12, 3) (job 121140703831):test_a_supplied_mtime_skips_the_frontmatter_cache_stat - AssertionError: assert ['/tmp/pytest.../config.json'] == []. The PR touches no skill-listing code. Fix PR #21084 is still open.test(skills): scope supplied-mtime stat spy (#21079) (#21084)