Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"results/hosted-41182807900/qualification-artifact.zip": "93baf16bdf448abaddbec567f7bbc507f4799a44ee583f16c3135c2a5029b005",
"results/hosted-41182807900/qualification.json": "f5228b65e714d82c5f38fa080cfb4224bad813940d07bdb4a9c2497c669da25f"
}
Binary file not shown.

Large diffs are not rendered by default.

33 changes: 33 additions & 0 deletions evidence/kv-live-pilot-20261031/plan/second-attempt-1200/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
# Prospectively refreshed window for the same single additional pair

This is the current 12:00 UTC planning window, not another comparison. The
[earlier 10:00 plan](../second-attempt/plan.json) is preserved byte-for-byte as
unexecuted history: its latest admission time passed without a dispatch or new
claim. Its price evidence and draft authorization are not relabelled or extended.

Relative to that reviewed plan, only the two expiry fields and two public
price-evidence URLs change. The unique campaign/execution IDs, PR275 exception,
old claimed binding/checkpoints, diagnostics-capable source, original qualified
actor ZIP/receipt, task/K/controls/verifier, common actor contracts and equal 8+8
limits remain identical. No provider, credential setting, runtime or workflow
changes, refund, reset, third attempt or automatic retry are introduced.

[Fresh price/accounting evidence](https://github.com/InferMatrixLab/InferRSI/issues/248#issuecomment-6542191862)
was checked at 10:22–10:23 UTC. The new window ends **2026-10-31 12:00 UTC**;
actual admission must be **no later than 11:38 UTC**, preserving 1,320 seconds of
runway after queue/preflight. This is not a provider price guarantee or renewed
account verification. Changed or uncertain prices/group applicability, source,
qualification or accounting must stop admission. A missed window is not silently
extended.

The full first unknown-cost $162.72 claim and $491.35 unrelated carryover remain.
One new $162.72 bound would total PR275/pilot $325.44 and observed daily $816.79;
PR275's scoped cap stays $350, other PRs $200, and day/pilot ceilings $1,000.
These are retained commitments, not actual invoices. The first run's omitted
cause and bill remain unknown; its consumed slot is not proof of a grant or HTTP.

The real public freeze/locator, exact current-main identity, current-host
preflight and fresh anchored admission remain mandatory. These data do not
execute a candidate or model, and software qualification is not efficacy or
service evidence. Existing candidate/grader secret boundaries and first-failure
retention remain unchanged.
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"plan/second-attempt-1200/plan.json": "6ce8ecfec8bd9a677bff4319e451ed997159e44a8aff9d4b0db98515d7035b24",
"plan/second-attempt-1200/README.md": "c56c46ffe2fd99a22f2b7a6e621e7cf9d17663a3f56d070a4c4451f699be5b15"
}
308 changes: 308 additions & 0 deletions evidence/kv-live-pilot-20261031/plan/second-attempt-1200/plan.json

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"actor_sha256":"af1ed26942b295758dfe93432109a62ded6ad08aca294d48527269dd8f764298","arm":"A2","baseline_sha256":"a8cdf534deead1d9ba8351e436f1019a4608e15daae61e54a971aec13047928d","client":{"api_version":"2023-06-01","endpoint":"https://yibuapi.com/v1/messages","kind":"anthropic-messages-edit-check-v1","max_output_tokens":4096,"max_read_bytes":65536,"max_request_bytes":262144,"max_requests":8,"max_tool_calls":32,"provider":"yibuapi"},"dependencies":{"src/inferrsi/claim.py":"5f24c4fa91b48f0bb4d4554531607763fc8fc108e90f332816f06cfb520b5cc1","src/inferrsi/harness/evaluation.py":"20d0c52145600a5d6b1e513b61f2fffaa459b83db194876be40726bd4f343a59","src/inferrsi/harness/kv_edit_workbench.py":"bc1f64c8aae39534b8052fdd9a6f3a6b8e63f7a9e9c93cd1077c37ef99cc6f69","src/inferrsi/harness/kv_reclamation.py":"56878c4d1bdda096ac681cadf2d99377bec59d47839802fdf94cfbd9066dc8b9","src/inferrsi/harness/reporting.py":"38c58f02c44e8c8aeacf46527e142be0e3142a83e4b2693246d0ca76c0ddd7c3","src/inferrsi/harness/runner.py":"d290fc87710e77c8e6069e95bb0d347016a393707592d2eed98f07951f2d0865","src/inferrsi/harness/skill_eval_engineering.py":"c83097f6069dd3e09046080b61c88aebc0922d09aab3fd5f1a03d8f04ec976f2","src/inferrsi/infra/artifacts.py":"bcf3adf325e34e10a4ecb4baf0af855ddca3d77eff76de5b66e493baaa3d7eaf","src/inferrsi/infra/executors/local.py":"37bcbca9f3261c8c58a8bf806c9da40720b18d0676c82e8ed24c3901ac9bbe77","src/inferrsi/infra/processes.py":"3b96ebc7a50913e78e86ff3dcba74c8ee8d03d547d9591ca6488f390ac1e6189","src/inferrsi/runspec.py":"dca0952425caf42095ef0c7e2feb8ef4740cc422ecb61e777f203962d9b87709","src/inferrsi/summary_chart.py":"d29023d60f6be804c1b01c9eb73765d4824d6c3bb870fe22c99a24544bc1d8bc","tools/kv_edit_pilot.py":"2e1a2baa9586436d27b3004cb68addc16fa0685bc90961406e31d03f69c3fee3","tools/kv_live_worker.py":"19b0b3765a56b1ae33eef62cac496a793f5844ff42e82bdc6cf21aa76617909c","tools/kv_worker_supervisor.py":"7b2f25148bc0b14536321aa45b434c23424c53858760a708689a28774d585168"},"edit_plan":{"callbacks_sha256":"3653820986096b4dcb328ea5a16a9b4cd4f6bd7185055a73e4c669ad0a0706e4","check_ids":["dev_initial_empty","dev_empty","dev_requires_save","dev_requires_fence","dev_requires_finish","dev_no_save","dev_order_and_nonblocking","dev_reuse","dev_invalid_atomic","development_seed_11","development_seed_23"],"direction":"minimize","files":[{"bytes":5608,"path":"CONTRACT.md","sha256":"85714ad11d360ca885c417cb4d56ef4ecf289e3a0c24696e94808e45661d2ccd"},{"bytes":3386,"path":"candidate.py","sha256":"a8cdf534deead1d9ba8351e436f1019a4608e15daae61e54a971aec13047928d"},{"bytes":11315,"path":"development.json","sha256":"e6da6e89af6a2956cc8f7dfe494b61fe9919900eefac5cb724bb508947dcb56c"},{"bytes":214,"path":"task.json","sha256":"8ee9cc95f07c8c36550f25008862f381a0a0a457bf2f62d4e644c6e38cfad44b"},{"bytes":950,"path":"workbench.md","sha256":"97596737c04f1904941e6eddd0090107af762d2743625260bf2185a35d85df5f"}],"limits":{"benchmark_repetitions":2,"max_benchmarks":4,"max_checks":8,"max_feedback_bytes":8192,"max_seconds":600,"max_source_bytes":65536,"max_writes":8},"metric_key":"elapsed_seconds","metric_unit":"seconds"},"input_token_ceiling":1000000,"model":"claude-opus-5-5","prompt":"Use only the exposed task, contract, starter and fixed visible workbench. Only candidate.py may change. External links are not readable files. Finish after current-revision checks and measurement. Any supplied knowledge is fallible guidance.","schema":"kv-live-worker-v1","suite_sha256":"812ac3e5dd686271d40598e8b8d35faa6f039888f1d36852e571b11b36c600bc"}
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"actor_sha256":"fc6a3eecc06856a9798f9ea542e3adf6a0ece66b60413af8e74390ee4e568ab3","arm":"A3","baseline_sha256":"a8cdf534deead1d9ba8351e436f1019a4608e15daae61e54a971aec13047928d","client":{"api_version":"2023-06-01","endpoint":"https://yibuapi.com/v1/messages","kind":"anthropic-messages-edit-check-v1","max_output_tokens":4096,"max_read_bytes":65536,"max_request_bytes":262144,"max_requests":8,"max_tool_calls":32,"provider":"yibuapi"},"dependencies":{"src/inferrsi/claim.py":"5f24c4fa91b48f0bb4d4554531607763fc8fc108e90f332816f06cfb520b5cc1","src/inferrsi/harness/evaluation.py":"20d0c52145600a5d6b1e513b61f2fffaa459b83db194876be40726bd4f343a59","src/inferrsi/harness/kv_edit_workbench.py":"bc1f64c8aae39534b8052fdd9a6f3a6b8e63f7a9e9c93cd1077c37ef99cc6f69","src/inferrsi/harness/kv_reclamation.py":"56878c4d1bdda096ac681cadf2d99377bec59d47839802fdf94cfbd9066dc8b9","src/inferrsi/harness/reporting.py":"38c58f02c44e8c8aeacf46527e142be0e3142a83e4b2693246d0ca76c0ddd7c3","src/inferrsi/harness/runner.py":"d290fc87710e77c8e6069e95bb0d347016a393707592d2eed98f07951f2d0865","src/inferrsi/harness/skill_eval_engineering.py":"c83097f6069dd3e09046080b61c88aebc0922d09aab3fd5f1a03d8f04ec976f2","src/inferrsi/infra/artifacts.py":"bcf3adf325e34e10a4ecb4baf0af855ddca3d77eff76de5b66e493baaa3d7eaf","src/inferrsi/infra/executors/local.py":"37bcbca9f3261c8c58a8bf806c9da40720b18d0676c82e8ed24c3901ac9bbe77","src/inferrsi/infra/processes.py":"3b96ebc7a50913e78e86ff3dcba74c8ee8d03d547d9591ca6488f390ac1e6189","src/inferrsi/runspec.py":"dca0952425caf42095ef0c7e2feb8ef4740cc422ecb61e777f203962d9b87709","src/inferrsi/summary_chart.py":"d29023d60f6be804c1b01c9eb73765d4824d6c3bb870fe22c99a24544bc1d8bc","tools/kv_edit_pilot.py":"2e1a2baa9586436d27b3004cb68addc16fa0685bc90961406e31d03f69c3fee3","tools/kv_live_worker.py":"19b0b3765a56b1ae33eef62cac496a793f5844ff42e82bdc6cf21aa76617909c","tools/kv_worker_supervisor.py":"7b2f25148bc0b14536321aa45b434c23424c53858760a708689a28774d585168"},"edit_plan":{"callbacks_sha256":"3653820986096b4dcb328ea5a16a9b4cd4f6bd7185055a73e4c669ad0a0706e4","check_ids":["dev_initial_empty","dev_empty","dev_requires_save","dev_requires_fence","dev_requires_finish","dev_no_save","dev_order_and_nonblocking","dev_reuse","dev_invalid_atomic","development_seed_11","development_seed_23"],"direction":"minimize","files":[{"bytes":5608,"path":"CONTRACT.md","sha256":"85714ad11d360ca885c417cb4d56ef4ecf289e3a0c24696e94808e45661d2ccd"},{"bytes":3386,"path":"candidate.py","sha256":"a8cdf534deead1d9ba8351e436f1019a4608e15daae61e54a971aec13047928d"},{"bytes":11315,"path":"development.json","sha256":"e6da6e89af6a2956cc8f7dfe494b61fe9919900eefac5cb724bb508947dcb56c"},{"bytes":7139,"path":"knowledge/SKILL.md","sha256":"4c3f27459df239f9f4fc971c559d4c9ddfbfebd70507a8a93be8eae59a30b69d"},{"bytes":781,"path":"knowledge/metadata.json","sha256":"b43fc3a7ccae59c664fcdf9ff77962edcc07c2a3df8b59324db551642bd23e23"},{"bytes":13853,"path":"knowledge/references/source-notes.md","sha256":"3665b034594fc8cc767c408002f4e16f8803369242405027c7f37ce6c9ecebe9"},{"bytes":214,"path":"task.json","sha256":"8ee9cc95f07c8c36550f25008862f381a0a0a457bf2f62d4e644c6e38cfad44b"},{"bytes":950,"path":"workbench.md","sha256":"97596737c04f1904941e6eddd0090107af762d2743625260bf2185a35d85df5f"}],"limits":{"benchmark_repetitions":2,"max_benchmarks":4,"max_checks":8,"max_feedback_bytes":8192,"max_seconds":600,"max_source_bytes":65536,"max_writes":8},"metric_key":"elapsed_seconds","metric_unit":"seconds"},"input_token_ceiling":1000000,"model":"claude-opus-5-5","prompt":"Use only the exposed task, contract, starter and fixed visible workbench. Only candidate.py may change. External links are not readable files. Finish after current-revision checks and measurement. Any supplied knowledge is fallible guidance.","schema":"kv-live-worker-v1","suite_sha256":"812ac3e5dd686271d40598e8b8d35faa6f039888f1d36852e571b11b36c600bc"}
35 changes: 35 additions & 0 deletions evidence/kv-live-pilot-20261031/plan/second-attempt/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# One authorized additional synthetic pair — frozen DATA

This versioned v2 plan preserves the original task, complete K, correct/incorrect
controls, verifier, 11 development and 77 hidden traces, and visible/final timing
workloads and thresholds. Equal eight-request budgets and all edit limits are
unchanged. Only approved execution/provenance identities, diagnostics-capable
source, fresh price evidence and the explicit budget exception differ.

The prospective exception fixes PR275's lifetime cap at $350, keeps other PRs at
$200 and day/pilot ceilings at $1,000. The exact old $162.72 unknown-cost claim
and all carryover remain; the single new $162.72 bound would make PR liability
$325.44 and observed daily liability $816.79. No third attempt, refund, reset,
PR switch or automatic retry is allowed. The original first-run cause and billing
remain unknown; its consumed slot does not prove a grant or HTTP delivery.

New model-free qualification is Ready run 41182807900, attempt 1. Its original
actor archive/receipt is retained at the versioned path in `plan.json`; the
actual qualified source closure and both common actor contracts match this plan.
Visible timing failures in scripted qualification remain failures, not model
optimization evidence. This synthetic near-transfer pair is not a held-out
knowledge efficacy, vLLM-conformance or service qualification.

[Fresh public price/accounting evidence](https://github.com/InferMatrixLab/InferRSI/issues/248#issuecomment-6541090217)
ends at 2026-10-31 10:00 UTC. Actual admission needs 1,320 seconds of remaining
runway (no later than 09:38 UTC). This is not a provider price guarantee. The
historical group statement is not renewed account verification. Stop on drift,
uncertainty, expiry or incomplete evidence; do not silently extend this plan.

These files alone grant no request. The exact owner public freeze and reviewed
locator, current-main/run identity, current-host preflight and fresh anchored
ledger admission must still pass. Existing credentials remain confined to the
trusted execute step; neither candidates nor grading receive them. Final
results, partial admission, unknown usage and first failures are retained
without candidate/model reruns to replace missing evidence. The old plan and
its original evidence are not changed or relabelled.
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
{
"plan/second-attempt/A2.json": "4abdd77aecd9c654000226bf80cdb5e77c4310d2d4aab0a41e97b6c3bebb1bdb",
"plan/second-attempt/A3.json": "ab4b0839c5ca6b093b6ea7dd34de2ea4021baadc704dbe993d5d6eb28c57bf95",
"plan/second-attempt/plan.json": "42aceca9ac8350ee1ca5516033bc3e01769ba5f128c60c37ee4cbb17510fc02a",
"plan/second-attempt/README.md": "a2e8146620b865e6593a34b642d0e31d1524d83b04dab9368a23e39df7f26052"
}
Loading
Loading