Skip to content

Track Ben and Jelani trial findings and pending decisions #43

Description

@raghubetina

Current audit coordination — 2026-09-26

The Service audit master #663 tracks assignments and researched decisions. Service main is 1e5f4d534712c54a822418c8680658f490b63d18: approved labels/naming cleanup Service #852, stale-evidence routing Service #848 and index-projection documentation correction Service #854 are merged. These are source-integration claims, not a new colleague trial or release.

Approved Board #54 is source-implemented through dockerfiles #7 at 84cf8ecb and Board #59 at 058fb28a. Maintainer source/checks/reports moved to the existing public Dockerfiles repository; all three Board action references pin its merged commit. Current hosted contracts and independent reviews passed. Local ARM64 root materialization, generated-app CI with the planning archive removed (77 ordinary and 9 browser examples), and the relocated image build/smoke passed. The final maintainer default update is merged in dockerfiles #14 at 7888a5d5; #54 is closed. No image was published and no fresh Codespace/provider trial occurred; all local trial resources were cleaned up.

Approved Service application-test work is source-integrated through Service #858 (b8d2831f), Service #862 (f7cf9425), Service #860 (849efa71), and Service #863 (1e5f4d53). These cover independent nested request bindings/denials, meaningful write responses, custom Account registration wiring, and filtered associated-form/profile browser coverage. Review, current-candidate CI and bounded generated-app qualification passed. Service #856/Service #857 are complete; broader Service #678 coverage and the remaining product/provider decisions stay open.

Independent Codex and Claude Opus 5.5/max research is complete and reconciled. New proposals remain decisions, including request timeouts, Permissions-Policy, browser-test ownership, redundant controller setup, Revyl version gating, and owner-doc/Skill routing. #663 links each researched packet; #11 records the owner's minimal public changelog/checkpoint proposal. The supplied Augment article and maintained Fizzy/Discourse examples inform the documentation research; no broad agent-certification gate is proposed.

The 49 colleague observations below remain evidence at their original revisions. The current implementation batch does not silently resolve pending interview, provider, or product decisions.

Earlier reconciliation — 2026-09-23

Drawing Board guidance is delivered through #51/#52; released 0.6.0 pins are in #53. #38 is merged at 296043d8928a6bed71fe548edcf68069aba9b905, fixing attachment with no retained planning helper. One fresh candidate Codespace fixture transition passed root/archived/absent-helper attachment, both real stop/starts and private-browser CRUD. Generated CI passed 103 ordinary/23 system examples with the archive present; a later archive-absent Books run had one first-session timeout among four examples. Service #729 retains that failure. The disposable Codespace was deleted; all 13 pre-existing Codespaces stayed stopped. The testing guide's previously recorded revision and historical trials are unchanged.

Current source checkpoint is Service ceef796f49693288864195656faf5f7687c194f6, Core 373106e81bb19405ac1a69473bcdd6e5c349926d, CLI 38528f4402bc0a75ac855f0226569fbbc92488e3, and Skills catalog 60dae12565d06156968a54f049c678e5d20baab4 (published source a322d1f6). Service #787 completes the remaining changelog audience cleanup. #788 completes another bounded associated/picker/protected-form browser-test increment under #678; broader application coverage remains open. These changes do not close the remaining decisions.

The earlier same-day reconciliation checked Service fe9e5f397474ca275a3f09939a19e6c3ffe1fe99, Skills a5983304ebb918431740d4f7ba7069de3adb8fd7, Drawing Board b48999092c664162204b134188f3796f2fc70075 and Core d3e646e7018419f65b6a29a82edce09d3ce5a86e. The main concrete code-complexity fixes below are integrated through Service #758; #667 and the other consolidated drafts must not be replayed. The remaining form/pagination/translation omission work is now complete in Service #772 at 39531bed71e6d202e8e7bbb0fa1f9008d9d62e7e, with current-head CI, actual Opus 5.5 review and the bounded qualification receipt.

The primary workflow is local. The independently authorized September 23 release deployed Service 4a89f5e3, published CLI/plugin 0.6.0 and selected the catalog. The later changelog/attach merges are source changes. The fixture transition above is not a fresh authoring/Compile/direct-template-publication, unaided sign-in or physical-device autofill trial.

All 49 original observations remain below with their causes and dispositions. The source-integration report owns prior runtime/CI evidence. The September 23 provider fixture transition and earlier local proof remain distinct from unaided full-workflow trials. Service #663 is the implementation-status master.

Remaining completion boundary — 2026-09-23

All 49 original observations are mapped below; they are not all resolved. Primary dispositions: 22 accepted/source-implemented, 3 corrected or superseded remedies with source simplifications complete, 1 accepted but partly implemented (#25 / Service #678), 1 remaining qualification item (#26), 15 pending/unapproved decisions, 2 explicit deferrals, and 5 positive/no-fix observations. Some rows retain separate installed-client or workflow-proof limits. The attach-hook and changelog cleanups beyond these 49 rows are now merged. Service #663 retains the specific browser/agent-discovery qualifications and broader #678 coverage; a completed implementation batch does not close those scopes.

The September 23 provider receipt is integrated through Service #789; it preserves the successful attachment/private-browser observations and the unresolved session-start failure.

Current interview priority — 2026-09-22

The owner prioritized and accepted useful sample data before the first preview under Skills #83, including focused planning/setup/continuation guidance, fresh-agent qualification, and conditional README demo-login discovery. Skills #84 now owns the related early interview invitation for real examples/artifacts, primarily to improve domain modeling and secondarily for appropriate sample reuse. Planning/sample/artifact guidance and its bounded source evaluations are merged in Skills #86. The demo-login README companion Service #770 is merged at 8ccb9a94ec8511c38b683e6b7daf41e449a2a70a; its receipt separates original runtime/browser proof from final integration comparison. The additional seed-edit continuation is complete through Skills #89 at c873e96ad2743f062e23be7981a5da9b674a4676. Skills #84's bounded source scope is complete. Drawing Board alignment is merged in #51/#52 and testing-guide alignment under Skills #83 is delivered; real instruction discovery remains under Service #712. These source and local-evaluation results do not claim a new installed-client or colleague trial. The existing seed emitter/readability work under Service #420 is already integrated through #758. Keep this focused UX work ahead of smaller refinements without turning it into the deferred comprehensive Skill overhaul.

Purpose and decision boundary

Reconcile every observation from Ben’s notes (#23), Jelani’s notes (#26), and Movie Tracker with Claude Design (#28), including the trials 3/4 follow-up.

The owner requested research and decision-ready Issues while away, followed by an interview one decision at a time. New recommendations are pending, not approved implementation. Prior accepted decisions remain accepted. No release/deployment is authorized by this tracker.

“Before the next trial” remains the priority boundary. A supplied development account is sufficient; real registration/recovery email delivery can wait.

Interview order · All 49 observations · Adjacent audit decisions · Evidence boundaries

Ownership

  • This Issue owns the complete colleague-feedback disposition ledger, including authoring, workshop, design, and app follow-ups.
  • Service #663 owns generated-code simplification and already-approved implementation work. Reuse its owners; do not create competing branches.
  • Service #507 and #504 own their stated qualification lanes; Skills #20 owns the broader authoring journey.
  • Source merged, private integration, hosted qualification, and released distribution are different states. “Source fixed” below does not mean colleagues already receive it.

Suggested interview order

Each linked packet has concrete examples, current source/history, primary-source conventions or prior art, alternatives/tradeoffs, an unapproved recommendation, one owner question, and bounded acceptance checks. Closely related observations share a packet; positive feedback and settled implementation do not require another decision.

Priority Decision to settle Research
Source implemented Agent-side Plan consistency check; technical review UI deferred Skills #79, completed in Skills #88
Source implemented Preserve requested behavior through revisions and gaps Skills #80, completed in Skills #88
Next-trial authoring Consequential questions versus a mandatory feature census Research
Deferred / settled for now Keep lifecycle-specific custom validations in notes; revisit FP scope only with the recorded trigger Research
Next-trial authoring Select useful list contents using existing projections Research
Source/local evaluation and guide delivery complete Propose connected reviewed sample data Research, Skills #86
Source/local preview complete; instruction discovery remains Document actual disposable development login Research, Service #770
Guidance and continuation evaluation complete Preserve the development-only seed boundary during continuation Research, Skills #89
Design-assisted trial Read a portable design bundle before repeating an interview Research
Design-assisted trial Bound and measure one complete UI flow first Research
Workshop friction Explain optional supported agent approval modes Research
Workshop friction Verify a browser-terminal link/copy recipe Research
Workshop maintenance Reduce dependency PR volume without losing security maintenance Research
Ordinary dependency work Repair the existing Solid Queue upgrade without adopting optional batches Research
Investigation Diagnose actual Codespaces browser crashes before choosing mitigation Research
Optional polish Use the current canonical Tailwind alias or leave harmless advice alone Research
Trial-app follow-up Choose one calendar-day rule for Habit Tracker Research
Later reminder demo Exercise the real scheduler/worker/local-mail loop Research
Later email preview Try a local inbox before deciding on generic Core adoption Research

Accessibility is a qualification reconciliation, not another request to approve keeping accessibility checks: current-output packet. Reuse the final integration matrix and fill genuine missing states rather than duplicating work.

Complete disposition ledger

“Implemented in source” names an integrated result, not a fresh distribution or end-to-end claim. “Decision ready” records researched alternatives awaiting discussion; accepted work and deliberate deferrals are identified separately. “Preserve” is positive evidence, not an instruction to add a feature. Numbers retain the original 40-item review plus nine trial-3/4 observations.

ID Original observation Current disposition Owner / evidence / qualification limit
1 Manual agent approvals / Auto mode Decision ready Research; latest-client policy already settled by Board #39–41.
2 Dependabot PR flood Decision ready Core #108; proposed grouping/caps, no automatic dependency upgrades.
3 Solid Queue upgrade fails CI Decision ready Research; reuse Core PR #70. Optional batch-table checker failure, not a proven baseline boot failure.
4 Privacy/terms footer Implemented in source Service #741 was consolidated in #758: editable attributed drafts and required signup acceptance. Owner completion of legal facts remains ordinary continuation.
5 Empty data before first preview Source, local qualification and guide delivery complete Skills #83: default connected sample-data proposal within Plan review, verify populated preview and usable development login, preserve development-only samples. Skills #84 completes artifact-grounded modeling and optional appropriate sample reuse through Skills #86 and Service #770; this is no general ingestion claim. Skills #89 completes the separate seed-edit evaluation. Drawing Board #51/#52 and the live testing-guide update complete #83’s delivery; a fresh unaided/Codespaces trial remains separate. Existing emitter cleanup is integrated through Service #758.
6 Return-destination helper complexity Source behavior and guidance merged #647 is complete through PR #648 and Skills #88; contextual defaults and worked exceptions are preserved.
7 Direct New/Edit/form routes fail without return_to Source change merged PR #648 fixes the demonstrated route defect; do not reapply the old patch to newer scoped forms.
8 Enum doctor false positive Accepted workaround / upstream tracked #625 records ordinary presence validation; #688 tracks upstream. Do not block the next trial awaiting upstream.
9 Association doctor baseline failures Source change merged #659 / PR #720; preserve callback-aware deletion selection and its safeguards.
10 Gap discoverability Agent-side check implemented; technical review UI deferred Skills #79 is complete in Skills #88; Skills #77 guidance is delivered through Skills #78; Service #751 owns actual repository-only notes handoff and #712 owns instruction-discovery qualification. Keep one immutable gap receipt.
11 Email verification blocks exploration README source and local preview complete; instruction discovery remains A supplied development account remains sufficient for the trial. Service #770 implements the accepted conditional README login/commands section, coordinated with Skills #83, with the local runtime and final integration evidence linked above. Service #712 retains real instruction-discovery qualification. Production email/verification behavior stays separate.
12 Copying terminal output and URLs Decision ready Research; exact browser/client path still needs qualification.
13 UUID validation helper names Implemented in source #667 was consolidated into #758. Readable private names and collision-aware native enum options; #693/#694 removed obsolete custom validators.
14 UUID associated-form variables Implemented in source #709/#758 replaced UUID form bindings with readable names; #772 completes omission of unused forms/dropdown loaders.
15 Verbose numeric bounds Implemented in source #703/#758 uses native numericality and consolidated compatible bounds.
16 Normalization and proposed squish replacement Implemented in source #704/#758 uses Rails normalizes, selected StripAttributes trimming and squish under the explicitly approved semantics.
17 Opaque JSON-pointer runtime form keys Implemented in source #709/#758 uses conventional scoped routes and readable form state; necessary binding and authorization remain.
18 Successful search continuation Preserve; no fix needed Research; a normal source-editing success, not a mandate to generate every search.
19 Successful enum-field continuation Preserve; no fix needed Research; ordinary migrations/enum work. Native helper simplification from #667 is consolidated into merged #758.
20 Successful image-upload continuation Preserve; no fix needed Research; conventional Active Storage continuation.
21 Redundant .all chains Implemented in source #706/#758 removes redundant .all where equivalent; actual Relation arguments remain.
22 Proposed preload_associations spelling Corrected; source simplification merged That proposed signature is not the pinned Rails API. Ordinary preloads: #683 / PR #722.
23 Herb partial instance-variable warning Implemented in source #709/#758 composes Entity/context partials with explicit strict locals.
24 Tailwind break-words canonical spelling Optional polish decision Research; pinned utilities emit the same CSS. No demonstrated layout defect or need for a new gate.
25 Missing useful CRUD/model tests Implemented bounded coverage; broader expansion open Service #678, #743 and #758 emit RSpec/FactoryBot and useful application specs/disclosures. #776 adds scalar/Account browser forms. #788 adds associated/picker/constructible protected forms with runtime qualification and honest setup disclosures. Nested request/denial, richer Account-profile smoke selection, and broader conditional/query/deletion/browser cases remain in #678.
26 Accessibility contrast warning Historical defect superseded; current qualification Research under #504; replacement UI must be checked in actual selected themes and states.
27 Intermittent Chrome test crashes Decision ready; cause unproven Board #46; distinguish process crashes, Service #728 axe timeouts, and the newly observed #729 first-session creation timeout. No common cause is established.
28 self[:attribute] spelling Disposition settled; obsolete mechanisms removed #686/#693/#694 landed in #758. Bracket reads remain a valid Rails API; no blanket spelling rewrite is required.
29 Unused projection-allowed flag Implemented in source #709/#681/#758 remove unused and always-true projection bookkeeping. Real authorization checks remain.
30 Nil form locals / optional-parent plumbing Implemented in source #709/#758 uses ordinary form inference and readable locals; #772 selects actual form/dropdown consumers while preserving necessary associated-parent context.
31 Inconsistent uniqueness, ordering, Notes Consistency check implemented; broader interview decision remains Skills #81 remains open; Skills #79 is completed in Skills #88. Different authored Plans are not nondeterministic Compilation.
32 Ask about streaks and reminders in every app Decision ready; recommend rejecting mandatory census Skills #81; ask consequential questions, do not invent common features.
33 Daily logging / future-date ambiguity Decision ready Skills #81; distinguish backdating, future entries, duplicate days and product calendar.
34 status == active instead of active? Attribution corrected; generator improvement implemented The screenshot was post-Compile code. #667/#702, consolidated in #758, restore safe ordinary enum APIs and reuse native predicates in supported conditions.
35 Design timing / duplicated interview Decision ready Research; take prior design decisions in before modeling and ask only unresolved questions.
36 ZIP vs direct design sync Decision ready Research; portable handoff works as a fallback, direct authenticated sync remains unqualified.
37 Good design result / backend preserved Preserve; bounded evidence Research; reporter liked the result and source remains Rails; not independent fresh visual qualification.
38 Sixty-minute first design task Decision ready Research; 47-file feature build, not a pure styling/startup benchmark.
39 Demo seeds moved into all-environment file Guidance and bounded continuation evaluation complete Skills #83 preserves development-only sample/account loading and existing-password behavior through Skills #86 and Skills #89. The continuation receipt records three repeat runs, both existing password fingerprints preserved, and a zero-demo production-configuration control; the second-account empty state is DB-only and no nonempty all-environment lookup dataset was exercised. Retain the useful Movie v3 dataset/design result without copying its unguarded production seed placement. No production exposure was observed.
40 Skill claims Rails enums unsupported Source guidance corrected; installed-client discovery remains Skills #80 records completed source reconciliation. Current shared sources teach enum Fields; actual installed-source discovery remains separate under #712 before claiming a new trial.
41 AASM undef loop vs explicit removals Superseded recommendation; simpler implementation merged #686/#758 retains the native AASM API and removes helper suppression plus snapshot/restore plumbing. Do not implement the old explicit-undef recommendation.
42 Unwanted HabitLog Note survived approval Agent-side consistency check source-complete Skills #79 is complete in Skills #88; the new source exercises cover optional-field review, unknown history, and exact removal without re-asking settled questions. No technical review UI was added.
43 Large Plan is hard to inspect in terminal Defer technical review experience Skills #79; pilot users are mostly non-technical, so the immediate investment is agent-side checking. A firstdraft.com review UI remains the long-term path.
44 Active-only rule missing from trial 4 Reconciliation source-complete Skills #80 and #79 are complete in Skills #88. Exercises retain the every-save rule and exact target gap, then preserve creation-only intent in notes when the user revises it.
45 Create-only vs every-save validation Deferred after research — 2026-09-22 Service #756 records the rationale and revisit criteria. Keep FP lifecycle scope deferred for now; use the approved implementation-notes workflow for outside-vocabulary requirements and ordinary post-Compile Rails work. Adding on alone would not generate HabitLog’s cross-record check. Revisit with another representative closed-family rule that benefits from create/update scope.
46 Descriptor-only lists hide date/status Decision ready; capability already exists Skills #82; fresh public scalar-projection Compilation passed. Correct stale Compiler documentation rather than implement a duplicate feature.
47 UTC dashboard vs Central expiry App-specific decision / defect Board #44; Central was a continuation choice, not an explicit original requirement.
48 Tests do not prove live reminder preview Later app qualification decision Board #45; actual queue/scheduler/captured-mail loop is distinct from direct job tests and general next-trial readiness.
49 State-machine and Rails continuation succeed Preserve; no new feature mandate Research; historical runtime/hosted evidence remains scoped; later AASM decisions supersede mechanism-specific conclusions.

Adjacent audit decisions

These are separate from the 49 colleague observations and remain under Service #663:

#752 — conditional destroy feedback is complete through PR #766 at fe9e5f397474ca275a3f09939a19e6c3ffe1fe99. Ordinary actions use destroy!; expected direct/indirect refusal keeps feedback. Final-head CI and Opus 5.5 review pass; the linked issue retains exact runtime/identity proof and the existing empty parent-error limitation. No release is implied.

Ben’s initial dissatisfaction with the plain generated appearance is separate from row 37’s praise for the final adapted design. Rows 35–38 retain that design-workflow context; the newer shared UI and theme work do not establish a fresh unaided visual trial.

Evidence and completion boundaries

Research checkpoint: 2026-09-19. Service b079cd2b74c024f44819893f85eddbb981c6bca4; its consumed Core 623622618d9c013543f93324f10e4f5b0e6a4ac9. At that research checkpoint, Core main was d3e646e7018419f65b6a29a82edce09d3ce5a86e, Skills main was a001a24cc47b5f2c421012f6f5cb38750e14e443, and Drawing Board main was 3e4ba3d3b62de78642be2c46975ed2454c74130f. Testing guide revision: c779f473f0482d057ef79e79944d86d43ce072e9.

Fresh focused proof in this research:

  • Public import → Analysis → Compile accepted one scalar HabitLog index projection: 265 files, 14 ordered semantic gaps unchanged, exact submitted bytes retained. Only the projection was added to the parsed original Plan. This establishes generation, not its final browser presentation. The temporary PostgreSQL cluster was stopped/deleted.
  • A no-database Rails value/job-context probe reproduced UTC/Chicago day disagreement in summer and winter and confirmed native Active Job zone propagation. It is not a new full request/scheduler/email test.
  • Six production JavaScript registry variants were built from the exact consumed Core in a private copy with an unchanged lockfile. Bundle bytes were measured; browser latency, Codespace startup, CSS size and asset-pipeline delivery were not.
  • Exact source, histories, package APIs and current hosted dependency logs were checked. Historical screenshots and earlier runtime suites are explicitly labeled as historical, and incomplete reports are not converted into a proven cause.

The linked Issues own remaining work. Skills #88, merged at a5983304ebb918431740d4f7ba7069de3adb8fd7, completes the accepted pilot consistency/reconciliation guidance with bounded source exercises and local analysis. Package delivery is recorded separately in the linked September 22 release; source evidence alone does not establish an installed-client trial. No fresh installed-client, Codespace, authenticated design-sync, clipboard, reminder-loop, production-email, or deployment observation is claimed for these changes; those boundaries retain their separate owners.

The agent-side consistency decision is already accepted. Prioritize the accepted sample-data/artifact/preview improvements and emitted-code cleanup; reserve remaining interview choices for explicit discussion. Technical review UI remains deferred to firstdraft.com. Implementation sequencing stays in the conversation. Keep later/deferred/rejected outcomes visible here so they do not reappear as accidental requirements.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions