Repository navigation
feat(bench): refactor bed with behaviour, many-branch and refactor question sets - #297
Draft
tonyketcham wants to merge 1 commit into
Conversation
…or question sets build-repo.mjs --refactor adds 10 (1x) or 11 (10x) refactor commits on main that move folders, rename files and symbols, split one module, merge two, and change one behaviour, without touching Proof. Its map is written beside the keymap, outside the repository. New test-bed checks: renamed, staleAnchor, codeAt, anchorDrift, goneText and refAll. New sets: behaviour (16), multibranch (12) and refactor (19). check.mjs refuses these sets on a bed without a refactor map, and run.mjs leaves out the 17 code and branch questions the refactor makes stale. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01DVVnhYL1Bz7mCfEKDoyLMW
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #296.
What
Phase 3 of the code-context benchmark. Two new tests:
Questions no single path names.
behaviour.json(16) asks about behaviour spread across folders, withspreadandcontrolgroups.multibranch.json(12) asks about many branches at once.Code anchors a refactor left stale.
build-repo.mjs --refactoradds 10 (1x) or 11 (10x) refactor commits on main without updating Proof:evict_pages→reclaim_pages,warm_district→prewarm_district,upgrade_steps→migration_steps,hash_blocks→hash_state_blocks);refactor.json(19) asks about the moved code. Its groups arefollow,no-follow,drift,locationandcontrol. The refactor map is written beside the keymap, outside the repository.Details
renamed,staleAnchor,codeAt,anchorDrift,goneTextandrefAll.check.mjsrefuses the new sets on a bed without a 10x refactor map.run.mjsleaves out the 17 code and branch questions the refactor makes stale.--refactor, both existing beds rebuild byte for byte.Checks
check.mjs: ok, 270 questions; ok, 91 questions on the 10x refactor bed; ok, 44 questions onp2-bed-x10.Offline baseline with today's reads
--pathquery on moved code returns no governing records: 10 of 10.The paid baseline comes next.
Generated by Claude Code