Skip to content

fix(deps): align agent-runtime and agent-interface with agent-eval 0.221.3 - #229

Merged
drewstone merged 4 commits into
mainfrom
fix/one-stack-startup-20261024
Oct 25, 2026
Merged

drewstone merged 4 commits into
mainfrom
fix/one-stack-startup-20261024

Conversation

@drewstone

@drewstone drewstone commented Oct 25, 2026 •

Copy link
Copy Markdown
Contributor

Main has been red since #224/#225: CLI-spawning tests time out at 30 s.

Cause. #224 moved agent-eval to 0.221.3, whose agent-core 0.13.2 and agent-interface 5.7.1 (zod 4.6.6) loaded beside traces' own agent-interface 5.2.0 and agent-runtime 0.318.0 (agent-core 0.11, zod 4.6.5). Every CLI start compiled both graphs. On beelink1, a tiny facts call went from 1.55 to 1.95 CPU-seconds (+25%), with compileSourceTextModule 495 → 755 ms and zod 300 → 683 ms in a CPU profile. At runner load that pushed the spawning tests past 30 s. Same six files at the same load (PSI ~83): b3d8302 105 s, 81/81 passed; main 153 s, 5 failed. No hang: each failing test passes alone.

Fix. Align the direct deps on agent-eval 0.221.3's stack: agent-runtime 0.348.1 and agent-interface 5.7.1. Typecheck is clean with no code change. facts CPU is back to parity with b3d8302 (≈1.75 s both, four runs each); the six files run 81/81 in 71 s.

harness-sessions stays at 0.1.7: 0.2.0's import holds 17.5 MB of heap vs 5.5 MB, which ran the 64 MB bounded-heap Codex rollout test out of memory. With 0.1.7 the Codex adapter's import heap is 12.2 MB (b3d8302: 10.9 MB).

Gate (beelink1, run directly at this SHA because beelink-gate is holding on CPU pressure) follows in a comment.

Run ID: run_66835efe8253ce375017d831711d5b00

agent-eval 0.221.3 beside agent-interface 5.2.0 and agent-runtime 0.318.0
loaded a second agent-interface and agent-core graph: a tiny facts call
took 25% more CPU (1.55 to 1.95 s on beelink1), enough to push CLI-spawning
tests past 30 s on a loaded runner. Aligned, it is back to 1.7 s.
tangletools
tangletools previously approved these changes Oct 25, 2026

@tangletools tangletools left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Auto-approved PR — 9d45f371

Blanket team auto-approval is intentional. This is not a code review.
No automated review runs on this PR. This approval rests on the rule above alone.

tangletools · auto-approval · reason: blanket_auto_approve · 2026-10-25T00:41:00Z

tangletools
tangletools previously approved these changes Oct 25, 2026

@tangletools tangletools left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Auto-approved PR — ac53b7ae

Blanket team auto-approval is intentional. This is not a code review.
No automated review runs on this PR. This approval rests on the rule above alone.

tangletools · auto-approval · reason: blanket_auto_approve · 2026-10-25T00:47:04Z

@drewstone drewstone changed the title fix(deps): align agent-runtime, agent-interface and harness-sessions with agent-eval 0.221.3 fix(deps): align agent-runtime and agent-interface with agent-eval 0.221.3 Oct 25, 2026

@tangletools tangletools left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Auto-approved PR — 8df9d440

Blanket team auto-approval is intentional. This is not a code review.
No automated review runs on this PR. This approval rests on the rule above alone.

tangletools · auto-approval · reason: blanket_auto_approve · 2026-10-25T00:48:59Z

@drewstone

Copy link
Copy Markdown
Contributor Author

Gate at 8df9d44 on beelink1-wsl, run directly in a clean clone at this SHA. beelink-gate held on CPU pressure: load average 131–142, PSI ~80.

  • pnpm install --frozen-lockfile, check:source, typecheck, build, verify:contracts-corpus and check:package all pass.
  • pnpm test: 983 passed, 6 failed and 1 hook failed, all of them timeouts at load 131.
  • The same 7 files run against b3d8302 (before fix(analysis-store): build the store from bytes; agent-eval 0.221.3 #224) back to back, in both orders:
    • load 141: b3d8302 118 s with 1 failed, this head 157 s with 2 failed;
    • load ~90, reversed: this head 99 s with 1 failed, b3d8302 92 s with 1 failed.
  • Bounded-heap Codex rollout test: passes. The adapter's import heap is 12.2 MB (b3d8302: 10.9 MB; with harness-sessions 0.2.0 it was 32 MB, and the test ran out of memory).
  • facts CPU, four runs each: this head 1.33–1.58 + 0.28–0.42 s, b3d8302 1.27–1.51 + 0.32–0.40 s.

@drewstone
drewstone merged commit cf44d25 into main Oct 25, 2026
0 of 2 checks passed
@drewstone drewstone mentioned this pull request Oct 25, 2026
drewstone added a commit that referenced this pull request Oct 25, 2026
chore(release): 1.0.1

Ships #229 (CLI startup parity after the agent-eval 0.221.3 bump), which 1.0.0 was tagged before, plus the release-path fixes #228, #230 and #231. Notes: docs/release-1.0.1.md.

Run ID: run_66835efe8253ce375017d831711d5b00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants