Research review / frameworks

ADK Python 2.15 Separates Can Solve From Solves Every Time

ADK Python 2.15.0 (November 19) adds pass@k and pass^k to multi-run evaluation, per-user and per-session sandbox scoping and buffered session writes. ADK Java 1.15.0 and Claude Code 2.1.330 also shipped this week.

By Sandeep Belgavi · Published 2026-11-22

ADK Python 2.15.0 was released on November 19, 2026. ADK Java 1.15.0 was tagged on November 18, and Claude Code 2.1.330 was published on November 20.

Two reliability numbers instead of one

ADK's multi_run_config now reports pass_at_k (the agent solves a case at least once in k runs) and pass_hat_k (it solves the case on every one of k runs), prints a per-case multi-run table by default and saves MultiRunCaseSummary results. A new tool_parameter_match criterion gives partial credit per argument instead of failing a whole tool call on one mismatch, with in-order, exact or any-order pairing.

Calculation, not a measurement: if a Belgavi's Book Store refund agent succeeds on CASE-7204 with independent probability 0.9 per run, pass@3 is 1 - 0.13 = 0.999 while pass^3 is 0.93 = 0.729. With 10 recorded runs and 9 successes, the unbiased pass^3 estimate is C(9,3)/C(10,3) = 84/120 = 0.70. The first number says the capability exists. The second says how often a customer gets it.

Sandbox scope and session writes

BaseEnvironment methods now receive the calling run's context, and EnvironmentScope (SHARED, USER or SESSION) scopes initialization locks so one session's sandbox startup does not make others wait. The experimental BufferedSessionService buffers session events in memory and flushes them in background batches, keeping slow writes off the turn path. Analysis: buffering trades latency for a window where events exist only in memory; test what a crash during that window loses before relying on it for audit trails.

Behavior changes worth checking on upgrade: run_live now runs every tool call in a background task and returns tool exceptions as error responses rather than ending the live run, and DYNAMIC_INSTRUCTION_ROUTING is on by default, moving dynamic instructions into a user-role message so the static prefix stays cacheable. The interactive Visual Agent Builder is removed from ADK Web; existing Agent Config YAML still runs.

ADK Java and Claude Code

ADK Java 1.15.0 releases FunctionNode workflow steps with typed Java ports, a build-time port check and edge checking by type assignability, along with the classifier routing node and per-run approval covered here earlier. Claude Code 2.1.330 adds sign-in to organizations managed in Anthropic's Enterprise Admin Console and fixes, among others, ExitWorktree deleting a worktree another running session was using, and lost user settings when several processes saved at once.

Sources accessed November 22, 2026. Release-note claims are vendor-stated and were not tested for this digest. Views are my own and do not represent any employer, past or present.

Sources and evidence

ADK Python 2.15 reports pass@k and pass^k separately, scopes sandboxes per user or session and buffers session writes; ADK Java 1.15 ships typed FunctionNode ports; Claude Code 2.1.330 fixes a cross-session worktree deletion.