Skip to content

Commit 3ffb2ef

Browse files
semantic-releasegithub-actions[bot]
authored andcommitted
chore(release): 0.12.13 [skip ci]
1 parent db2067e commit 3ffb2ef

6 files changed

Lines changed: 64 additions & 5 deletions

File tree

‎CHANGELOG.md‎

Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,65 @@
22

33
<!-- version list -->
44

5+
## v0.12.13 (2026-10-13)
6+
7+
### Bug Fixes
8+
9+
- **agent**: Address the context_window review
10+
([#219](https://github.com/UiPath/coder_eval/pull/219),
11+
[`ae02485`](https://github.com/UiPath/coder_eval/commit/ae02485a7a21944e2ee15a0f72131def5f2e425a))
12+
13+
- **agents**: Count Delegate batched tool calls once under max_turns and stamp turns off one
14+
TurnClock ([#222](https://github.com/UiPath/coder_eval/pull/222),
15+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
16+
17+
- **claude-code**: Book only the turn's own usage on a resumed session
18+
([#221](https://github.com/UiPath/coder_eval/pull/221),
19+
[`c9456e5`](https://github.com/UiPath/coder_eval/commit/c9456e58b49174c29f48577507f249eb9e98a94b))
20+
21+
- **delegate**: Count a batched reply's tools as one model call under max_turns
22+
([#222](https://github.com/UiPath/coder_eval/pull/222),
23+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
24+
25+
- **delegate**: Keep the max_turns count in one place and warn when it drifts
26+
([#222](https://github.com/UiPath/coder_eval/pull/222),
27+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
28+
29+
- **delegate**: Stamp the whole turn off one TurnClock
30+
([#222](https://github.com/UiPath/coder_eval/pull/222),
31+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
32+
33+
- **pricing**: Add Haiku 5.5, Sonnet 5.5 and GPT-6.1 Sol, re-verify every row
34+
([#220](https://github.com/UiPath/coder_eval/pull/220),
35+
[`b3ae960`](https://github.com/UiPath/coder_eval/commit/b3ae96033d32f3e88bff68a15219e85372762220))
36+
37+
### Chores
38+
39+
- **no-mistakes/document**: Name Delegate among the TurnClock harnesses in timing docs
40+
([#222](https://github.com/UiPath/coder_eval/pull/222),
41+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
42+
43+
### Documentation
44+
45+
- **delegate**: Count the six Delegate golden-master scenarios in the notes
46+
([#222](https://github.com/UiPath/coder_eval/pull/222),
47+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
48+
49+
- **delegate**: Document the tool-only cut race and relax the live test count
50+
([#222](https://github.com/UiPath/coder_eval/pull/222),
51+
[`db2067e`](https://github.com/UiPath/coder_eval/commit/db2067e94e458796c10cfe5f2b0c0383a3c8db03))
52+
53+
### Features
54+
55+
- **agent**: Cap Pi's context window with agent.context_window
56+
([#219](https://github.com/UiPath/coder_eval/pull/219),
57+
[`ae02485`](https://github.com/UiPath/coder_eval/commit/ae02485a7a21944e2ee15a0f72131def5f2e425a))
58+
59+
- **agent**: Cap the agent's context window with agent.context_window
60+
([#219](https://github.com/UiPath/coder_eval/pull/219),
61+
[`ae02485`](https://github.com/UiPath/coder_eval/commit/ae02485a7a21944e2ee15a0f72131def5f2e425a))
62+
63+
564
## v0.12.12 (2026-10-06)
665

766
### Bug Fixes

‎action.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ inputs:
2525
version:
2626
description: coder-eval version to install from PyPI, or "local" to install from the action checkout
2727
required: false
28-
default: "0.12.12" # <-- kept in sync with releases by release.yml
28+
default: "0.12.13" # <-- kept in sync with releases by release.yml
2929
extras:
3030
description: >-
3131
Comma-separated coder-eval extras (`codex`, `antigravity,litellm`), composed

‎plugins/coder-eval/.claude-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"$schema": "https://json.schemastore.org/claude-code-plugin-manifest.json",
33
"name": "coder-eval",
44
"displayName": "Coder Eval",
5-
"version": "0.12.12",
5+
"version": "0.12.13",
66
"description": "Test whether your Claude Code skills actually trigger, and benchmark any coding agent — author, run, and analyze the eval suite that proves it, locally or as a CI gate.",
77
"author": { "name": "UiPath", "email": "coder-eval@uipath.com", "url": "https://github.com/UiPath/coder_eval" },
88
"homepage": "https://coder-eval.com",

‎pyproject.toml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[project]
22
name = "coder-eval"
3-
version = "0.12.12"
3+
version = "0.12.13"
44
description = "Evaluate, benchmark, and A/B-test AI coding agents (Claude Code, Codex, Gemini/Antigravity, OpenCode, Pi, Delegate) with sandboxed, reproducible YAML task suites."
55
readme = "README.md"
66
license = "Apache-2.0"

‎src/coder_eval/__init__.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,3 @@
11
"""coder_eval - A framework for evaluating AI coding agents."""
22

3-
__version__ = "0.12.12"
3+
__version__ = "0.12.13"

‎uv.lock‎

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)