Issues

• inspect-trace: fall back to tool-result text when no span has error status

  NVIDIA-NeMo/eval-author#140 · Filter by author phermosomore opened on Oct 27, 2026

• Proofs: regrade stored runs when only tests/ changed

  NVIDIA-NeMo/eval-author#139 · Filter by author phermosomore opened on Oct 27, 2026

• Audit: check task balance across train, val and test splits

  NVIDIA-NeMo/eval-author#138 · Filter by author phermosomore opened on Oct 27, 2026

• Review Compass Insights against an eval: caught, not caught, or caught but gameable

  NVIDIA-NeMo/eval-author#137 · Filter by author phermosomore opened on Oct 27, 2026

• Research question: counterfactual sensitivity of generated agent evaluations

  enhancement
  NVIDIA-NeMo/eval-author#127 · Filter by author GBX-Max1220 opened on Oct 25, 2026

• Audit: add a provenance probe for trace-authored code copied from the agent's skills or prompt

  NVIDIA-NeMo/eval-author#90 · Filter by author phermosomore opened on Oct 20, 2026
  1