Remote CI coverage for the OBR bridge and ScoreResult#23
Merged
Conversation
- Replace the stale 'OBR arm pending' remote test (score_reform model=obr no longer errors — the bridge landed in #22) with the corp-tax refusal contract: a corporation_tax reform must be refused with a pointer to the direct obr_shock TCPRO lever. - Add a fast post-deploy remote test for score_reform(model='microsim'): sign of the costing, ScoreResult coherence, distributional block. - Add a slow end-to-end remote test of the full bridge pipeline (microsim costing -> HHDI path -> OBR second-round effects) with sign and magnitude gates; runs in the scheduled full validation. - Bump validate-deployment timeout 20->35 min: the slow leg gains the bridge test and already timed out once at 20. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #22: the post-deploy smoke suite still contained the stale 'OBR arm pending' test, which now fails against the deployed bridge. This PR replaces it with the new refusal contract and adds real coverage for the shipped functionality.
test_score_reform_obr_errors_actionablyexpectedscore_reform(model='obr')to error with a pending-bridge pointer; replaced withtest_score_reform_obr_refuses_corp_tax_actionably(corp-tax reforms must be refused with theobr_shockTCPRO pointer).score_reform(model='microsim')— costing sign, ScoreResult block coherence, distributional data present.--runslow): the complete OBR reform contract: microsim static costing path in, second-round effects out #9 pipeline end-to-end against the hosted server — costing sign, HHDI path sign, GDP falls, magnitude within a demand-multiplier sanity band.Note: GitHub Actions has no
HUGGING_FACE_TOKENsecret, so the hosted server (whose Modal secret exists) is deliberately the only place the full bridge can be exercised in CI — these remote tests are that coverage.🤖 Generated with Claude Code