Repository navigation
Make the INT8 parity test hardware-tolerant - #44
Merged
Merged
Conversation
The v0.1.0 release run failed test_onnx_export_and_int8_parity: on that runner dynamic INT8 kernels moved one span of the tiny test model, while the same commit passed on the CI runner. FP32 export stays exact; INT8 must keep typed F1 within 0.05 of the reference and leave at least 90% of documents identical, in the spirit of the 1-point release gate.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
v0.1.0release workflow failed intest_onnx_export_and_int8_parity. Dynamic INT8 kernels on that runner moved one span of the tiny test model ((42, 61)→(42, 47)), and the same commit passed on the CI runner. Nothing was built or published.docs/targets.md(≤ 1 point typed-F1 loss on real data). On the 24-document tiny fixture it must keep typed F1 within 0.05 of the reference and leave at least 90% of documents identical.Checks
ruff check,ruff format --check,pytest -m "not slow"pass.