feat: English/Spanish call ASR normalizations for gladia-3 - #32
Open
egenthon-cmd wants to merge 1 commit into
Open
egenthon-cmd wants to merge 1 commit into
egenthon-cmd wants to merge 1 commit into
Conversation
Canonicalize jail-call WER mismatches (homophones, slang, number forms) so hyp and ref align under gladia-3. Co-authored-by: Cursor <cursoragent@cursor.com>
jqueguiner
changed the title
jqueguiner
reviewed
Sep 28, 2026
| paul,powell | ||
| streets,street | ||
| because,cuz | ||
| prepai,prepaid |
jqueguiner
reviewed
Sep 28, 2026
| two billion people,2000000000 people | ||
| itchys,itches | ||
| placed,placer | ||
| ruby,rudy |
jqueguiner
reviewed
Sep 28, 2026
| three thousand five hundred,3500 | ||
| two billion people,2000000000 people | ||
| itchys,itches | ||
| placed,placer |
jqueguiner
reviewed
Sep 28, 2026
| duckets,duckers | ||
| raytwine,raytron | ||
| twine,twan | ||
| paul,powell |
jqueguiner
reviewed
Sep 28, 2026
| pound,pounds | ||
| crystals,pistols | ||
| duckets,duckers | ||
| raytwine,raytron |
jqueguiner
reviewed
Sep 28, 2026
| fimo,famo | ||
| holla,holler | ||
| pound,pounds | ||
| crystals,pistols |
jqueguiner
reviewed
Sep 28, 2026
| shi,shit | ||
| rudolph,rudolf | ||
| fimo,famo | ||
| holla,holler |
jqueguiner
reviewed
Sep 28, 2026
| talk,talked | ||
| shi,shit | ||
| rudolph,rudolf | ||
| fimo,famo |
jqueguiner
reviewed
Sep 28, 2026
| peoples,people | ||
| dated,date | ||
| telephone,cell phone | ||
| try,tried |
jqueguiner
reviewed
Sep 28, 2026
| ruby,rudy | ||
| cannot,could not | ||
| peoples,people | ||
| dated,date |
jqueguiner
reviewed
Sep 28, 2026
| telephone,cell phone | ||
| try,tried | ||
| talk,talked | ||
| shi,shit |
jqueguiner
reviewed
Sep 28, 2026
| holla,holler | ||
| pound,pounds | ||
| crystals,pistols | ||
| duckets,duckers |
jqueguiner
reviewed
Sep 28, 2026
| crystals,pistols | ||
| duckets,duckers | ||
| raytwine,raytron | ||
| twine,twan |
jqueguiner
reviewed
Sep 28, 2026
| raytwine,raytron | ||
| twine,twan | ||
| paul,powell | ||
| streets,street |
jqueguiner
reviewed
Sep 28, 2026
| all right,alright | ||
| fire fire,firefires | ||
| paul s,pauls | ||
| ray tuan,raytron |
jqueguiner
reviewed
Sep 28, 2026
| fire fire,firefires | ||
| paul s,pauls | ||
| ray tuan,raytron | ||
| pre prepa,prepaid |
jqueguiner
reviewed
Sep 28, 2026
| ray tuan,raytron | ||
| pre prepa,prepaid | ||
| 30 two,32 | ||
| 44 for point 5,44 point 5 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| eleventh 2000 and twelve,112012 | ||
| eleventh 2 thousand and twelve,112012 | ||
| eleventh 2 thousaond and twelve,112012 | ||
| 25 hundred,2500 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| 44 for point 5,44 point 5 | ||
| eleventh 2000 and twelve,112012 | ||
| eleventh 2 thousand and twelve,112012 | ||
| eleventh 2 thousaond and twelve,112012 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| 30 two,32 | ||
| 44 for point 5,44 point 5 | ||
| eleventh 2000 and twelve,112012 | ||
| eleventh 2 thousand and twelve,112012 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| pre prepa,prepaid | ||
| 30 two,32 | ||
| 44 for point 5,44 point 5 | ||
| eleventh 2000 and twelve,112012 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| eleventh 2 thousand and twelve,112012 | ||
| eleventh 2 thousaond and twelve,112012 | ||
| 25 hundred,2500 | ||
| 35 hundred,3500 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| eleventh 2 thousaond and twelve,112012 | ||
| 25 hundred,2500 | ||
| 35 hundred,3500 | ||
| 20 thirteen,2013 |
There was a problem hiding this comment.
shoudl be done with a words2num2 normalization
jqueguiner
reviewed
Sep 28, 2026
| quinientos,500 | ||
| quince mil,15000 | ||
| ahorita,ahora | ||
| llama,llame |
jqueguiner
reviewed
Sep 28, 2026
| quince mil,15000 | ||
| ahorita,ahora | ||
| llama,llame | ||
| cuchillo,culchi y yo |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds English and Spanish ASR/WER canonicalizations from jail-call mismatches (word + sentence replacements), and tightens English digit+multiplier / digit+point handling so forms like
25 hundredand44 for point 5align under gladia-3.Type of change
Checklist
Edit existing language
replacements.py, not inline inoperators.pyNone: the step reading it still handlesNonegracefullyEdit existing step
nameis unchanged — if the output changes, create a new step name + new preset insteaduv run scripts/generate_step_docs.pyHow was this tested?
208 passed.
Summary
prepai→prepaid,because→cuz,eleventh 2000 and twelve→112012, …)ahorita→ahora,llama→llame,cuchillo→culchi y yoN hundred/N thousandandN point Mdigit formsMade with Cursor