Skip to content

Benchmarking: Centralize results layout #1324

Open

Description

@Prajna1999

Is your feature request related to a problem?
Benchmark results are currently scattered between the Netlify page and Drive links/docs, making it difficult to find all the information in one place. This causes confusion and inefficiency for users seeking the latest data.

Describe the solution you'd like

  • Update GitHub Pages to use the eval-run layout for centralized benchmark results.
  • Limit benchmarks to validators exposed in Glific for simplicity and relevance.
  • Ensure the new PII dataset format is consistent with other validator benchmarks for uniformity.
Original issue

Is your feature request related to a problem? Please describe.
GitHub as the single source of truth: Benchmark results currently live in two places: the Netlify page and Drive links/docs. We’ll bring everything together in the GitHub repo and use that as the single source of truth going forward, so there’s no need to look across multiple Drive links for numbers.

Describe the solution you'd like
Use the eval-run layout for GitHub Pages: Update GitHub Pages to follow this layout: https://rococo-cat-a45cd7.netlify.app/ Benchmark results for each validator will be available in one place, making it easier to scan and compare results without opening individual Drive links.

Limit benchmarks to validators exposed in Glific: Since the guardrails repo also needs cleanup, we’ll keep only the validators that are actually exposed in Glific and will be used in future. Validators we don’t plan to use will be removed instead of maintained.

Keep the PII dataset format consistent: We’ll update the new PII dataset to follow the same format as the other validator benchmarks, so the results are consistent across the page.

Activity

  1. self-assigned this
    on Nov 3, 2026
  2. changed the title [-]Guardrails: Github Pages documentation.[/-] [+]Benchmarking: Centralize results layout[/+] on Nov 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions