Skip to content

Clean up train diff tests #808

Description

@priyakasimbeg

The train diff tests are difficult to run at the moment.

  • Add documentation on how to run them
  • Eliminate IO errors related to writing temporary results to files

Train diff test: https://github.com/mlcommons/algorithmic-efficiency/blob/main/tests/test_traindiffs.py

Activity

  1. mrhimanshu commented on Oct 7, 2026

    @mrhimanshu

    I’m working on this. I’ll make the train-diff output paths isolated per test run instead of sharing fixed /tmp files, let subprocess failures surface before attempting to read missing results, and document the actual repository-root invocation and GPU/runtime requirements. I’ll include focused tests for the path and failure behavior before opening a PR.\n\nDisclosure: I’m using an agent-assisted workflow and will report the tooling and validation in the PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions