Skip to content

feat(mars): support flash-attn in mars - #989

Merged
voltjia merged 1 commit into
masterfrom
feat/mars-flash-attn-support
Sep 17, 2026
Merged

voltjia merged 1 commit into
masterfrom
feat/mars-flash-attn-support

Conversation

@spike-zhu

Copy link
Copy Markdown
Contributor

Summary

  • support flash-attn with mars GPU

Motivation

Closes #

Type of Change

  • feat — new feature / new operator / new platform
  • fix — bug fix
  • perf — performance improvement (no behavioral change)
  • refactor — code restructuring without behavior change
  • test — adding or fixing tests only
  • docs — documentation only
  • build / ci — build system or CI configuration
  • chore — tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • MetaX (WITH_METAX)
  • Cambricon (WITH_CAMBRICON)
  • Moore (WITH_MOORE)
  • Ascend (WITH_ASCEND)
  • Mars (WITH_MARS)
  • PyTorch C++ bindings (WITH_TORCH)
  • Build system / CMake / CI
  • Python bindings / user-facing API

Smoke Test Result

paste smoke test output here

Test Results on Supported Platforms

Platform Affected Build / Smoke Result Full Result / Notes
NVIDIA
Iluvatar
MetaX
Cambricon
Moore
Ascend
Full `pytest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

9g8b test:
image

@spike-zhu
spike-zhu requested a review from a team September 16, 2026 08:44
@spike-zhu
spike-zhu force-pushed the feat/mars-flash-attn-support branch from 8a9a354 to 45fd92b Compare September 16, 2026 09:19
@spike-zhu
spike-zhu requested a review from voltjia September 16, 2026 09:25
@spike-zhu spike-zhu self-assigned this Sep 16, 2026
@voltjia
voltjia merged commit dbf2e76 into master Sep 17, 2026
11 of 20 checks passed
@voltjia
voltjia deleted the feat/mars-flash-attn-support branch September 17, 2026 03:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants