Skip to content

feat(hetero_humanoid): add gait symmetry rewards and tune rough terrain locomotion - #3

Merged
modanesh merged 5 commits into
modanesh:mainfrom
kaidalisohaib:feature/gait-symmetry-rough-terrain
Oct 6, 2026
Merged

modanesh merged 5 commits into
modanesh:mainfrom
kaidalisohaib:feature/gait-symmetry-rough-terrain

Conversation

@kaidalisohaib

Copy link
Copy Markdown
Contributor

Note

Stacked Pull Request: This PR is stacked on top of the Unitree H2 integration #2 PR (feature/h2-integration). Please review and merge that PR first.

Description

This pull request introduces gait symmetry rewards and locomotion stability improvements across the heterogeneous humanoid suite (cassie, digit, g1, h1, h2) on rough terrain (pyramids, inverted pyramids, and discrete obstacles):

  1. Reward Tensor Slicing Fix: Fixed environment ID indexing across custom MDP reward functions in hetero_humanoid_rewards.py (feet_air_time_biped, feet_air_time_symmetry_biped, feet_slide, no_fly, undesired_contacts, desired_contacts) to properly slice contact sensor buffers using robot_env_ids.
  2. Bipedal Gait Symmetry: Integrated feet_air_time_symmetry_biped reward penalties across all 5 bipedal humanoids (Cassie, Digit, G1, H1, H2) to prevent single-leg favoring/limping and encourage synchronized alternating footfall cycles during straight walking.
  3. Rough Terrain Traversability & Terminations:
    • Relaxed overly aggressive orientation_limit terminations for Cassie and H2 in robot_configs.py that previously triggered false-positive resets when pitching on steep stairs or ramps.
    • Tuned feet_air_time thresholds and weights to incentivize stepping over rough terrain obstacles.
  4. H2 Locomotion Refinements:
    • Decoupled hip roll and hip yaw deviation penalties (joint_deviation_hip_roll_h2 and joint_deviation_hip_yaw_h2) to prevent inward knee and lateral leg drift while maintaining yaw responsiveness.
    • Softened shoulder pitch penalty to enable natural sagittal arm swing during forward locomotion.
    • Refined action_scale_h2 = 0.25 for smoother joint position setpoint tracking.

Fixes # (issue)

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

Visuals

Cassie Digit
cassie.mp4
digit.mp4
H1 H2
h1.mp4
h2.mp4
G1
g1.mp4

Checklist

  • I have read and understood the contribution guidelines
  • I have run the pre-commit checks with ./isaaclab.sh --format
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the changelog and the corresponding version in the extension's config/extension.toml file
  • I have added my name to the CONTRIBUTORS.md or my name already exists there

…in locomotion

- Add gait_symmetry reward terms to Cassie, Digit, G1, H1, and H2 to eliminate limping and promote symmetric bipedal gaits
- Fix tensor indexing in hetero_humanoid_rewards.py to slice contact sensor data by robot_env_ids
- Tune feet air time thresholds, action scales, and joint deviation penalties for rough terrain
- Relax termination limits (orientation_limit, min_root_height) in robot_configs.py to prevent premature termination on stairs and ramps
@github-actions github-actions Bot added documentation Improvements or additions to documentation enhancement New feature or request asset labels Sep 28, 2026
@modanesh
modanesh merged commit 355f9ef into modanesh:main Oct 6, 2026
4 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

asset documentation Improvements or additions to documentation enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants