Skip to content

Conversation

WYB27
Copy link
Collaborator

@WYB27 WYB27 commented Sep 17, 2025

修复glm4moe tp+ep+sp不能正常训练的问题

已修复:

  1. 开sp后的reshape报错问题
  2. 开sp后ep内部维度报错问题

todo:
_cal_seq_aux_loss函数,为适配sp维度而临时改动,未验证正确性,当前场景暂不需要计算aux_loss,后续需要时需验证正确性

Copy link

paddle-bot bot commented Sep 17, 2025

Thanks for your contribution!

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 0% with 25 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (develop@53230c0). Learn more about missing BASE report.

Files with missing lines Patch % Lines
paddleformers/transformers/moe_gate.py 0.00% 18 Missing ⚠️
paddleformers/transformers/glm4_moe/modeling.py 0.00% 7 Missing ⚠️

❌ Your patch status has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files
@@            Coverage Diff             @@
##             develop    #2621   +/-   ##
==========================================
  Coverage           ?   28.59%           
==========================================
  Files              ?      308           
  Lines              ?    54024           
  Branches           ?        0           
==========================================
  Hits               ?    15450           
  Misses             ?    38574           
  Partials           ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants