Search results

使用FMOE设置了随机种子较难复现实验结果

Status: Open.

#217 In laekov/fastmoe;

· sky836 opened on Jul 12, 2025

有支持华为昇腾芯片的计划吗

Status: Open.

#216 In laekov/fastmoe;

· guoqijun opened on Apr 2, 2025

Detailed documentation about model parallelism

Status: Open.

#214 In laekov/fastmoe;

· ZSL98 opened on Oct 28, 2024

how to run transformer-xl with parallel experts with single gpu?

Status: Open.

#211 In laekov/fastmoe;

· HudashiNeo opened on Sep 10, 2024

Do We support DeepSpeed training? Thanks.

Status: Open.

#210 In laekov/fastmoe;

· lzl-mt opened on Sep 9, 2024

前向传播返回值缺少bal_loss

Status: Open.

#209 In laekov/fastmoe;

· tisgotos opened on Sep 7, 2024

CUDA memory increases after each loss.backward()

Status: Open.

#201 In laekov/fastmoe;

· sreetamasarkar opened on Mar 22, 2024

A bug in switch_gate

Status: Open.

#199 In laekov/fastmoe;

· Heihaierr opened on Mar 7, 2024

About switch_gate

Status: Open.

#198 In laekov/fastmoe;

· Heihaierr opened on Mar 6, 2024

multi-node problem

Status: Open.

#197 In laekov/fastmoe;

· Qianshaowei opened on Mar 4, 2024

Example to run Megatron

Status: Open.

#196 In laekov/fastmoe;

· Juanhui28 opened on Feb 26, 2024

[BUG] AttributeError: module 'fmoe_cuda' has no attribute 'assign_pos_'

Status: Open.

#195 In laekov/fastmoe;

· pangsg opened on Feb 17, 2024