Skip to content

Commit 54cb94e

Browse files
authored
Merge pull request #61 from danielhua23/a2a_rule_clarify
2 parents 750868c + 54ff613 commit 54cb94e

File tree

1 file changed

+1
-1
lines changed
  • problems/amd_distributed/all2all

1 file changed

+1
-1
lines changed

problems/amd_distributed/all2all/task.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ config:
1515

1616
description: |
1717
18-
You will implement a custom single node all2all kernel optimized for 8xMI300.
18+
You are expected to implement dispatch and simulated moe and combine kernels with intra node communication, refering to reference.py, which jointly made a custom single node all2all kernel optimized for 8xMI300.
1919
You will be given MoEConfig, which is the main hypeparameter, including numbers of experts, experts per token, hidden dim, max number tokens each dp rank and input output dtype
2020
2121
To be explicit, you will be given data of all ranks, naming all_rank_data.

0 commit comments

Comments
 (0)