Skip to content

Commit 54ff613

Browse files
committed
clarify rules
1 parent ed05357 commit 54ff613

File tree

1 file changed

+1
-1
lines changed
  • problems/amd_distributed/all2all

1 file changed

+1
-1
lines changed

problems/amd_distributed/all2all/task.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ config:
1515

1616
description: |
1717
18-
You are expected to implement dispatch and simulated moe and combine kernels with intra node communication, which jointly made a custom single node all2all kernel optimized for 8xMI300
18+
You are expected to implement dispatch and simulated moe and combine kernels with intra node communication, refering to reference.py, which jointly made a custom single node all2all kernel optimized for 8xMI300.
1919
You will be given MoEConfig, which is the main hypeparameter, including numbers of experts, experts per token, hidden dim, max number tokens each dp rank and input output dtype
2020
2121
To be explicit, you will be given data of all ranks, naming all_rank_data.

0 commit comments

Comments
 (0)