Sweep for auxillary loss and top-k #165
Description
Sweep over auxiliary loss and top-k for the 200M-A50M model. Also try it with different number of experts
{{ message }}
Sweep over auxiliary loss and top-k for the 200M-A50M model. Also try it with different number of experts