#moe

Ai2 releases technical report on supercharging Olmo-core for MoE training

Ai2 has published a technical report titled 'Supercharging Olmo-core for Efficient and Scalable MoE Training,' focusing on scalable and efficient MoE model training.