research
∙
04/08/2023
FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement
With the increasing data volume, there is a trend of using large-scale p...
share
research
∙
01/26/2023
SparDA: Accelerating Dynamic Sparse Deep Neural Networks via Sparse-Dense Transformation
Due to its high cost-effectiveness, sparsity has become the most importa...
research
∙
12/29/2021
Dense-to-Sparse Gate for Mixture-of-Experts
Mixture-of-experts (MoE) is becoming popular due to its success in impro...
research
∙
09/02/2020
Architectural Implications of Graph Neural Networks
Graph neural networks (GNN) represent an emerging line of deep learning ...
research
∙
10/19/2018
