This dataset is used to evaluate the effectiveness of the Growing-MoE learning framework. The dataset contains tasks across computer vision (CV) and natural language processing (NLP). The dataset includes CV tasks such as CIFAR, ImageNet, Cars, and Flowers, as well as NLP tasks including English Wikipedia and GLUE benchmark.