Popular repositories Loading

1. Skywork Skywork Public

   Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation me…

   Python 1.2k 110

2. Vitron Vitron Public

   NeurIPS 2024 Paper: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing

   Python 418 24

3. MoH MoH Public

   MoH: Multi-Head Attention as Mixture-of-Head Attention

   Python 195 7

4. MoE-plus-plus MoE-plus-plus Public

   MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts

   Python 166 4

5. Skywork-MoE Skywork-MoE Public

   Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models

   127 7

6. Gamba Gamba Public

   Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction

   Python 103 4