Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 69.4k 13.2k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 23.2k 4.3k

3. verl-project/verl verl-project/verl Public

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 19k 3.2k

4. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 15.1k 3.6k

5. aliyun/SimAI aliyun/SimAI Public

   C++ 806 134

6. aliyun/aicb aliyun/aicb Public

   HTML 231 51