Popular repositories Loading

1. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. xllm xllm Public

   Forked from xLLM-AI/xllm

   A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

   C++

4. moudles moudles Public

   some self code of LLMs

   Python