Pinned Loading

1. ai-infra-hpc ai-infra-hpc Public

   Forked from jinbooooom/ai-infra-hpc

   hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等

   Cuda 1

2. InfraTech InfraTech Public

   Forked from CalvinXKY/InfraTech

   分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等

   Jupyter Notebook 1

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

4. tilelang-ascend tilelang-ascend Public

   Forked from tile-ai/tilelang-ascend

   Ascend TileLang adapter

   C++

5. xllm xllm Public

   Forked from xLLM-AI/xllm

   A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

   C++

6. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from xlite-dev/Awesome-LLM-Inference

   📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

   Python