Popular repositories Loading

1. xllm xllm Public

   Forked from xLLM-AI/xllm

   A high-performance inference engine for LLMs, optimized for diverse AI accelerators.

   C++

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

3. ssd ssd Public

   Forked from tanishqkumar/ssd

   A lightweight inference engine supporting speculative speculative decoding (SSD).

   Python

4. HiCache HiCache Public

   Forked from fenglang918/HiCache

   HiCache: Hermite Polynomial-based Feature Cache for diffusion inference

   Python

5. flux flux Public

   Forked from black-forest-labs/flux

   Official inference repo for FLUX.1 models

   Python

6. edge-dit.cpp edge-dit.cpp Public

   Forked from THU-MIG/edge-dit.cpp

   edge-dit.cpp — a native C/C++ inference engine for Diffusion Transformers (DiT), designed for local and resource-constrained devices with automatic VRAM-aware precision, placement, and offloading.

   C++