eagle-hq/EAGLE-4
Official Inference Code of EAGLE-4
A star delta has been computed for 62,252 of 63,106 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 07:51 and 14:25 (BKK).
Official Inference Code of EAGLE-4
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
High Performance Serving Runtime For Interactive Super Intelligence System
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
UniRL is a Framework for Unified Multimodal Model Reinforcement Learning
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率，量化感知训练的精度
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
A workload for deploying LLM inference services on Kubernetes
An agentic system that auto-optimizes LLM workloads on AMD GPUs.
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang performance.
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.
sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD
A foundation model that generates synchronized video and audio in a single model
Control panel for VLLM, Sglang, llama.cpp, exllamav3
One command turns a DGX Spark or ASUS Ascent GX10 into a private AI server: seven measured, pinned AI lanes (text up to 1M tokens, images, video with sound), run from a local cockpit on a laptop or a phone. Nothing leaves the box.
Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
A Datacenter Scale Distributed Inference Serving Framework
Read-only dashboard and rack panel for DGX Spark / ASUS GX10 / MSI EdgeXpert nodes running vLLM or SGLang
High Performance KV Cache for LLM Inference
That's all 26 repositories in this period.