vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
A star delta has been computed for 61,707 of 62,640 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 00:28 and 06:42 (BKK).
A high-throughput and memory-efficient inference and serving engine for LLMs
Kill shader compilation stutter before you play. Compiles your games' shaders into the GPU driver's cache ahead of time. Windows, NVIDIA and AMD.
Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux
OptiScaler bridges upscaling/frame gen across GPUs. Supports DLSS2+/XeSS/FSR2+ inputs, replaces native upscalers, enables FSR-FG/XeFG on non-FG titles. Supports Nukem mod for DLSSG-to-FSR3 FG.
SuperMimic-UniLab: An Independent reproduction of SuperMimic on UniLab for whole-body humanoid motion tracking.
The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2
Lightweight Armoury Crate alternative for Asus laptops with nearly the same functionality. Works with ROG Zephyrus, Flow, TUF, Strix, Scar, ProArt, Vivobook, Zenbook, Expertbook, ROG Ally, and more.
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
Addon Manager for Lossless Scaling (LSFG): DLSS 5 Neural Rendering, DLSS, XESS and FSR upscalers with motion measured from the frames, one-click installer, addons you install and tune in one window, live GPU and frame-time view. Tested with World of Warcraft: Forever.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
NVIDIA's official DLSS 3/4/4.5 on AMD RDNA3/4 GPUs on Windows and Linux.
nullarc — Metal on AMD Radeon 780M for macOS Tahoe: GPU bring-up, WindowServer compositing at 120 Hz, Metal over Vulkan (Mesa RADV)
RadeonTuner is an easy to use alternative for the AMD Adrenalin Software for users that just want the basics and use the driver only software install type.
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
An agentic system that auto-optimizes LLM workloads on AMD GPUs.
XB_ToolBox: An easy-to-use ComfyUI custom node suite that streamlines workflow generation. Featuring exclusive data-flow logic and pioneering experimental kernel optimizations dedicated to the native AMD GPU ecosystem.
GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
The macOS kext for GPU bug fixes, QoL improvements, and extended hardware support.
Faster FSR 4.1.1 upscaling on Radeon RX 6000 and RX 7000 graphics cards, on Windows and Linux: drop-in DLLs and shader overrides. Exact version keeps AMD's picture byte for byte; optional lossy version is faster still.
memory introspection and reverse engineering hypervisor powered by leveraging Hyper-V
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
A close-to-metal Python API for programming AMD Ryzen™ AI NPUs (AI Engines), built on an open-source MLIR-based compiler toolchain.
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架，Linux和Windows通用，只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
AMD's graph optimization engine.
Showing 30 of 37 repositories
