A star delta has been computed for 62,678 of 63,374 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 02:16 and 17:24 (BKK).
Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.
Bonsai Demo
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Open-source AI coding assistant for VS Code. Code completion, chat, edits and reviews with local or hosted models. Your models, your infrastructure.
Cross-platform on-device AI toolkit
Production ready toolkit to run AI locally
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration - PQC ML-DSA-87 signed releases
Running any GGUF SLMs/LLMs locally, on-device in Android
User friendly GUI for configuring and launching llama.cpp
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
LSP server leveraging LLMs for code completion (and more?)
Typed decisions from unstructured state: one forward pass, zero generated text. Local, deterministic, Jev-compatible. Not affiliated with typesafe.ai.
Control panel for VLLM, Sglang, llama.cpp, exllamav3
Synthetic Autonomic Mind - An AI assistant for everyone.
Instant, controllable, local pre-trained AI models in Rust
ML software (llama.cpp, ComfyUI, Strata, Maya, ...) builds for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
The easiest way to use Ollama in .NET
Showing 30 of 36 repositories
