Niko1221/Strata
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
This period is measured from GitHub’s rebuilt star history — one point per week — because our own daily snapshots do not reach this far back yet. Period boundaries can be off by up to half a week; the repository page prints the real start date for each period. So far the history has been fetched for 12,567 of 62,640 tracked repositories, and only those can be ranked in this period.
Star counts measured between 00:29 and 04:33 (BKK).
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the world.
Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
AirLLM 2.8T LLM inference with single 4GB GPU
Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Fully automatic censorship removal for language models
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LLM inference in C/C++
A high-throughput and memory-efficient inference and serving engine for LLMs
VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
非自回归System 1决策引擎，专为结构化类型决策场景设计 DeepOpen Multilingual, non-autoregressive System 1 decision engine.
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.
High-Quality Voice Cloning TTS for 600+ Languages
A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.
SGLang is a high-performance serving framework for large language models and multimodal models.
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Millisecond decisions, any domain: a 0.8B open "System 1" model that picks between your options with calibrated probabilities. One base, swappable LoRA adapters, on your own hardware.
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Run DLSS 5 Neural Rendering on your AMD GPU. Magic!
Hundreds of models & providers. One command to find what runs on your hardware.
Infrastructure for continually self‑improving agents
The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.
A native control plane for Claude Code, Codex, Cursor, Devin and other coding agents.
Open-source State-of-the-art TTS model which runs on a CPU 😻
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
LLM Inference Engine for Metal, CUDA and Vulkan.
Showing 30 of 263 repositories