Folkbench/folkbench
AI API 中转站评测排行与切换工具:实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
A star delta has been computed for 61,465 of 62,212 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 17:04 and 08:07 (BKK).
AI API 中转站评测排行与切换工具:实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
[ICML 2026] RoboTwin 2.0 Offical Code Repo
A command-line benchmarking tool
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
Your coding agent paints pixel art in the Aseprite window you already have open. MCP server + skills for Claude Code, omp, Codex, Gemini CLI and Cursor — draws, looks at its work, animates and exports. Gallery and benchmark: pixeli.pebbly.space
Open-source benchmark for browser AI agents on daily tasks.
SkillsBench evaluates how well skills work and how effective agents are at using them.
A unified framework for training, fine-tuning, and evaluating World Action Models
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
Official repository for RoboDojo
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
CodSpeed is the all-in-one performance testing toolkit. Optimize code performance and catch regressions early.
BEHAVIOR-1K: a platform for accelerating Embodied AI research. Join our Discord for support: https://discord.gg/bccR5vGFEx
Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.
ParseBench - A Document Parsing Benchmark for AI Agents
Benchmark local LLM serving by replaying real agent trajectories
Hire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code and OpenAI Codex.
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.
AI 大模型世界,把 556 个大模型拟人化成像素小人的可视化站点。进来就能看到此刻谁最聪明、谁最会写代码、谁最便宜、谁刚发布,往下是国内与国外分区的厂商广场、完整的发布时间线和多维排行榜。搜索认模型名、厂商和能力,输入「多模态」会直接列出全部多模态模型。数据取自 Epoch AI、models.dev、LiveBench 与 Hugging Face,每小时自动同步,所有文案由真实数据生成,不调用任何 LLM。Next.js 静态导出,零后端。
🐰 Bencher - Continuous Benchmarking
High-precision, one-shot and consistent benchmarking framework/harness for Rust. All Valgrind tools at your fingertips.
Lossless AI compression: 33% less GPU memory, bit for bit.
S3 benchmarking tool
Showing 30 of 96 repositories