sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
A star delta has been computed for 61,707 of 62,640 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 00:31 and 04:32 (BKK).
SGLang is a high-performance serving framework for large language models and multimodal models.
FlashInfer: Kernel Library for LLM Serving
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
A collection of memory efficient attention operators implemented in the Triton language.
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
an open-source, from-first-principles reconstruction of the ideas behind TypeSafe AI's Jev, written in pytorch
Scenic: A Jax Library for Computer Vision Research and Beyond
High Performance KV Cache for LLM Inference
That's all 8 repositories in this period.