jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
A star delta has been computed for 52,827 of 63,382 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 17:18 and 17:21 (BKK).
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Utilities for debouncing, throttling, rate limiting, and queueing. Non-async and Async.
That's all 2 repositories in this period.