jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
A star delta has been computed for 62,252 of 63,106 tracked repositories in this period, and only those can be ranked in it.
A repository missing here has not been measured far enough back yet. That does not mean it did not move.
Star counts measured between 07:59 and 08:03 (BKK).
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
Utilities for debouncing, throttling, rate limiting, and queueing. Non-async and Async.
That's all 2 repositories in this period.