vllm-project
A high-throughput and memory-efficient inference and serving engine for LLMs
This repo is #94 on the trending list. Run the analysis to see what it does and who it is for.
