vLLM: high-throughput LLM serving, OpenAI API, quantization.
📥 安装命令
hermes skill install serving-llms-vllm
版本 1.0.0 • 作者:Orchestra Research
vLLM: high-throughput LLM serving, OpenAI API, quantization.
hermes skill install serving-llms-vllm