CmdID

CmdID / Commands

vllm

Serve large language models efficiently and interact with them through an OpenAI-compatible API. tldr-pages

On several platforms

Opens CmdID with your command. It is read in your browser and sent nowhere.

Several platforms

from tldr-pages, CC BY 4.0

Launch an OpenAI-compatible API server for a model

vllm serve model_nameIdentify

Serve a model on a specific host and port

vllm serve model_name --host 0.0.0.0 --port 8000Identify

Start an interactive chat session

vllm chatIdentify

Run batch prompts from a file and write results to a file

vllm run-batch -i input.jsonl -o output.jsonl --model model_nameIdentify

Print environment information for bug reports

vllm collect-envIdentify

List all available subcommands

vllm --helpIdentify