CmdID

CmdID / Commands

vllm-chat

Generate chat completions via the running API server using the OpenAI-compatible REST API. tldr-pages

On several platforms

Opens CmdID with your command. It is read in your browser and sent nowhere.

Several platforms

from tldr-pages, CC BY 4.0

Send a single chat prompt to the API server and get a response

vllm chat --quick "message"Identify

Chat with a specific model name

vllm chat --model-name model_name --quick "message"Identify

Chat with a custom system prompt

vllm chat --system-prompt "system_prompt" --quick "message"Identify

Chat using a custom API server URL

vllm chat --url http://custom-host:port/v1 --quick "message"Identify

Chat with an API key for authentication

vllm chat --api-key your_api_key --quick "message"Identify

Start an interactive chat session

vllm chatIdentify