CmdID

CmdID / Commands

llama-cli

Command-line interface for LLM inference. tldr-pages

On Linux

Opens CmdID with your command. It is read in your browser and sent nowhere.

Linux

from tldr-pages, CC BY 4.0

Start up LLM model and interface

llama-cli --model path/to/modelIdentify

Start with setup prompt context size

llama-cli --model path/to/model --ctx-size numberIdentify

Start with set offload number of layer gpu layers

llama-cli --model path/to/model --n-gpu-layers autoIdentify

Start with sending content as system prompt from a file

llama-cli --model path/to/model --system-prompt-file path/to/promptIdentify

Start with sending content in file as first prompt

llama-cli --model path/to/model --file path/to/promptIdentify