CmdID

CmdID / Commands

litert-lm

Run and manage LiteRT-LM models. tldr-pages

On several platforms

Opens CmdID with your command. It is read in your browser and sent nowhere.

Several platforms

from tldr-pages, CC BY 4.0

List all imported models

litert-lm listIdentify

Run a local or imported model interactively

litert-lm run path/to/model.litertlmIdentify

Run a model directly from a Hugging Face repository with a single prompt

litert-lm run --from-huggingface-repo owner/repository model.litertlm --prompt "What is the capital of France?"Identify

Run a model using GPU acceleration

litert-lm run path/to/model.litertlm --backend gpuIdentify

Run a multimodal model with an image attachment

litert-lm run path/to/model.litertlm --vision-backend gpu --attachment path/to/image.jpg --prompt "Describe this image."Identify

Run a model with Python function calling tools via a preset file

litert-lm run path/to/model.litertlm --preset path/to/preset.pyIdentify

Benchmark a model's performance

litert-lm benchmark path/to/model.litertlmIdentify

Start an OpenAI-compatible API server on a specific port

litert-lm serve --port 9379Identify