Tools

llm

https://llm.datasette.io/en/stable/

uv tool install -U llm

llm logs path
llm logs status

llm install llm-gpt4all
llm -m Meta-Llama-3-8B-Instruct 'Hi!'  # downloads the model

# use model by default on desktop with gtx 1080
llm models default Meta-Llama-3-8B-Instruct

Usage

llm -c "5 single words usable as Python class names"

llm chat
llm -m 4o-mini -s 'code only' -c 'bash test if command on path is available / executable'
llm models

Set up keys

llm keys
llm keys set openai

mistral.ai

simonw/llm-mistral

llm install llm-mistral
llm keys set mistral