Llama-LLM

$ curl -fsSL https://ollama.com/install.sh | sh
>>> Installing ollama to /usr/local
>>> Downloading ollama-linux-amd64.tgz
######################################################################## 100.0%
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service.
>>> The Ollama API is now available at 127.0.0.1:11434.
>>> Install complete. Run "ollama" from the command line.
WARNING: No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode.

$ sudo systemctl edit ollama
[Service]
Environment="OLLAMA_HOST=0.0.0.0:11434"

$ sudo apt install -y nvidia-driver-535
$ nvidia-smi

$ sudo systemctl start ollama

$ sudo systemctl stop ollama

$ brew install ollama

$ brew services start ollama
==> Successfully started `ollama` (label: homebrew.mxcl.ollama)

$ brew services restart ollama
Stopping `ollama`... (might take a while)
==> Successfully stopped `ollama` (label: homebrew.mxcl.ollama)
==> Successfully started `ollama` (label: homebrew.mxcl.ollama)

$ brew services stop ollama
Stopping `ollama`... (might take a while)
==> Successfully stopped `ollama` (label: homebrew.mxcl.ollama)

$ ollama pull nomic-embed-text
$ ollama pull qwen2.5:7b
$ ollama pull llama3.2:1b

$ head /opt/homebrew/var/log/ollama.log
Couldn't find '/Users/michaelholzheu/.ollama/id_ed25519'. Generating new private key.
Your new public key is: ...

$ ollama --version
ollama version is 0.13.5

$ ollama list
NAME                       ID              SIZE      MODIFIED
nomic-embed-text:latest    0a109f422b47    274 MB    12 days ago
llama3.2:1b                baf6a787fdff    1.3 GB    12 days ago

$ ollama pull qwen2.5:7b
pulling manifest
pulling 2bada8a74506: 100%
verifying sha256 digest
writing manifest
success

$ ollama list
NAME                       ID              SIZE      MODIFIED
qwen2.5:7b                 845dbda0ea48    4.7 GB    7 minutes ago
nomic-embed-text:latest    0a109f422b47    274 MB    12 days ago
llama3.2:1b                baf6a787fdff    1.3 GB    12 days ago

$ ollama run qwen2.5:7b "Sag Hallo in einem Satz."
HALLO!