| Example | Description |
|---|---|
| Llama Cpp Basic | Cookbook example for llama_cpp/basic.py. |
| Retry | Example demonstrating how to set up retries with llama.cpp. |
| Llama Cpp Structured Output | Cookbook example for llama_cpp/structured_output.py. |
| Tool Use | Llama Cpp model example. |
Llama.cpp
Llama Cpp
Run your chat model using Llama CPP. For the examples below make sure to download ggml-org/gpt-oss-20b-GGUF. Please also make sure that the model is reachable at `http://127.0.0.