> ## Documentation Index
> Fetch the complete documentation index at: https://agno-v2.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Llama Cpp

> Run agents against a local llama.cpp server serving `ggml-org/gpt-oss-20b-GGUF` at `http://127.0.0.1:8080/v1`.

| Example | Description |
| - | - |
| [Llama Cpp Basic](https://agno-v2.mintlify.site/examples/models/llama-cpp/basic.md) | Run a local GGUF model with LlamaCpp and print sync and streamed responses. |
| [Retry](https://agno-v2.mintlify.site/examples/models/llama-cpp/retry.md) | Review retry settings and why invalid model IDs cannot reliably exercise the retry path. |
| [Llama Cpp Structured Output](https://agno-v2.mintlify.site/examples/models/llama-cpp/structured-output.md) | Generate a MovieScript Pydantic object from a local LlamaCpp model with output\_schema. |
| [Tool Use](https://agno-v2.mintlify.site/examples/models/llama-cpp/tool-use.md) | Give a local LlamaCpp model web search tools and stream the tool-assisted answer. |


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.