> ## Documentation Index
> Fetch the complete documentation index at: https://agno-v2.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# LiteLLM OpenAI

> Use LiteLLM with Agno through an OpenAI-compatible proxy server.

## Proxy Server Integration

LiteLLM can also be used as an OpenAI-compatible proxy server, allowing you to route requests to different models through a unified API.

### Starting the Proxy Server

First, install LiteLLM with proxy support and the `openai` package, which `LiteLLMOpenAI` uses as its client:

```shell theme={null}
uv pip install 'litellm[proxy]' openai
```

Start the proxy server:

```shell theme={null}
litellm --model gpt-5-mini --host 127.0.0.1 --port 4000
```

### Set Your API Key

`LiteLLMOpenAI` requires the `LITELLM_API_KEY` environment variable to authenticate requests to the proxy server:

```shell theme={null}
export LITELLM_API_KEY=xxx
```

### Using the Proxy

The `LiteLLMOpenAI` class connects to the LiteLLM proxy using an OpenAI-compatible interface:

```python theme={null}
from agno.agent import Agent
from agno.models.litellm import LiteLLMOpenAI

agent = Agent(
    model=LiteLLMOpenAI(
        id="gpt-5-mini",  # Model ID to use
    ),
    markdown=True,
)

agent.print_response("Share a 2 sentence horror story")
```

### Configuration Options

The `LiteLLMOpenAI` class accepts the following parameters:

| Parameter | Type | Description | Default |
| - | - | - | - |
| `id` | str | Model identifier | "gpt-4o" |
| `name` | str | Display name for the model | "LiteLLMOpenAI" |
| `provider` | str | Provider name | "LiteLLM" |
| `api_key` | Optional\[str] | API key (falls back to LITELLM\_API\_KEY environment variable) | None |
| `base_url` | str | URL of the LiteLLM proxy server | "[http://0.0.0.0:4000](http://0.0.0.0:4000)" |

`LiteLLMOpenAI` is a subclass of the [OpenAILike](https://agno-v2.mintlify.site/models/providers/openai-like.md) class and has access to the same params.

## Examples

> [!NOTE]
>
> View more examples [here](https://agno-v2.mintlify.site/models/providers/gateways/litellm-openai/usage/basic-stream.md).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.