Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs-v1.agno.com/llms.txt

Use this file to discover all available pages before exploring further.

Many providers like Together, Groq, Nebius, Sambanova, xAI, etc support the OpenAI API format. Use the OpenAILike model to access them by replacing the base_url.

​
Example

from os import getenv
from agno.agent import Agent, RunResponse
from agno.models.openai.like import OpenAILike

agent = Agent(
    model=OpenAILike(
        id="mistralai/Mixtral-8x7B-Instruct-v0.1",
        api_key=getenv("TOGETHER_API_KEY"),
        base_url="https://api.together.xyz/v1",
    )
)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

​
Params

ParameterTypeDefaultDescription
idstr"not-provided"The name of the model to be used for generating responses.
namestr"OpenAILike"The name of this chat model instance.
api_keystr"not-provided"The API key for authenticating requests to the service.
override_system_roleboolFalseWhether to override the default system role.
system_message_rolestr"system"The role to use for system messages.
OpenAILike also support all the params of OpenAIChat