Sambanova

Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.

Authentication

Set your SAMBANOVA_API_KEY environment variable. Get your key from here.

export SAMBANOVA_API_KEY=***

setx SAMBANOVA_API_KEY ***

Example

Use Sambanova with your Agent:

from agno.agent import Agent, RunResponse
from agno.models.sambanova import Sambanova

agent = Agent(model=Sambanova(), markdown=True)

# Print the response in the terminal
agent.print_response("Share a 2 sentence horror story.")

Params

Parameter	Type	Default	Description
`id`	`str`	`"Meta-Llama-3.1-8B-Instruct"`	The id of the Sambanova model to use
`name`	`str`	`"Sambanova"`	The name of this chat model instance
`provider`	`str`	`"Sambanova"`	The provider of the model
`api_key`	`Optional[str]`	`None`	The API key for authenticating with Sambanova (defaults to environment variable SAMBANOVA_API_KEY)
`base_url`	`str`	`"https://api.sambanova.ai/v1"`	The base URL for API requests

Sambanova also supports the params of OpenAI.

Portkey Together

Introduction

Concepts

Other

How to

Authentication

Example

Params

​Authentication

​Example

​Params

Authentication

Example

Params