Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
You are viewing v1 docs. For the latest documentation, visit docs.agno.com
from agno.agent import Agent
from agno.models.vllm import vLLM
agent = Agent(
model=vLLM(id="deepseek-ai/deepseek-coder-6.7b-instruct"),
description="You are an expert Python developer.",
markdown=True,
)
agent.print_response(
"""Write a Python function that returns the nth Fibonacci number
using dynamic programming."""
)
Create a virtual environment
Terminal and create a python virtual environment.python3 -m venv .venv
source .venv/bin/activate
python3 -m venv .venv
.venv/scripts/activate
Install Libraries
pip install -U agno openai vllm
Start vLLM server
vllm serve deepseek-ai/deepseek-coder-6.7b-instruct \
--dtype float32 \
--tool-call-parser pythonic
Run Agent
python cookbook/models/vllm/code_generation.py
Was this page helpful?