Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
You are viewing v1 docs. For the latest documentation, visit docs.agno.com
Agno ScrapeGraphTools enable an Agent to extract structured data from webpages for LLMs in markdown format.
scrapegraph-py library.
pip install -U scrapegraph-py
SGAI_API_KEY environment variable:
export SGAI_API_KEY="YOUR_SGAI_API_KEY"
ScrapeGraphTools to extract specific information from a webpage using the smartscraper functionality.
from agno.agent import Agent
from agno.tools.scrapegraph import ScrapeGraphTools
agent = Agent(
tools=[ScrapeGraphTools(smartscraper=True)],
show_tool_calls=True,
)
agent.print_response("""
"Use smartscraper to extract the following from https://www.wired.com/category/science/:
- News articles
- Headlines
- Images
- Links
- Author
""",
)
| Function | Description |
|---|---|
smartscraper | Extracts structured data from a webpage using an LLM and a natural language prompt. Returns a JSON string of the result or an error. |
markdownify | Converts a webpage to markdown format. Returns the markdown string or an error. |
ScrapeGraphTools constructor.
| Parameter | Type | Default | Description |
|---|---|---|---|
api_key | Optional[str] | None | API key for ScrapeGraph services. If not provided, it defaults to the SGAI_API_KEY environment variable. |
smartscraper | bool | True | Enable the smartscraper tool. |
markdownify | bool | False | Enable the markdownify tool. |
Was this page helpful?