Code

cookbook/agent_concepts/tools/spider_tools.py
from agno.agent import Agent
from agno.tools.spider import SpiderTools

agent = Agent(
    tools=[SpiderTools()],
    show_tool_calls=True,
    markdown=True,
)
agent.print_response("Crawl https://example.com and extract all links")

Usage

1

Create a virtual environment

Open the Terminal and create a python virtual environment.

2

Install libraries

pip install -U scrapy agno
3

Run Agent