Knowledge
Website Knowledge Base
WebsiteKnowledge is a knowledge base class that allows you to load and query data from websites.
Parameter | Type | Default | Description |
---|---|---|---|
urls | List[str] | [] | List of URLs to scrape |
reader | Optional[WebsiteReader] | None | Reader to scrape website content |
max_depth | int | 3 | Maximum depth of links to follow when scraping |
max_links | int | 10 | Maximum number of links to follow when scraping |