The ArxivKnowledgeBase reads Arxiv articles, converts them into vector embeddings and loads them to a vector database.
Usage
from agno.knowledge.arxiv import ArxivKnowledgeBase
from agno.vectordb.pgvector import PgVector
knowledge_base = ArxivKnowledgeBase(
queries=["Generative AI", "Machine Learning"],
# Table name: ai.arxiv_documents
vector_db=PgVector(
table_name="arxiv_documents",
db_url="postgresql+psycopg://ai:ai@localhost:5532/ai",
),
)
Then use the knowledge_base
with an Agent
:
from agno.agent import Agent
from knowledge_base import knowledge_base
agent = Agent(
knowledge=knowledge_base,
search_knowledge=True,
)
agent.knowledge.load(recreate=False)
agent.print_response("Ask me about something from the knowledge base")
ArxivKnowledgeBase also supports async loading.
pip install qdrant-client
We are using a local Qdrant database for this example. Make sure it’s running
import asyncio
from agno.agent import Agent
from agno.knowledge.arxiv import ArxivKnowledgeBase
from agno.vectordb.qdrant import Qdrant
COLLECTION_NAME = "arxiv-reader"
vector_db = Qdrant(collection=COLLECTION_NAME, url="http://localhost:6333")
# Create a knowledge base with the ArXiv documents
knowledge_base = ArxivKnowledgeBase(
queries=["Generative AI", "Machine Learning"], vector_db=vector_db
)
# Create an agent with the knowledge base
agent = Agent(
knowledge=knowledge_base,
search_knowledge=True,
)
if __name__ == "__main__":
# Comment out after first run
asyncio.run(knowledge_base.aload(recreate=False))
# Create and use the agent
asyncio.run(
agent.aprint_response(
"Ask me about generative ai from the knowledge base", markdown=True
)
)
Params
Parameter | Type | Default | Description |
---|
queries | List[str] | [] | Queries to search |
reader | ArxivReader | ArxivReader() | A ArxivReader that reads the articles and converts them into Documents for the vector database |
ArxivKnowledgeBase
is a subclass of the AgentKnowledge class and has access to the same params.
Developer Resources