1
Chunk the information
Break down the knowledge into smaller chunks to ensure our search query
returns only relevant results.
2
Load the knowledge base
Convert the chunks into embedding vectors and store them in a vector
database.
3
Search the knowledge base
When the user sends a message, we convert the input message into an
embedding and “search” for nearest neighbors in the vector database.
- Performing a vector similarity search to find semantically similar content.
- Conducting a keyword-based search to identify exact or close matches.
- Combining the results using a weighted approach to provide the most relevant information.
⚡ Asynchronous Operations
Several vector databases support asynchronous operations, offering improved performance through non-blocking operations, concurrent processing, reduced latency, and seamless integration with FastAPI and async agents.
Supported Vector Databases
The following VectorDb are currently supported:Azure Cosmos DB MongoDB vCore
Azure Cosmos DB with MongoDB vCore vector search
Cassandra
Apache Cassandra vector database
Chroma
Open-source embedding database
ClickHouse
Fast analytical database with vector search
Couchbase
NoSQL database with vector search*
LanceDB
Fast, local vector database*
LangChain
LangChain vector store integration
LightRAG
Lightweight RAG framework
LlamaIndex
LlamaIndex vector store integration
Milvus
Open-source vector database
MongoDB
MongoDB Atlas vector search
PgVector
PostgreSQL with vector extension*
Pinecone
Managed vector database service*
Qdrant
High-performance vector database
Redis
Redis with vector search capabilities
SingleStore
Real-time analytics database
SurrealDB
SurrealDB vector database
Upstash
Serverless Redis with vector search
Weaviate
Open-source vector database
Popular Choices by Use Case
Development & Testing
LanceDB - Fast, local, no setup required
Production at Scale
PgVector - Reliable, scalable, full SQL support
Managed Service
Pinecone - Fully managed, no operations overhead
High Performance
Qdrant - Optimized for speed and advanced features