| Example | Description |
|---|---|
| Vllm Basic | Cookbook example for vllm/basic.py. |
| Code Generation | Run vLLM model: vllm serve deepseek-ai/deepseek-coder-6.7b-instruct —dtype float32 —tool-call-parser pythonic. |
| Db | Vllm model example. |
| Memory | Prerequisites: 1. |
| Retry | Example demonstrating how to set up retries with vLLM. |
| Vllm Structured Output | Cookbook example for vllm/structured_output.py. |
| Build a Web Search Agent using xAI | Build a web search agent using vLLM. |
vLLM
Vllm
vLLM is a fast and easy-to-use library for running LLM models locally.