Code
basic.py
Usage
1
Set up your virtual environment
2
Install LlamaCpp
Follow the LlamaCpp installation guide and start the server:
3
Install dependencies
4
Run Agent
Save the code above as
basic.py, then run:Stream an agent’s response from a local LlamaCpp server and print it in the terminal.
Set up your virtual environment
Install LlamaCpp
Install dependencies
Run Agent
basic.py, then run: