Code
cookbook/models/llama_cpp/tool_use_stream.py
Usage
1
Create a virtual environment
Open the
Terminal
and create a python virtual environment.2
Install LlamaCpp
Follow the LlamaCpp installation guide and start the server:
3
Install libraries
4
Run Agent