So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...
For example usage, we encourage you to checkout the scripts in the examples folder and in the tests folder. The examples folder contains two scripts showing typical usage. The script simpleExample.py ...