David Koski
0199407d93
LLMEval performance ( #40 )
...
* notes about performance and some performance improvements (don't update the display for every token)
* swift-format
* Update Applications/LLMEval/README.md
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
* Update Applications/LLMEval/README.md
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
---------
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
2024-03-28 12:00:52 -07:00
David Koski
61105bf0c4
use memory limit API ( #13 )
...
* add buffer cache limit
* swift-format
* a more reasonable size
* add memory stats to command line tool, update to final api
* add note about changing models
2024-03-05 15:22:12 -08:00
David Koski
0374e4b073
update documentation
2024-03-01 16:33:49 -08:00
David Koski
b41f14fba7
add LLM evaluator example
...
- runs on iOS and macOS
- downloads a model / tokenizer from hugging face
- evaluates the given prompt
2024-03-01 16:10:00 -08:00
