David Koski
dfc9f2fc01
apply swift-format
2024-03-03 18:40:49 -08:00
John Mai
66d9202360
feat: Qwen2 support
2024-03-03 22:26:28 +08:00
David Koski
7b746cb89c
allow alternate location for tokenizer
2024-03-01 23:27:03 -08:00
David Koski
ff7a615db7
improve phi prompt -- partial fix for #9
2024-03-01 22:45:01 -08:00
David Koski
c49dd73c28
swift-format, circleci setup
2024-03-01 16:10:34 -08:00
David Koski
b41f14fba7
add LLM evaluator example
...
- runs on iOS and macOS
- downloads a model / tokenizer from hugging face
- evaluates the given prompt
2024-03-01 16:10:00 -08:00
David Koski
2157333905
swift-format!
2024-03-01 14:47:43 -08:00
David Koski
82f6a969d4
llm improvements
...
- document the tokenizer used (https://github.com/huggingface/swift-transformers )
- provide a hook for tokenizer configuration, prompt augmentation
- this isn't as rich as the python equivalents but it helps a little
2024-03-01 14:46:32 -08:00
