David Koski
430b464c8d
pick up ios build fix ( #15 )
2024-03-04 20:26:37 -08:00
John Mai
66d9202360
feat: Qwen2 support
2024-03-03 22:26:28 +08:00
David Koski
9cea67f7bc
add missing path to Info.plist -- fix #10
2024-03-01 22:20:29 -08:00
David Koski
82b86e4484
fix https://github.com/ml-explore/mlx-swift-examples/issues/8 -- do not specify info plist location
2024-03-01 19:49:19 -08:00
David Koski
2efd5575c7
remove dev team -- this needs to be supplied
2024-03-01 16:58:48 -08:00
David Koski
b41f14fba7
add LLM evaluator example
...
- runs on iOS and macOS
- downloads a model / tokenizer from hugging face
- evaluates the given prompt
2024-03-01 16:10:00 -08:00
David Koski
79e0620891
add MNIST training example
2024-03-01 15:55:36 -08:00
David Koski
82f6a969d4
llm improvements
...
- document the tokenizer used (https://github.com/huggingface/swift-transformers )
- provide a hook for tokenizer configuration, prompt augmentation
- this isn't as rich as the python equivalents but it helps a little
2024-03-01 14:46:32 -08:00
Rudro Samanta
362f1c8ad8
Fix position of @main annotation
...
- Also update package versions otherwise things don't compile out of the box
(you need the version where `callAsFunction` is marked `open`)
2024-02-27 13:02:13 -08:00
David Koski
4fad86d84b
split tokenizer code out into new file
2024-02-26 14:42:40 -08:00
David Koski
c86d1c195e
partial fix for #1
...
- handle loading models with different names for the safetensors files (gemma)
- handle merge tokens that can't be split
- organize code into Load/Evaluate
2024-02-26 13:23:21 -08:00
David Koski
b6d1e14465
initial commit
2024-02-22 10:41:02 -08:00