Commit Graph

4 Commits

Author SHA1 Message Date
Rudro Samanta
362f1c8ad8 Fix position of @main annotation
- Also update package versions otherwise things don't compile out of the box
  (you need the version where `callAsFunction` is marked `open`)
2024-02-27 13:02:13 -08:00
David Koski
4fad86d84b split tokenizer code out into new file 2024-02-26 14:42:40 -08:00
David Koski
c86d1c195e partial fix for #1
- handle loading models with different names for the safetensors files (gemma)
- handle merge tokens that can't be split
- organize code into Load/Evaluate
2024-02-26 13:23:21 -08:00
David Koski
b6d1e14465 initial commit 2024-02-22 10:41:02 -08:00