Anchen
c27208812d
chore: add repetition_penalty example ( #45 )
2024-04-04 15:15:50 -07:00
Anchen
2d0fdfe3a9
chore(llm-tool): add the top_p option in the llm-tool ( #41 )
...
* chore: add top p option in llm-tool
* chore: wire up the top p with async generate
2024-04-03 07:54:54 -07:00
Anchen
63531bc5fa
feat: add command r model support ( #35 )
...
* feat: add command r model support
2024-03-26 12:43:10 -07:00
John Mai
a94bf79d7e
feat: Support Starcoder2 ( #20 )
...
* feat: Support Starcoder2
2024-03-07 21:28:37 -08:00
John Mai
66d9202360
feat: Qwen2 support
2024-03-03 22:26:28 +08:00
David Koski
82f6a969d4
llm improvements
...
- document the tokenizer used (https://github.com/huggingface/swift-transformers )
- provide a hook for tokenizer configuration, prompt augmentation
- this isn't as rich as the python equivalents but it helps a little
2024-03-01 14:46:32 -08:00
