3 Commits

Author	SHA1	Message	Date
John Mai	a94bf79d7e	feat: Support Starcoder2 (#20) ... * feat: Support Starcoder2	2024-03-07 21:28:37 -08:00
John Mai	66d9202360	feat: Qwen2 support	2024-03-03 22:26:28 +08:00
David Koski	82f6a969d4	llm improvements ... - document the tokenizer used (https://github.com/huggingface/swift-transformers) - provide a hook for tokenizer configuration, prompt augmentation - this isn't as rich as the python equivalents but it helps a little	2024-03-01 14:46:32 -08:00