3 Commits

Author	SHA1	Message	Date
John Mai	66d9202360	feat: Qwen2 support	2024-03-03 22:26:28 +08:00
David Koski	b41f14fba7	add LLM evaluator example ... - runs on iOS and macOS - downloads a model / tokenizer from hugging face - evaluates the given prompt	2024-03-01 16:10:00 -08:00
David Koski	82f6a969d4	llm improvements ... - document the tokenizer used (https://github.com/huggingface/swift-transformers) - provide a hook for tokenizer configuration, prompt augmentation - this isn't as rich as the python equivalents but it helps a little	2024-03-01 14:46:32 -08:00