Commit Graph

3 Commits

Author SHA1 Message Date
David Koski
82f6a969d4 llm improvements
- document the tokenizer used (https://github.com/huggingface/swift-transformers)
- provide a hook for tokenizer configuration, prompt augmentation
	- this isn't as rich as the python equivalents but it helps a little
2024-03-01 14:46:32 -08:00
David Koski
5a83d7d92b fix broken links, clarify documentation 2024-02-22 12:46:44 -08:00
David Koski
b6d1e14465 initial commit 2024-02-22 10:41:02 -08:00