3 Commits

Author	SHA1	Message	Date
Anchen	2d0fdfe3a9	chore(llm-tool): add the top_p option in the llm-tool (#41) ... * chore: add top p option in llm-tool * chore: wire up the top p with async generate	2024-04-03 07:54:54 -07:00
Anchen	3314e20a24	chore: add top_p sampling example (#34)	2024-03-26 12:44:13 -07:00
David Koski	c86d1c195e	partial fix for #1 ... - handle loading models with different names for the safetensors files (gemma) - handle merge tokens that can't be split - organize code into Load/Evaluate	2024-02-26 13:23:21 -08:00