David Koski 9d74afd119 handle partially quantized models (#76) ...

* handle partially quantized models

- fix for #53 #71 #69 #74
- in order to test the models
	- I added a default prompt of an appropriate form
	- while working on the model configuration also added additional stop tokens (#74)
- fixed the repetitionPenalty code (#71)

2024-05-28 16:35:11 -07:00

9.3 KiB

Raw Blame History

View Raw