3 Commits

Author	SHA1	Message	Date
David Koski	9d74afd119	handle partially quantized models (#76) ... * handle partially quantized models - fix for #53 #71 #69 #74 - in order to test the models - I added a default prompt of an appropriate form - while working on the model configuration also added additional stop tokens (#74) - fixed the repetitionPenalty code (#71)	2024-05-28 16:35:11 -07:00
David Koski	bb7bacc077	fix for #2 -- CodeLlama crashes ... - add replacement tokenizer class for unknown tokenizers - fix quantization for models that don't have lm_head quantized Requires https://github.com/ml-explore/mlx-swift/pull/28	2024-02-26 10:38:05 -08:00
David Koski	b6d1e14465	initial commit	2024-02-22 10:41:02 -08:00