* phi3

Co-authored-by: David Koski <dkoski@apple.com>
This commit is contained in:
Awni HannunandDavid Koski authored and GitHub committed 2024-04-24 09:31:01 -07:00
1 parent 6c0b66f90a
commit b951b78eb2
7 files changed
+284 -8

No files matched your search

+1 -1
View File
@@ -157,7 +157,7 @@ class LLMEvaluator {
/// this controls which model loads -- phi4bit is one of the smaller ones so this will fit on
/// more devices
let modelConfiguration = ModelConfiguration.phi4bit
let modelConfiguration = ModelConfiguration.phi34bit
/// parameters controlling the output
let generateParameters = GenerateParameters(temperature: 0.6)