update documentation

This commit is contained in:
David Koski
2024-03-01 16:33:49 -08:00
parent 807c8136c0
commit 0374e4b073
2 changed files with 14 additions and 1 deletions

View File

@@ -17,6 +17,7 @@ Some notes about the setup:
- this downloads models from hugging face so LLMEval -> Signing & Capabilities has the "Outgoing Connections (Client)" set in the App Sandbox
- LLM models are large so this uses the Increased Memory Limit entitlement on iOS to allow ... increased memory limits for devices that have more memory
- The Phi2 4 bit model is small enough to run on some iPhone models
- this can be changed by editing `let modelConfiguration = ModelConfiguration.phi4bit`
### Troubleshooting