20 lines
422 B
Markdown
20 lines
422 B
Markdown
# Llama
|
|
|
|
This is a port of several models from:
|
|
|
|
- https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/models/
|
|
|
|
You can use this to load models from huggingface, e.g.:
|
|
|
|
- https://huggingface.co/mlx-community/Mistral-7B-v0.1-hf-4bit-mlx
|
|
|
|
Currently supported model types are:
|
|
|
|
- Llama / Mistral
|
|
- Gemma
|
|
- Phi
|
|
|
|
See [Configuration.swift](Configuration.swift) for more info.
|
|
|
|
See [llm-tool](../../Tools/llm-tool)
|