mlx-swift-examples/Libraries/LLM/README.md

Llama

This is a port of several models from:

• https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/models/

You can use this to load models from huggingface, e.g.:

• https://huggingface.co/mlx-community/Mistral-7B-v0.1-hf-4bit-mlx

Currently supported model types are:

• Llama / Mistral
• Gemma
• Phi

See Configuration.swift for more info.

See llm-tool