initial commit

This commit is contained in:
David Koski
2024-02-22 10:41:02 -08:00
commit b6d1e14465
29 changed files with 3856 additions and 0 deletions

11
Libraries/LLM/README.md Normal file
View File

@@ -0,0 +1,11 @@
# Llama
This is a port of the llama model from:
- https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/models/llama.py
You can use this to load models from huggingface, e.g.:
- https://huggingface.co/mlx-community/Mistral-7B-v0.1-hf-4bit-mlx
See [llm-tool](../../Tools/llm-tool)