zhangshuai/mlx-swift-examples
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Remove Tokenizer wrapper (#28)

Browse Source 
* Remove Tokenizer wrapper

Depends on https://github.com/huggingface/swift-transformers/pull/70

* Update swift-transformers revision
This commit is contained in:
Pedro Cuenca authored and GitHub committed 2024-03-18 09:07:52 -07:00
1 parent 0af2efe8a0
commit 6c270a9d12
3 files changed
+4 -50
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

Tools/llm-tool/LLMTool.swift
+1
View File
@@ -5,6 +5,7 @@ import Foundation
import LLM
import MLX
import MLXRandom
import Tokenizers
@main
struct LLMTool: AsyncParsableCommand {