David Koski and GitHub
cedf73421f
make it _much_ easier to run command line tools from the command line ( #49 )
2024-04-09 12:23:42 -07:00
0199407d93
LLMEval performance ( #40 )
...
* notes about performance and some performance improvements (don't update the display for every token)
* swift-format
* Update Applications/LLMEval/README.md
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
* Update Applications/LLMEval/README.md
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
---------
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
2024-03-28 12:00:52 -07:00
David Koski and GitHub
452b49aef0
fixed height for the progress view, produce more tokens ( #33 )
2024-03-19 08:56:37 -07:00
David Koski and GitHub
857a10de91
make the mnist app/library targets match each other ( #32 )
...
* make the mnist app/library targets match each other
* switch mnist tool to 14.2 as well
2024-03-19 08:56:22 -07:00
David Koski and GitHub
0af2efe8a0
switch swift-tokenizers to main, remove some workarounds ( #26 )
...
* switch swift-tokenizers to main, remove some workarounds
- swift-tokenizers is getting a lot of updates and fixes, let's track main for now
- remove some workarounds that are no longer needed
- https://github.com/huggingface/swift-transformers/issues/63
2024-03-14 13:18:57 -07:00
David Koski and GitHub
ac273a14ea
fix float types in Phi (use float16) ( #25 )
...
- per suggestions in #23 ensure that the values that go into the cache are float16
2024-03-14 13:18:40 -07:00
David Koski and GitHub
a1431e7155
scroll to bottom when text is generated ( #24 )
...
- also restore circleci
2024-03-14 13:18:28 -07:00
David Koski and GitHub
0fb74cbfdc
adopt MLXFast.scaledDotProductAttention ( #23 )
2024-03-12 14:04:43 -07:00
David Koski and GitHub
61105bf0c4
use memory limit API ( #13 )
...
* add buffer cache limit
* swift-format
* a more reasonable size
* add memory stats to command line tool, update to final api
* add note about changing models
2024-03-05 15:22:12 -08:00
David Koski and GitHub
430b464c8d
pick up ios build fix ( #15 )
2024-03-04 20:26:37 -08:00
David Koski and GitHub
0f454999a4
Merge pull request #11 from maiqingqiang/feat-qwen2
...
feat: Qwen2 support
2024-03-03 18:37:29 -08:00
David Koski and GitHub
599661774a
Merge pull request #6 from rudro/rudro_fixmain
...
Fix position of @main annotation
2024-02-27 13:32:39 -08:00
David KoskiandGitHub
