IOS app which runs LLM inference locally, i.e. on device.
Tested with:
The models must be converted to a format compatible with Core ML, see llm-to-coreml.
| Name | Name | Last commit date | ||
|---|---|---|---|---|
IOS app which runs LLM inference locally, i.e. on device.
Tested with:
The models must be converted to a format compatible with Core ML, see llm-to-coreml.