More and more iOS apps are using local ai models for running functions and chats to power advanced features and currently each downloads and stores their own large model to do this. If you have 3 or 4 apps using 2GB open models that’s 6 to 8 gigabytes of storage wasted.
Why not share the models? So I created a swift package to do this. It creates a common methodology to store and download open models in your user files, so when a new app needs an ai model it can point it to the share folder. It will then check to see if a compatible model is already downloaded, saving data and time.
https://github.com/Tschucker/SharedModelKit
The SharedModelKit handles the organization but the app you build is responsible for running the model with an engine. As there are already many options for swift packages to run ai engines, I have also created an example chat app that uses and implements the SharedModelKit package and a couple of example ai engines to help you design your app.
https://github.com/Tschucker/SharedModelChat
This is still a big work in progress but I wanted to get this out and gauge developers on the idea. Check out the GitHub projects and see how your app could benefit from a community of common model storage.
