Google AI Edge Gallery app is good
Google has a new app for Android and also for iOS called AI Edge Gallery that lets people explore and use local on-device LLMs. Currently, it's featuring the newly launched Gemma 4 family of models.
This is written in their app description on app stores:
AI Edge Gallery is the premier destination for running the world's most powerful open-source Large Language Models (LLMs) on your mobile device. Experience high-performance Generative AI directly on your hardware—fully offline, private, and lightning-fast.
And to my surprise, the app itself is open-source. I love whatever is Google's game here.
I tried the app on my Android device, and even downloaded the smallest Gemma-4-E2B-it model and it worked fine. The app has multiple different options, as you see in the screenshots, and it looks stunning as well.
I am traveling next week via train and the network is not stable sometimes, so I can easily chat with these local models. I have tested for a bit, and they're good at non-coding stuff.
Webmentions