Gemma is a new LLM from Google small enough to run on local machines and mobile...
Gemma is a new LLM from Google small enough to run on local machines and mobile devices. You can use MediaPipe to interface with the LLM on device and ask it requests.
The 2b model doesn't seem to function well and the 7b model is an improvement. For v1 versions it is impressive these run on a mobile device at all.
