So the Chrome team at Google is exploring bundling Gemini Nano with Chrome, it is already live in Canary and Dev versions (127+). This means that in the future simple prompts can be computed within the clients’ browsers reducing the need for external services. I really like this development and will be exploring it further in the future.
For now I created a proof of concept component of a few dozen lines.
Show case of it working:
Note that this will ONLY work with the latest Canary and Dev versions of Chrome, to configure I’d recommend signing up for the preview and follow the configuration steps VERY carefully.