Chrome is adding `window.ai` — a Gemini Nano AI model right inside your browser.
It already works with the AI SDK:
ai-sdk-chrome-ai.vercel.app
It already works with the AI SDK:
ai-sdk-chrome-ai.vercel.app
I believe this will truly transform frontend applications.
The use-cases are endless: smart auto-completion, error correction and validation, natural language filtering, auto-filling forms, UI suggestions, first-pass summarization and search…
But what we're getting now is:
• Faster AI – the model is tiny and runs on-device, at the speed of keystrokes.
• Optimistic AI – just like `useOptimistic` is a React hook to commit a local state change beating the server roundtrip and provider a better UX, I believe we'll see "multi-tiered AI", where the On-device AI does the first pass, and the Cloud AI enhances it further.
• Cost-efficient AI – many usecases will be altogether served by the local AI end-to-end. And if the device doesn't support it, @vercel AI SDK helps you share code, execute it in the cloud, and just swap out the `provider` to use a fast cloud model like @groqinc
The use-cases are endless: smart auto-completion, error correction and validation, natural language filtering, auto-filling forms, UI suggestions, first-pass summarization and search…
But what we're getting now is:
• Faster AI – the model is tiny and runs on-device, at the speed of keystrokes.
• Optimistic AI – just like `useOptimistic` is a React hook to commit a local state change beating the server roundtrip and provider a better UX, I believe we'll see "multi-tiered AI", where the On-device AI does the first pass, and the Cloud AI enhances it further.
• Cost-efficient AI – many usecases will be altogether served by the local AI end-to-end. And if the device doesn't support it, @vercel AI SDK helps you share code, execute it in the cloud, and just swap out the `provider` to use a fast cloud model like @groqinc
This is how simple the resulting API is.
h/t @jeasonstudio for implementing `chrome-ai`
h/t @jeasonstudio for implementing `chrome-ai`
• • •
Missing some Tweet in this thread? You can try to
force a refresh
