Google is introducing a new live view feature for its Gemini apps on iOS and Android, allowing users to stream their surroundings to stream their surroundings so that they are watching. Integration is starting from today.
In a demo, Mithun identified the objects that the user was looking into, corrected misconceptions about an object, and provided references by answering questions. Live view of Gemini can identify objects in real time, provide assistance with DIY or home improvement projects, help to organize spaces, assist with shopping, and more.
You can also share your iPhone or iPad screen with Gemini so that you can watch online.
The live option of Gemini can be helpful for those who are blind or who have low vision, as it can provide a live vocal feed of a person’s environment. The Live Project is built on Estra, which was previewed by Google in I/O last year, and it was first rolled out for pixel devices.
In this summer, Google plans to add individual reference to Gemini for features such as Gmail’s smart answer. Gemini will be able to use relevant information in Google Apps to provide more personal experiences. For example, AI answer feature in Gmail may look like you, rather than having a normal voice. It is capable of scanning the previous email to match tone, style and word choice, as well as it can add reference to the notes, documents from Google Drive, and more and more emails.
