As announced on X, Google is extending the availability of Gemini Live camera and screen sharing to users without a Gemini Advanced subscription. This means a One AI premium plan will no longer be required to access this feature.

Gemini Live can understand what it sees

The Gemini Live feature within the app utilizes the Project Astra model, which is designed for visual contextual awareness and a more agent-like approach. When using it, you can share your current phone screen or a live view through your device’s camera. From there, you can interact with Gemini Live using voice input, asking anything from identifying objects to understanding what’s on your screen in real time.

The camera view sharing functions as a visual assistant with object and text recognition capabilities, making it potentially useful for identifying surroundings or solving math problems. Meanwhile, the screen sharing option complements Gemini’s existing Ask about this image or Ask about this PDF features.

Empfohlener redaktioneller Inhalt
Dieser externe Inhalt von Twitter ergänzt den Artikel. Du hast die Wahl, ob du diesen Inhalt laden möchtest.
Externer Inhalt
Ich bin damit einverstanden, dass externer Inhalt geladen wird. Personenbezogene Daten werden womöglich an Drittplattformen übermittelt. Nähere Informationen enthält die Datenschutzerklärung.

Google states that the rollout begins today and may take a few days to reach more Android users. Importantly, this feature should work even on older Android devices and won’t require flagship processors, as it’s a cloud-based AI.

Currently, there’s no information on whether Google will extend this availability to the Gemini app for iPhone and iPad. However, if it eventually does, it would represent a significant advantage given the limited multimodal capabilities of other chatbots like OpenAI’s ChatGPT.

Just this week, Google also introduced a video generation feature in Gemini, powered by the Veo 2 model. This model allows users to create realistic 8-second clips using simple or detailed prompts. However, this feature is currently exclusive to paying users, though it wouldn’t be surprising if Google offers free users a limited trial in the future.

Do you believe Google is on the right track with Gemini’s ongoing expansion? What premium Gemini features would you like to try? We’d love to hear your thoughts in the comments.

We mark partner links with this symbol. If you click on one of these links or buttons–or make a purchase through them–we may receive a small commission from the retailer. This doesn’t affect the price you pay, but it helps us keep nextpit free for everyone. Thanks for your support!