Google is advancing its Gemini project, introducing a new feature, “Get tasks done with Gemini,” designed to enhance user experience on Android devices. This feature will enable Gemini to automate certain tasks such as placing orders and booking rides through screen automation.
Gemini’s Screen Automation Feature
As part of the Google app 17.4 beta, the “Get tasks done with Gemini” function is currently being tested. The development is codenamed “bonobo” and aims to simplify how users interact with specific applications on their Android devices.
Operational Framework
The screen automation capability is built on the Android 16 QPR3 framework. This feature will function in select applications, signaling a significant shift in how tasks are managed on mobile devices.
- Order Placement: Users can automate the ordering process through supported apps.
- Ride Booking: The feature allows for improved ride booking experiences.
- Supervision Warning: Google advises users to supervise Gemini closely, as it may make errors.
Privacy Considerations
Privacy concerns are paramount with the new functionality. Gemini can review screenshots while interacting with applications, particularly if the “Keep Activity” feature is enabled. Google emphasizes the importance of safeguarding sensitive information.
- Do Not Share Sensitive Data: Users should refrain from entering login or payment information into Gemini chats.
- Avoid Using for Emergencies: The feature should not be relied upon for urgent tasks or sensitive operations.
Additional Features on the Horizon
Beyond basic automation, there are indications of a “Likeness” feature, codenamed “wasabi.” This feature is expected to allow users to utilize 3D avatars, enhancing interaction during Google Meet calls. Such advancements showcase Google’s intent to innovate within its suite of services.
The Gemini project represents a significant step towards integrating AI into everyday mobile tasks, bringing increased convenience while emphasizing user supervision and privacy awareness.
