Google has officially announced that users can now utilize Gemini to convert hand-drawn sketches into interactive applications. This innovative feature aims to help users turn their ideas from paper into practical tools.
Users can upload sketches and request code generation
According to Google, users simply need to upload a photo of their hand-drawn sketch, such as a prototype for an app, a habit tracker, or a game board, then select the Canvas tool and ask Gemini: "Can you code this app?"
Gemini generates code in real-time and allows design adjustments
Gemini is capable of reading users' visual sketches and generating corresponding code, allowing users to test the created tools in a preview window. Google noted that Gemini can also adjust colors, fonts, or features in real-time, enabling users to modify designs as needed.
Encouraging users to turn inspiration into reality anytime
Google stated: "Next time inspiration strikes, bring it to life with Gemini." This feature not only simplifies the app development process but also makes it easier to realize creative ideas.
Source: Google official announcement

