Google’s new Pixel 9 phones have hit the market two months ahead of schedule, boasting an array of AI features. However, one of the standout features, the Reimagine tool, is already facing criticism from reviewers. This innovative feature allows users to type a description of how they want a photo to look, and it will apply that vision to the image.
The Verge tested the tool and found it to be surprisingly effective – perhaps too effective. They discovered that it can easily be used to insert objectionable or disturbing content into images. This includes things like car wrecks, smoking bombs in public places, sheets appearing to cover bloody corpses, and drug paraphernalia.
The Verge envisions a scenario where bad actors could quickly churn out fake but believable visuals related to events like scandals, wars, or disasters, spreading misinformation in real time before the truth has a chance to surface. They suggest that “the default assumption about a photo is about to become that it’s faked because creating realistic and believable fake photos is now trivial to do.”
Google will likely work to address these issues with Reimagine, but other companies offering similar tools may not be as diligent in implementing safeguards. The Pixel 9’s AI-related concerns don’t stop there. The phone also includes a new Pixel Studio app that allows users to generate entirely synthetic imagery through AI, and it appears to lack adequate safeguards.
Digital Trends demonstrated that it’s possible to create images of copyrighted characters in offensive scenarios, such as Spongebob depicted as a Nazi, Mickey Mouse as a slave owner, and Paddington Bear on a crucifix. The images generated by this app don’t seem to carry any clear watermarks to indicate that they are artificially created.
While it’s commendable that Google is innovating and pushing the boundaries of AI, there are still significant gaps despite the company’s claims of having robust safeguards in place.
My Thoughts
Google’s Pixel 9 phones have hit the market, and with them, the innovative Reimagine tool. This feature, part of Google Photos’ Magic Editor, allows users to simply type a description of how they want a photo to look, and it will apply that vision to the image. While it seems designed for innocent edits, it has a darker side.
The Verge tested the tool and found it to be surprisingly effective – perhaps too effective. They discovered that it can easily be used to insert objectionable or disturbing content into images. This includes things like car wrecks, smoking bombs in public places, sheets appearing to cover bloody corpses, and drug paraphernalia.
The ease with which Reimagine can create convincing fake images raises concerns over misinformation. Bad actors could quickly churn out fake but believable visuals related to events like scandals, wars, or disasters, spreading misinformation in real time before the truth has a chance to surface. This is a worrying trend, and Google needs to address these issues with Reimagine.
Google also needs to be more diligent in implementing safeguards for its AI tools, as other companies may not be as careful. The lack of clear watermarks on artificially created images is also a concern.