Auto Awesome Snow Shake in Google+ for Android

This is another fun feature for the holidays, but it's limited to the Google+ app for Android: "Shake your device while viewing one of your photos, and watch the snow fall. Shake it again to save your new snowy photo and share it with family and friends."

It's a way to manually trigger the Auto Awesome Snow effect for any photo.

You need the latest version of the Google+ app (4.2.4), which was released today. Blame staged rollouts if you don't have the new version. You can also manually download the APK file.

This is not the only new feature: "when you +1 posts in the stream, you'll see something lovely" (hearts). There's also a unified search box, a new section for less important notifications and separate "What's Hot" streams for different categories.

Auto Awesome Action, Eraser and Movie

Auto Awesome is a collection of features that create new images which use the photos you upload: panoramas, animations, HDR, better group photos. They're created automatically and Google now even sends notifications when they're ready.

There are 3 new Auto Awesome features: 2 of them are only for photos (action, eraser) and the third one is for both photos and videos.

Action is great for action photos. "Take a series of photos of someone moving (dancing, running, jumping) and Auto Awesome will merge them together into one action shot where you can see the full range of movements in a single image, capturing the movement in one captivating still."

Google combines these 6 photos:

and creates this awesome visual effect:

Eraser is useful when you want to remove people from photos. "If you take a sequence of 3 or more photos in front of a structure or landmark with movement in the background, Eraser will give you a photo with all the moving objects removed. It's helpful for those situations when you're trying to get a great shot of a landmark or other crowded place, but want to avoid including all of the people in the background of your photo."

These photos aren't great:

but they can be combined to get this:

Auto Awesome Movie is a bit like HTC Zoe, but it's a lot more advanced. In fact, it's the only Auto Awesome feature that lets you customize the result and the only feature you can trigger manually. Google creates a video that combines some of the videos and photos you uploaded, processes the videos, adds image stabilization and picks some appropriate music. "You can create Auto Awesome movies from the Google Photos app for Android, which are short films created automatically by editing together the videos and photos you capture around an experience. Choose the photos and videos you wish to make into an Auto Awesome movie, and let Google do the rest. You can change the theme, style, background music, or even remove, shorten, or re-order scenes. After your movie is created, you can choose to share or save it. Auto Awesome movies are currently only available for some devices running Android 4.3 and up, including the Nexus 4, Nexus 7, Nexus 10, and HTC One."

Auto Awesome shows that advanced features don't need complicated interfaces. It also shows the power of the cloud: Google+ Photos finds your best photos, enhances your photos, it lets you search your photos and it even creates new ones. All of this without buying expensive photo editors and learning how to use them.

Google+ Photo Search Detects More Than 1,000 Objects

Back in May, Google announced an impressive search feature that allows to find photos even if they don't include any useful metadata. "To make computers do the hard work for you, we've also begun using computer vision and machine learning to help recognize more general concepts in your photos such as sunsets, food and flowers." Here are more details: "This is powered by computer vision and machine learning technology, which uses the visual content of an image to generate searchable tags for photos combined with other sources like text tags and EXIF metadata to enable search across thousands of concepts like a flower, food, car, jet ski, or turtle."

Now Google announced that it detects more than 1,000 objects. It may not seem like a lot, but it's extremely difficult to detect objects algorithmically and do this with enough precision. Distinguishing between so many objects makes this task even more difficult. Google can now detect labradors and snowmen, tulips and umbrellas, laptops and shoes.

Google's announcement is strange because a Google post from June mentioned that the classifier already detected 1,100 classes of objects:

We came up with a set of about 2000 visual classes based on the most popular labels on Google+ Photos and which also seemed to have a visual component, that a human could recognize visually. In contrast, the ImageNet competition has 1000 classes. As in ImageNet, the classes were not text strings, but are entities, in our case we use Freebase entities which form the basis of the Knowledge Graph used in Google search. An entity is a way to uniquely identify something in a language-independent way. In English when we encounter the word 'jaguar', it is hard to determine if it represents the animal or the car manufacturer. Entities assign a unique ID to each, removing that ambiguity, in this case '/m/0449p' for the former and '/m/012x34' for the latter. In order to train better classifiers we used more training images per class than ImageNet, 5000 versus 1000. Since we wanted to provide only high precision labels, we also refined the classes from our initial set of 2000 to the most precise 1100 classes for our launch.

I'm not sure if there's some improvement I'm missing. It's likely that the search results are better, but the number of objects has not increased.

Which Google Drive Images Are Added to Google+ Photos?

If you're wondering why not all the image files from Google Drive are available in Google+ Photos, here's the explanation. Google+ Photos only imports photos if they meet these criteria:

1. photos MUST be at least 512 x 512
2. JPG photos MUST have 'Date Taken' EXIF metadata
3. supported formats: JPG, GIF, WebP, RAW.

I've tested various image files and these are the rules. Google wants to restrict the feature to photos, but it's not clear why GIF and WebP are allowed, while PNG isn't.

{ Thanks, Martin. }