You dance and AI lets the pictures dance with you

Google has again introduced a creative use of AI techniques with Move Mirror. It's a new experience that you can already enjoy online for yourself. What exactly does Google Move Mirror do? Well, you can walk in front of your webcam. The software captures your movements in the browser and compares them with a database of 80,000 stored photos. Among the photos, there are shots in the fields of sports, martial arts, dance, etc. The Move Mirror now searches your movements for the appropriate images from the database and reflects them almost. In this way, you can then create fun GIFs.

The video above will present the Move Mirror again. Good idea, as much as you can of course share the GIF with your friends. Such experiences, which also entertain users, are one of Google's specialties. For example, I remember Scrying Pen, which Olli described in April. Scrying Pen predicts what you want to do by scribbling. The Move Mirror in turn recognizes your movements and body positions. Obviously, this technology has a lot of potential for the future, for example to make other animations and to find a use for avatars.

According to Google, Google also uses PoseNet for the Move Mirror. This is so that you can effectively recognize people and their postures in photos and videos. This compensates for your positions with those of 80,000 photos in the database. Then the best match will be shown. Of course, 80,000 photos are relatively few. If you want to push the dance pads even further and reproduce the movements more accurately, you will definitely need a much larger base of pictures.

Tensorflow.js is also the basis of the Move Mirror. Through this library, machine learning can take place directly on the device or in the browser. Moreover, your images are not stored on a server anywhere on Google. If you want to know more about the technical context, you can also check it here.

You can find the Move Mirror online here. I hope you enjoy trying it!