Google Lens arrives on the Chrome desktop, will soon support text + image search



[ad_1]

Google Lens, Google’s computer vision search engine, come to the Chrome desktop. Google hasn’t exactly shared a timeline, but a teaser tweet showed what the feature will look like.

On the Chrome desktop, you will soon be able to right-click an image and choose “Search with Google Lens,” which will darken the page and display a cropping tool so you can cast a certain image on the photo AI. Google. After a round trip on the Internet, a sidebar will appear showing several results.

While Google.com’s image search is simply trying to find similar images, Lens can actually identify things in an image, such as people, text, math equations, animals, landmarks, products, etc. It can translate text through the camera and even copy real world text (with OCR) and paste it into an app. The feature has been around on Android and iOS for some time, first as a camera-driven search that displayed a live viewfinder, then in Google Photos, and more recently as a long press option. for web images in Chrome for Android.

Google Lens is also getting a little smarter. A new feature is coming to the service that will allow you to ask follow-up questions to an image search. Google offers two very impressive demos here. One of them asks a user to scan a photo of a shirt and ask for “socks with this design” before Google displays a match. It would be practically impossible to search for a specific model of clothing otherwise. You can enter descriptors like “floral pattern”, but that would give you similar patterns that you have to scroll through, not the same pattern.

Another example is a great use case for visual search: finding something that you don’t know the name of. In the example, the user has a broken bicycle and needs to fix something with the rear sprocket. They don’t know what the rear shifter is called, so they just take a picture of it and ask Google. Apparently it’s a “derailleur”, and from there the user types “how to fix” and Google finds instructions.

Basically, Lens has the ability to search for images and text at the same time. Both of these examples are awesome, but they’re canned demos, so it’s hard to know how well this will actually work. Google says the feature will arrive “in the next few months.”



[ad_2]

Source link