Showing posts with label Amazon. Show all posts
Showing posts with label Amazon. Show all posts

Sunday, October 2, 2022

Oh, patents! Amazon One, pay with the palm of your hand!

Copyright © Françoise Herrmann

The COVID-19 pandemic accelerated the advent of a new era of contactless payment. In 2022, welcome contactless cardless payment with the palm of your hand! Just provide your mobile phone number and Amazon Prime QR Code, when you first enroll with the Amazon One service to activate both palms on the sensor. A fast procedure, somewhat reminiscent of activating the biometrics of your face on a new Iphone. Thereafter, all you need to do to pay, is to hover and let the Amazon One sensor recognize and identify one of your palms, for example, at a cash register, equipped with the biometric device. No more credit cards. No more searching for your Prime QR code with your phone app, or via Amazon.com. Checking out is as easy as a hover, effortless, and incredibly streamlined, not to mention safe, and truly contactless. You can even check out and pay, if you forget your purse (or wallet) in the car.

Needless to say that this invention is patented. The Amazon One, palm-powered contactless payment service is recited in the US utility patent application US20200302147A1, titled Biometric input device. The patent discloses the means for acquiring images of the user’s palms, while determining surface and subcutaneous features relevant to contactless identification of the user. The patent also discloses the means of processing recognition of the user's palm, for each new use of the service, whether for payment, entry, or other biometric identification purposes.

The patent Figure 1 below, together with an image of the Amazon One biometric device, both show a user hovering within the device's Field Of View (FOV) for identification of their palm. Hovering for Identification at the cash registers of Amazon-owned Whole Foods supermarkets, for example, or at other points of sale, or entry portals, such as libraries, hospitals, apartments, and offices, according to the extended scope of the invention.


  
 The patent Figure 1 specifically depicts the biometric input device 102, according to the invention. A user’s hand 104 is hovering over the device 102 sensor window 106. A sensor assembly beneath the sensor window 106, comprises a camera with a field of view (FOV) 108. The sensor assembly (not depicted in Figure 1) might further comprise illuminators and polarizers used to obtain biometric data, in cooperation with the camera. Likewise, a mainboard assembly (not depicted in Figure 1) might additionally comprise a card reader, one or more processors, memory, output devices, controllers, and additional input devices. The patent Figure 1 additionally depicts an optional liquid crystal display device 110, able to display text, images and other information. The display device 110 might further comprise a touchscreen together with a haptics sensor. The device 102 also depicts a card reader 112, able to cooperate with a magnetic card 114. Finally, the device 102 also includes a stand 116, supporting the device, and possibly attached to a countertop. 

Below, the abstract of the Amazon One biometric input device invention. 
A biometric input device includes a sensor assembly that generates images of a user's palm that is within a field of view (FOV) using an image sensor behind a polarizer with a first polarization. The palm within the FOV is illuminated at different times with light having the first polarization and the second polarization. The images are acquired using polarized light and provide images of surface and subcutaneous features. The images may then be processed to identify the user. The device may include a touchscreen to provide information to the user or receive input from the user. The device may include a stand to mount the device at a convenient location, such as at an entry portal, point of sale, and so forth. [US20200302147A1]


References

Amazon One 

https://one.amazon.com/ 


Amazon One - How it works

https://one.amazon.com/how-it-works

Saturday, February 27, 2021

Oh, patents! Amazon VTON smart mirror (4)

Copyright © Françoise Herrmann

For a company that owes a large part of its success to inventions, or doing “crazy” things that become “normal”, according to former CEO Jeff Bezos (2021), perhaps that one day, in the near future, Amazon will get their smart mirror for Virtual Try-On (VTON) perfect enough, so that this invention might also become part of the everyday experience of shopping for clothes, at Amazon. In other words, perhaps that the Amazon VTON smart mirror invention might one day become a “yawn-worthy” invention, as Bezos (2021) further puts it for all the Amazon inventions that “got it right”.

The Amazon VTON smart mirror invention is recited in the US utility patent, US10621785, titled Blended reality systems and methods. A patented invention, just like the now- mainstream Amazon inventions, such as: “customer reviews, 1-Click, personalized recommendations, Prime’s insanely-fast shipping, Just Walk Out shopping, the Climate Pledge, Kindle [and] Alexa”, to name just a few, that Bezos (2021) listed in his farewell email to Amazon employees, on February 2, 2021. Hopefully also, and perhaps most importantly, an Amazon VTON smart mirror invention, in the future of online retail fashion, that might soon work by design, rather than of necessity, arising from further pandemic lockdown orders, or curfews.

Till then, the Amazon VTON smart mirror invention intends to make shopping online a lot easier, resolving issues such as garment fitting, and associated customer satisfaction. The patent discloses a shopping experience where the user can try on clothes virtually. The patent discloses a blended reality where systems and methods are used to blend both projected images (e.g., clothes or background scenery), and captured reflection (e.g.; the user or real objects in front of the mirror), into a single scene, so that users are able to see images of themselves, for example wearing a different outfit, in a real or different (projected) background. The blending of both projected images and captured reflection, without ghosting, is achieved by controlling the amounts of light transmitted to the user through the mirror, and reflected by the mirror to the user, resulting in the controlled superimposition of both projected image and reflection of the user. Thus, the means and methods of blending reality might selectively illuminate or darken portions of the user (see Figure 1B below), while selectively projecting an image on the darkened parts of the user, so that the user in front of the mirror sees a reflection of him- or herself, wearing a different item of clothing (e.g.; a shirt), corresponding to the superimposed reflection of the projected image (see Figure 1C below).

More specifically, the means and methods are those that fuel much artificial intelligence (AI) research in the domain of visual synthesizing, already variously applied in a host of different areas, ranging from fashion to architecture or engineering, and Deep Fakes (Lewis, et.al., 2021; Neuberger, et.al., 2020; Palermo, 2020; Sangkloy, et.al., 2016). Efforts in AI visual synthesizing that have precisely tackled the issues of mapping one high-resolution image onto another, in view of obtaining the photorealistic effects of a blended reality. 

In the domain of fashion design, for example, AI visual synthesizer programs allow designers to see how a new outfit might fit on one body or another, posing one way or another (e.g., using 3D Body Labs scans [1], [2]). Likewise, both image and sound synthesizing technologies are together invoked in the generation of Deep Fake videos, where fake images superimpose the real ones, together with fake speech, using the vocal characteristics of the speaker’s voice. Deep Fake research relying on visual synthesizers, whether it is for the purposes of developing countermeasures to control the generation of such materials, indistinguishable from the real ones (e.g., using video authentication signatures)—or not (Palermo, 2020).

In any event, such AI synthesizing technologies have already made waves, making it possible to virtually try on eyeglasses (e.g., Zenni), makeup (e.g., L'Oréal Makeup VTON),  haircolor (e.g.; L'Oréal Hair VTON) or hairstyles (e.g., L'Oréal style hair VTON), for example, via the generation of photorealistic images, involving the blending of virtual objects onto captured representations of the user.

The abstract of the Amazon VTON smart mirror invention is included below, together with the patent Figures 1A, 1B and 1C, showing the blended reality smart mirror, configured to generate a blended reality view to the user. Specifically, Figure 1A shows an example of the blended reality smart mirror apparatus 100, configured to generate a blended reality 116 to a user 105, in front of the apparatus 100, using light reflected by the mirror 120 blended with light generated from a display device 110 transmitted through the mirror 120. A plurality of projectors 130 on the mirror frame 125 are programed to selectively illuminate objects in front of the mirror. One or more of cameras 140, on the frame 125, are programmed to capture images of the user 105, and other objects in front of the mirror.

The apparatus generates a blended reality view by combining the image projections from the display device 110, behind the mirror 120, with control on the illumination of the user 105 and surroundings, in front of the device, using projectors 130 (Fig 1B). The blended view 116 includes the combination of reflected light 122 of the user, and transmitted light, of the beach scene 112 or shirt 117 (Fig. 1C) projected by the display device 110. 



Systems and methods are provided for generating a blended reality view to a user, the blended reality view combining images reflected by a mirror with images transmitted from a screen behind the mirror. Systems for generating blended reality views can include a display device with a screen positioned behind a mirror. The display device can generate a pattern of illumination and non-illumination on the screen so that the illuminated portions of the screen substantially transmit through the mirror. Projectors can be used to illuminate objects in front of the mirror so that the illuminated objects are reflected by the mirror. In combination, the portions of the screen transmitted through the mirror and the illuminated objects reflected by the mirror can provide a blended reality view to a user viewing the mirror. [Abstract US10621785]


References


Bezos, J. (Feb. 2, 2021) Email from Jeff Bezos to employees. https://www.aboutamazon.com/news/company-news/email-from-jeff-bezos-to-employees

Boyle, A (Jan. 2, 2018) Amazon’s blended-reality mirror shows you wearing virtual clothes in virtual locales.Geekwire. https://www.geekwire.com/2018/amazon-patents-blended-reality-mirror-shows-wearing-virtual-clothes-virtual-locales/

Lewis, K. M. et. al. (Jan. 6, 2021) VOGUE: Try-On by StyleGAN Interpolation Optimization https://vogue-try-on.github.io/

Neuberger, A. et. Al. (2020) Image-based virtual tryon network from unpaired data. Amazon Lab126 Paper presented at The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020. https://assets.amazon.science/1a/2b/7a4dd8264ce19a959559da799aff/scipub-1281.pdf

Ong, T. (Jan. 3, 2018) Amazon patents a mirror that dresses you in virtual clothes. The Verge. https://www.theverge.com/circuitbreaker/2018/1/3/16844300/amazon-patent-mirror-virtual-clothes-fashion

L'Oréal  Makeup Virtual Try-On (VTON)  https://www.lorealparisusa.com/virtual-try-on/makeup.aspx

L'Oréal Haircolor Virtual Try-On (VTON)  https://www.lorealparisusa.com/virtual-try-on/hair.aspx

L'Oréal Style my Hair Virtual Try-On (VTON)  https://www.lorealprofessionnel.co.uk/hair-looks/style-my-hair

Palermo, J. (Feb. 12, 2020) TEDX Deepfakes: Why you can't believe everything you see. Engineer at Dessa. https://youtu.be/JXBBalHl_cI

Sangkloy, P. et. al. (2016) Scribbler: Controlling Deep Image Synthesis with Sketch and Color. Georgia Institue of Technology. http://scribbler.eye.gatech.edu/paper.pdf

Wiggers, K. (June 5, 2020) Amazon’s new AI technique lets users virtually try on outfits. https://venturebeat.com/2020/06/05/amazons-new-ai-technique-lets-users-virtually-try-on-outfits/

Sunday, June 17, 2018

Oh, patents! Blended reality mirror

Copyright © Françoise Herrmann

Mirror, mirror on the wall, what shall I wear today?
Now, everyone will be able to seek counsel from a blended reality mirror!

What is blended reality? In this scenario, blended reality combines the images reflected by the mirror with images transmitted through the mirror, functioning as a display. Thus, users might see themselves in a setting  (e.g.; at the beach or in a restaurant) other than their current location. Alternatively, users might see themselves wearing clothes other than the ones actually worn.

The challenge of combining both reflected and transmitted images, so that users can view them in a blended reality experience, is the problematic situation addressed in the patent US9858719, titled Blended reality systems and methods, assigned to Amazon Technologies Inc. In particular, this invention seeks to resolve such issues as the superimposition of reflected images on a transmitting display, which often results in what is termed “ghosting”. Conversely, the invention also resolves the impossibility of reflecting transmitted images.  Thus, the patent recites the systems and methods designed to blend both reflected and transmitted realities, so that both are accessible to users in an augmented reality (AR) experience.

Succinctly, the mirror/display device controls all the undesirable effects of superpositioned images, by controlling the amount of light transmitted and reflected, according to proprietary algorithms, that include the recognition and extraction of scanned (camera) data. For example,  the mirror/display device can selectively: darken the image of the room (preventing reflection), illuminate the user (to promote reflection), and/or project images onto the darkened areas where the user would have seen a reflection of the room and its objects.

The abstract of this invention is included below, together with a blended reality illustration, extracted from the patent. The illustration shows how the reflection of the room has been obliterated to allow for the display of a beach scene, and conversely how the user has been identified in the flow of scanned images (as an outline in the darkened room captured data) which is then illuminated so that  it can be reflected in the transmitted scene, as the user.

Systems and methods are provided for generating a blended reality view to a user, the blended reality view combining images reflected by a mirror with images transmitted from a screen behind the mirror. Systems for generating blended reality views can include a display device with a screen positioned behind a mirror. The display device can generate a pattern of illumination and non-illumination on the screen so that the illuminated portions of the screen substantially transmitted through the mirror. Projectors can be used to illuminate objects in front of the mirror so that the illuminated objects are reflected by the mirror. In combination, the portions of the screen transmitted through the mirror and the illuminated objects reflected by the mirror can provide a blended reality 
view to a user viewing the mirror. [Abstract US9858719]

The bottom line is that when you stand in front of a blended reality mirror, you will no longer see a mirror image! The youtube video included below provides a glimpse of the blended mirror reality in the dressing room. 



Happy Father’s day to everyone! 

Reference
CNN - Amazon smart mirror patent

Tuesday, December 20, 2016

Oh, patents! Commercial drones

Copyright © Françoise Herrmann

Imagine all your Amazon and postal service packages delivered by drone!

Although long lines at the post office, at this festive time of the year, do not appear to be the primary reason for the piloting and testing of drone deliveries carried out separately, both by the French postal service in France, and Amazon in the UK, this might well be what’s in store for the future. 

Rather, it is both the costs and difficulty of accessing remote locations that prompted developments and research in this domain for the French postal service. And in the UK, for Amazon, it looks like speed of service might be part of the equation too, since Amazon CEO Jeff Bezos tweeted: “13-minutes - click to delivery time” following successful delivery of  popcorn and an Amazon Fire tablet, from the Amazon fulfillment center, to the first drone-delivery customer, located 2 miles away. (WSJ, Wells & Stevens, 12/2016)

Amazon commercial drones are located at the Amazon Cambridge fulfillment center in the UK. They are permitted to operate in the airspace at 400 feet, during the daytime only, to avoid collisions with aircrafts. They are completely autonomous devices, driven by GPS, and can carry a payload of 5lbs. Amazon is testing in the UK, because it could not secure authorization to use the US airspace. (BBC)

Likewise, in France, the French postal service has begun weekly service in the remote and mountainous location of the southwestern Var region after securing permission from civil aviation authorities to operate in the airspace of that region. The French postal service drones are operated by the DPDgroup. They carry payloads up to 6 lbs, at a speed of 30 km/hour with a maximum range of 20 km. (Le Figaro; Le Monde - J.M. Normand 12/2016)

Drone deliveries are highly patented technologies. The following are a few of these patents ranging from the ADLPs (Aerial drone landing pads), to the computerized systems for managing drone delivery cycles:
  • WO2016196093 (A1) 2016-12-08 - Systems, methods, and apparatuses for managing aerial drone parcel transfers  
  • US2016335898 (A1) 2016-11-17 - Automated drone management system
  • WO2016094067 (A1) 2016-06-16 - Drone docking station and delivery system
  • GB2537122 (A) 2016-10-12 - Automated drone package receiver module
  • US2015248640 (A1) 2015-09-03 - 3D model and beacon for automatic delivery of goods
  • US2014316243 (A1) 2014-10-23 - Systems and techniques for delivery and medical support
  • US2016101874 (A1) 2016-04-14 - Drone receiving systems and methods
  • US2016033966 (A1) 2016-02-04 - System and method for controlling drone delivery or pick up during a delivery or pick up phase of drone operation
  • US2016068264 (A1) 2016-03-10 Methods, Systems and Devices for Delivery Drone Security 


Amazon makes first drone delivery – Dec. 14 (BBC)
Amazon conducts first commercial drone delivery (WSJ, Wells & Stevens, Dec. 14, 2016)
In major step for drone delivery, amazon flies package to customer in the England
http://www.nytimes.com/2016/12/14/technology/amazon-drone-england-delivery.html?_r=0
Premiers clients pour les drones d'Amazon et de la Poste - Le Monde 15 déc. 2016 - J.M. Normand