Patent US11221213

Method and system for generating a retail experience using an augmented reality system
[+] Show Details

US11221213

1. A method for generating a retail experience, comprising: (14) (9)

recognizing, by an electronic Augmented Reality (AR) system, a location of a user in a retail establishment;

said AR system retrieving data corresponding to the retail establishment;

said AR system generating virtual content relating to the retail establishment based on the retrieved data;

said AR system creating and rendering a virtual user interface in a field of view of the user and positioning the virtual user interface by tying the virtual user interface to object map points associated with a physical shopping cart in a real world retail location;

displaying the virtual content on the virtual user interface of a display device of the AR system, while the user is engaged in retail activity in the retail establishment;

said AR system moving the virtual user interface in response to a movement of the physical shopping cart in the real world retail location by rendering the virtual user interface at a position that is tied to the object map points associated with the physical shopping cart in the real world retail location after movement thereof such that the position of the virtual user interface relative to the physical shopping cart in the real world retail location remains unchanged;

receiving user input in a form of a user gesture; and

said AR system generating additional virtual content responsive to the user gesture,

wherein the user gesture comprises hand motions or hand positions and does not involve a user's hand contacting a physical interface or physical input device.

2. The method of claim 1, wherein the retrieved data comprises a set of map points corresponding to the retail establishment. (0)

3. The method of claim 1, wherein the location of the user is recognized using radio frequency identification transponders and communications. (0)

4. The method of claim 1, wherein the virtual content is selected from the group consisting of a virtual character, a virtual coupon, a game based on the user location, a list of promotional items, nutritional information, metadata relating to an item, a celebrity appearance, a cross-selling advertisement, information from a person known to the user, and an electronic book. (0)

5. The method of claim 1, further comprising: (2) (2)

7. The method of claim 1, further comprising: (1) (3)

receiving further user input;

generating further virtual content based on the further user input; and

displaying the further virtual content on the virtual user interface on a display device of the AR system, while the user is engaged in the retail activity in the retail establishment.

8. The method of claim 7, wherein the further user input is selected from the group consisting of visual data, audio data, sensory data, a direct command, a voice command, eye tracking, and selection of a physical button. (0)

10. The method of claim 1, further comprising sending the generated virtual content to the display device and wherein the AR system comprises a head mounted AR system and said creating a virtual user interface comprises creating the virtual user interface in the field of view of the user wearing the head mounted AR system. (0)

11. The method of claim 1 implemented as a system with a processor capable of implementing the method steps. (0)

12. The method of claim 1 implemented as a computer program product comprising a computer-readable storage medium having executable code to execute the method steps. (0)

13. The method of claim 1, further comprising comparing said gesture to a database to detect a predetermined command. (0)

14. The method of claim 1, further comprising detecting a location of a user by detecting a set of data associated with map points of the real world retail location and wherein said recognizing includes recognizing that the location of a user is in the retail establishment, based on the set of data. (1) (0)

15. The method of claim 1, wherein the virtual content includes metadata relating to an item and further comprising unlocking the metadata in response to the gestures. (0)

16. The method of claim 1, wherein the display device includes artificial or remote image data superimposed, overlaid, or juxtaposed with real scenes. (0)

17. The method of claim 1, wherein the virtual user interface comprises a floating virtual user interface. (1) (0)

20. The method of claim 1, wherein the additional virtual content further comprises rendering a virtual effect to the user by recognizing a visual input and retrieving data corresponding to a virtually augmented appearance of the user, wherein the virtually augmented appearance is based at least in part on a diet the user is following. (0)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US11221213

Method and system for generating a retail experience using an augmented reality system

Patent Matrix® Search