Patent US10299717

Detecting stress based on thermal measurements of the face
[+] Show Details

US10299717

1. A system configured to detect a stress level, comprising: (11) (2)

an inward-facing head-mounted thermal camera (CAM) configured to be held less than 10 cm from a user's head and to take thermal measurements of a region on a periorbital area (TH_ROI1) of the user; wherein the field of view of CAM does not cover a region outside the user's face; and

a computer configured to: generate feature values based on TH_ROI1, utilize a model to detect the stress level based on the feature values, and output said stress level; wherein the model was trained based on: previous TH_ROI1taken while the user was under elevated stress, and other previous TH_ROI1taken while the user was not under elevated stress.

2. The system of claim 1, wherein the region on the periorbital area is a region of the periorbital area of the right eye; and further comprising a second inward-facing head-mounted thermal camera (CAM2) configured to be held less than 10 cm from the user's face and to take thermal measurements of a region on the periorbital area of the left eye (TH_ROI2); wherein the computer is further configured to detect the stress level based on TH_ROI1and TH_ROI2. (2) (0)

5. The system of claim 1, further comprising a second inward-facing head-mounted thermal camera configured to take thermal measurements of a region on the user's forehead (TH_ROI2); wherein the computer is further configured to generate additional feature values based on TH_ROI2, and to detect the stress level based on the feature values and the additional feature values. (0)

6. The system of claim 1, further comprising a second inward-facing head-mounted thermal camera configured to take thermal measurements of a region on the user's nose (TH_ROI2); wherein the computer is further configured to generate additional feature values based on TH_ROI2, and to detect the stress level based on the feature values and the additional feature values. (0)

7. The system of claim 1, further comprising a second inward-facing head-mounted thermal camera configured to be located above the user's upper lip and to take thermal measurements of a region below the user's nostrils (TH_ROI2); wherein TH_ROI2is indicative of the user's breathing, and the computer is further configured to generate additional feature values based on TH_ROI2, and to detect the stress level based on the feature values and the additional feature values. (0)

8. The system of claim 1, further comprising second and third inward-facing head-mounted thermal cameras, configured to be located less than 10 cm from the user's face and at least 1 cm to the right and to the left of the vertical symmetry axis, respectively, and to take thermal measurements of regions on the right and left cheeks, respectively; wherein the computer is configured to generate additional feature values based on the thermal measurements of the cheeks, and to detect the stress level based on the feature values and the additional feature values. (0)

9. The system of claim 1, wherein the computer is further configured to detect the stress level based on a difference between TH_ROI1and a baseline value determined based on a set of previous measurements taken by CAM; and wherein most of the measurements belonging to the set were taken while the user was not under elevated stress. (0)

10. The system of claim 1, further comprising a sensor configured to take additional measurements (m_conf) of at least one of the following: the user, and the environment in which the user was in while TH_ROI1were taken; wherein the computer is further configured to generate, based on m_conf, one or more feature values that are utilized to detect the stress level; whereby m_confare indicative of an extent to which a confounding factor occurred while TH_ROI1were taken. (2) (0)

13. The system of claim 1, wherein the computer is further configured to generate at least one feature value based on an additional measurement of the user taken during the same period TH_ROI1were taken; wherein the additional measurement is indicative of one or more of the following signals: a heart rate of the user, heart rate variability of the user, brainwave activity of the user, galvanic skin response of the user, muscle activity of the user, and an extent of movement of the user; and wherein the computer is further configured to detect the stress level of the user based on the feature values and the at least one feature value. (0)

14. The system of claim 1, further comprising a head-mounted display configured to present digital content to the user; wherein the display does not prevent CAM from measuring the region on the periorbital area. (0)

15. The system of claim 1, further comprising an eye tracker configured to track gaze of the user, and (i) an augmented reality optical see through head-mounted display configured to operate in cooperation with: a visible-light camera configured to capture images of objects the user is looking at, and a computer configured to match the objects the user is looking at with the detected stress levels, or (ii) a virtual reality head-mounted display configured to present video comprising objects, and the computer is configured to match the objects the user is looking at with the detected stress levels. (0)

16. The system of claim 1, further comprising a user interface configured to notify the user when the stress level reaches a predetermined threshold, and to provide the user with encouragement not to engage in behavior that causes stress. (0)

17. A system configured to alert about stress, comprising: (1) (3)

first and second inward-facing head-mounted thermal cameras (CAM1, CAM2) configured to be held at least 0.5 cm to the right and to the left of the vertical symmetry axis that divides a user's face, respectively;

CAM1 and CAM2 are further configured to take thermal measurements of regions on the periorbital areas of the right and left eyes (TH_ROI1and TH_ROI2, respectively) of the user; wherein the fields of view of CAM1 and CAM2 do not cover a region outside the user's face; and

a user interface configured to provide an alert about a stress level reaching a threshold; wherein the stress level is determined based on TH_ROI1and TH_ROI2.

18. The system of claim 17, further comprising a computer configured to detect the stress level based on TH_ROI1and TH_ROI2and to command the user interface to provide the alert; and further comprising a frame configured to be worn on the user's head, wherein each of CAM1 and CAM2 is physically coupled to the frame and the frame is further configured to hold each of CAM1 and CAM2 less than 15 cm from the user's face. (0)

19. A method comprising: (2) (2)

taking thermal measurements of regions on the periorbital areas of the right and left eyes (TH_ROI1and TH_ROI2, respectively) of a user utilizing first and second inward-facing head-mounted thermal cameras (CAM1 and CAM2, respectively) configured to be held at least 0.5 cm to the right and to the left of the vertical symmetry axis that divides the user's face, respectively; wherein the fields of view of CAM1 or CAM2 do not cover a region outside the user's face; and

alerting about a stress level that is detected based on TH_ROI1and TH_ROI2.

20. The method of claim 19, further comprising generating feature values based on TH_ROI1and TH_ROI2, and utilizing a model for detecting the stress level based on the feature values; wherein the model was trained based on previous TH_ROI1and TH_ROI2of the user, taken during different days, which comprise: a first set of measurements taken while the user had a first stress level according to a predetermined stress scale, and a second set of measurements taken while the user had a second stress level according to the predetermined stress scale. (0)

21. The method of claim 19, further comprising generating feature values based on TH_ROI1and TH_ROI2, and utilizing a model for detecting the stress level based on the feature values; wherein the model was trained based on previous TH_ROI1and TH_ROI2of users, taken during different days, which comprise: a first set of measurements taken while the users had a first stress level according to a predetermined stress scale, and a second set of measurements taken while the users had a second stress level according to the predetermined stress scale. (0)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10299717

Detecting stress based on thermal measurements of the face

Patent Matrix® Search