Patent US10136852

Detecting an allergic reaction from nasal temperatures
[+] Show Details

US10136852

1. A system configured to detect allergic reaction, comprising: (8) (2)

an inward-facing head-mounted thermal camera (CAM) configured to take thermal measurements of a region on the nose (TH_N) of a user; and

a computer configured to: generate feature values based on TH_N, and utilize a machine learning-based model to detect an allergic reaction of the user based on the feature values; wherein the machine learning-based model was trained based on previous TH_Ntaken during different days.

2. The system of claim 1, wherein the previous TH_Nare previous TH_Nof the user, and further comprising a frame configured to be worn on the user's head; wherein CAM is physically coupled to the frame and the frame is configured to hold CAM less than 15 cm from the user's face. (3) (0)

3. The system of claim 2, further comprising second and third inward-facing head-mounted thermal cameras (CAM2 and CAM3, respectively), each of which is physically coupled to the frame; wherein the frame is configured to hold CAM2 and CAM3 less than 15 cm from the user's face, to the right and to the left of the vertical symmetry axis that divides the user's face, respectively; wherein CAM2 and CAM3 are configured to take thermal measurements of regions on the right and left cheeks (TH_ROI1and TH_ROI2, respectively); and wherein the computer is further configured to generate additional feature values based on TH_ROI1and TH_ROI2, and to utilize the additional feature values to detect the allergic reaction. (0)

4. The system of claim 2, further comprising second and third inward-facing head-mounted thermal cameras (CAM2 and CAM3, respectively), each of which is physically coupled to the frame; wherein the frame is configured to hold CAM2 and CAM3 less than 15 cm from the user's face, to the right and to the left of the vertical symmetry axis that divides the user's face, respectively; wherein CAM2 and CAM3 are configured to take thermal measurements of regions on the right and left periorbital areas (TH_ROI1and TH_ROI2, respectively); and wherein the computer is further configured to generate additional feature values based on TH_ROI1and TH_ROI2, and to utilize the additional feature values to detect the allergic reaction. (0)

5. The system of claim 2, wherein the computer is further configured to detect an early rise in the temperature of the region of the nose, which is evident before the user is aware of a symptom of the allergic reaction; and further comprising a user interface configured to alert the user of a possible allergic reaction before the user is aware of the symptom of the allergic reaction, responsive to a detection of the early rise in the temperature of the region of the nose. (0)

6. The system of claim 1, further comprising a sensor configured to take additional measurements (m_conf) of at least one of the following: the user, and the environment in which the user was in while TH_Nwere taken; wherein the computer is further configured to generate, based on m_conf, one or more feature values and to utilize the one or more feature values to detect the allergic reaction; whereby m_confare indicative of an extent to which a confounding factor occurred while TH_Nwere taken. (0)

7. The system of claim 1, wherein the previous TH_Ncomprise: a first set of TH_Ntaken while the user had an allergic reaction, and a second set of TH_Ntaken while the user did not have an allergic reaction. (0)

8. The system of claim 1, wherein the computer is further configured to generate samples based on data comprising the previous TH_Nand corresponding indications of whether the user experienced an allergic reaction, and to train the machine learning-based model based on the samples; and wherein the previous TH_Ncomprise: a first set of TH_Ntaken while the user was indoors, and a second set of TH_Ntaken while the user was outdoors. (0)

9. The system of claim 1, wherein the computer is further configured to generate samples based on data comprising the previous TH_Nand corresponding indications of whether the user experienced an allergic reaction, and to train the machine learning-based model based on the samples; and wherein the previous TH_Ncomprise: a first set of TH_Ntaken while the user was sitting, and a second set of TH_Ntaken while the user was walking. (0)

10. The system of claim 1, wherein the computer is further configured to: (i) generate samples based on data comprising the previous TH_N, corresponding indications of whether the user experienced an allergic reaction, and additional physiological measurements taken while the previous TH_Nwere taken, and (ii) train the machine learning-based model based on the samples; and wherein the additional physiological measurements are indicative of one or more of the following signals of the user: heart rate, heart rate variability, brainwave activity, galvanic skin response, muscle activity, and extent of movement. (0)

11. The system of claim 1, wherein the computer is further configured to: (i) generate samples based on data comprising the previous TH_N, corresponding indications of whether the user experienced an allergic reaction, and measurements of the environment in which the user was in while the previous TH_Nwere taken, and (ii) train the machine learning-based model based on the samples; and wherein the measurements of the environment are indicative of one or more of the following values of the environment: temperature, humidity level, noise level, air quality, wind speed, and infrared radiation level. (0)

12. The system of claim 1, wherein the computer is further configured to: (i) generate samples based on data comprising the previous TH_N, corresponding indications of whether the user experienced an allergic reaction, and indications of exposure of the user to one or more allergens up to twelve hours before some of the previous TH_Nwere taken, and (ii) train the machine learning-based model based on the samples; wherein the indications of exposure are indicative of one or more of the following: consumption of a certain drug, consumption of a certain food item, exposure to at least a certain concentration of pollen, exposure to at least a certain concentration of dust, exposure to a certain cosmetics product, and exposure to a certain aerosol. (0)

13. A method for performing a personalized detection of an allergic reaction, comprising: (7) (3)

taking thermal measurements of a region on the nose (TH_N) of a user utilizing an inward-facing head-mounted thermal camera;

generating feature values based on TH_N; and

utilizing a machine learning-based model for detecting an allergic reaction of the user based on the feature values; wherein the machine learning-based model was trained based on previous TH_Ntaken during different days.

14. The method of claim 13, wherein the previous TH_Ncomprise: a first set of TH_Ntaken while the user had an allergic reaction, and a second set of TH_Ntaken while the user did not have an allergic reaction; and further comprising detecting an early rise in the temperature on the region of the nose, which is evident before the user is aware of a symptom of the allergic reaction, and responsive to detecting the early rise in the temperature on the region of the nose, alerting the user about a possible allergic reaction before the user is aware of the symptom of the allergic reaction. (0)

15. The method of claim 13, further comprising: utilizing second and third inward-facing head-mounted thermal cameras (CAM2 and CAM3, respectively) for taking thermal measurements of regions on the right and left sides of the cheeks (TH_ROI1and TH_ROI2, respectively); generating additional feature values based on TH_ROI1and TH_ROI2; and detecting the allergic reaction based on the feature values and the additional feature values; wherein CAM2 and CAM3 are physically coupled to a frame worn on the user's head, which is configured to hold CAM2 and CAM3 less than 15 cm from the user's face at positions that are to the right and to the left of the vertical symmetry axis that divides the user's face, respectively. (0)

16. The method of claim 13, further comprising: utilizing second and third inward-facing head-mounted thermal cameras (CAM2 and CAM3, respectively) for taking thermal measurements of regions on the right and left periorbital areas (TH_ROI1and TH_ROI2, respectively); generating additional feature values based on TH_ROI1and TH_ROI2; and detecting the allergic reaction based on the feature values and the additional feature values; wherein CAM2 and CAM3 are physically coupled to a frame worn on the user's head, which is configured to hold CAM2 and CAM3 less than 15 cm from the user's face at positions that are to the right and to the left of the vertical symmetry axis that divides the user's face, respectively. (0)

17. The method of claim 13, wherein the previous TH_Ncomprise: a first set of TH_Ntaken while the user had an allergic reaction, and a second set of TH_Ntaken while the user did not have an allergic reaction. (0)

18. The method of claim 13, further comprising: receiving indications indicating whether the user experienced an allergic reaction, and training the machine learning-based model based on a first subset of the previous TH_Ntaken while the user was indoors, and a second subset of the previous TH_Ntaken while the user was outdoors. (0)

19. The method of claim 13, further comprising: receiving indications indicating whether the user experienced an allergic reaction, and training the machine learning-based model based on a first subset of the previous TH_Ntaken while the user was sitting, and a second subset of the previous TH_Ntaken while the user was walking. (0)

20. The method of claim 13, further comprising (i) generating samples based on data comprising the previous TH_N, corresponding indications whether the user experienced an allergic reaction, and indications of exposure of the user to one or more allergens while some of the previous TH_Nwere taken, or up to twelve hours before the some of the previous TH_Nwere taken, and (ii) training the machine learning-based model based on the samples; wherein the indications of exposure are indicative of one or more of the following: consumption of a certain drug, consumption of a certain food item, exposure to at least a certain concentration of pollen, exposure to at least a certain concentration of dust, exposure to a certain cosmetics product, and exposure to a certain aerosol. (0)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10136852

Detecting an allergic reaction from nasal temperatures

Patent Matrix® Search