Patent US10154191

Emotional/cognitive state-triggered recording
[+] Show Details

US10154191

1. A system comprising: (9) (4)

a camera configured to capture video data;

a buffer configured to store the video data captured by the camera;

a sensor data analysis module configured to determine an emotional or cognitive state of a user based at least in part on sensor data representing a physiological condition of the user; and

a recording module configured to: detect a change from a first emotional or cognitive state of the user to a second emotional or cognitive state of the user;

in response to detecting the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user, create a video segment that includes at least a portion of the video data already stored in the buffer at a time the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

capture additional video data after the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

add the additional video data to the video segment;

detect a change from the second emotional or cognitive state of the user to a third emotional or cognitive state of the user;

cease adding the additional video data to the video segment based at least in part on the change from the second emotional or cognitive state of the user to the third emotional or cognitive state of the user; and

store metadata with the video segment, wherein the metadata indicates the second emotional or cognitive state of the user.

2. A system as recited in claim 1, wherein the buffer is configured as a ring buffer. (0)

3. A system as recited in claim 1, wherein the physiological condition of the user includes any combination of one or more of: (0) (10)

a galvanic skin response;

a skin temperature;

electrical activity of a brain;

electrical activity of a heart;

an eye movement;

a facial expression;

a pupil dilation;

a pupil contraction;

a volume of speech; or

a rate of speech.

4. A system as recited in claim 1, wherein the video data comprises video content that triggers the second emotional or cognitive state of the user. (0)

5. A system as recited in claim 1, further comprising a biometric sensor to generate the sensor data. (0)

6. A system as recited in claim 1, further comprising: (0) (1)

7. A system as recited in claim 1, further comprising a microphone configured to capture audio data, wherein the buffer is further configured to store the audio data captured by the microphone. (0)

8. A system as recited in claim 1, implemented, at least in part, as a head-mounted display device. (0)

9. A system as recited in claim 1, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are a same emotional or cognitive state. (0)

10. A system as recited in claim 1, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are different emotional or cognitive states. (0)

11. A method comprising: (5) (10)

capturing video data with a camera;

recording the video data to a buffer;

receiving sensor data;

analyzing the sensor data to detect changes in an emotional or cognitive state of a user;

in response to detecting a change from a first emotional or cognitive state of the user to a second emotional or cognitive state of the user, creating a video segment that includes at least part of the video data currently in the buffer at a time the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

capturing additional video data after the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

adding the additional video data to the video segment;

detecting a change from the second emotional or cognitive state of the user to a third emotional or cognitive state of the user;

storing metadata with the video segment, wherein the metadata indicates the second emotional or cognitive state of the user.

12. A method as recited in claim 11, wherein receiving the sensor data comprises capturing the sensor data using a biometric sensor. (0)

13. A method as recited in claim 11, wherein the video data comprises video content that triggers the second emotional or cognitive state of the user. (0)

14. A method as recited in claim 11, further comprising detecting a gaze target of the user while capturing the additional video data, wherein the metadata indicates the gaze target of the user. (0)

15. A method as recited in claim 11, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are a same emotional or cognitive state. (0)

16. A method as recited in claim 11, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are different emotional or cognitive states. (0)

17. One or more computer readable storage media having computer-executable instructions stored thereon, which, when executed by a computing device, cause the computing device to perform operations comprising: (3) (9)

capturing video content to a buffer;

receiving sensor data;

based at least in part on the sensor data, detecting a change from a first emotional or cognitive state of a user to a second emotional or cognitive state of the user;

based at least in part on detecting the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user, creating a video segment that includes at least part of the video content currently in the buffer at a time the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

capturing additional video content after the change from the first emotional or cognitive state of the user to the second emotional or cognitive state of the user is detected;

adding the additional video content to the video segment;

detecting a change from the second emotional or cognitive state of the user to a third emotional or cognitive state of the user;

cease adding the additional video content to the video segment based at least in part on the change from the second emotional or cognitive state of the user to the third emotional or cognitive state of the user; and

storing metadata with the video segment, wherein the metadata indicates the second emotional or cognitive state of the user.

18. One or more computer readable storage media as recited in claim 17, wherein the video content triggers the second emotional or cognitive state of the user. (0)

19. One or more computer readable storage media as recited in claim 17, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are a same emotional or cognitive state. (0)

20. One or more computer readable storage media as recited in claim 17, wherein the first emotional or cognitive state of the user and the third emotional or cognitive state of the user are different emotional or cognitive states. (0)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10154191

Emotional/cognitive state-triggered recording

Patent Matrix® Search