Patent US10803389

Apparatus and method for determining user's mental state
[+] Show Details

US10803389

1. A terminal system, comprising: (5) (4)

one or more processors configured to:

collect sensor data generated as a user is using a terminal to compose a message;

determine a pictorial representation for the user, based on extracted feature data from the sensor data, the extracted feature data reflecting an observed emotion of the user; and

control an implementation of one or more measures based on the pictorial representation for the user.

2. The system of claim 1, wherein at least one of the one or more processors is further configured to provide an emoticon corresponding to the pictorial representation for the user. (2) (0)

5. The system of claim 1, wherein the extracted feature data includes text input information. (0)

6. The system of claim 1, wherein the one or more processors are further configured to: (5) (3)

determine a mental state of the user based on the extracted feature data from the sensor data reflecting the observed emotion of the user;

determine the pictorial representation for the user, updated based on the extracted feature data from the sensor data and the mental state of the user; and

provide the updated pictorial representation to the user.

7. The system of claim 6, wherein the extracted feature data includes text input information, and the text input information includes one or more of keyboard input information, writing input information, and terminal state information. (0)

8. The system of claim 6, wherein the one or more measures comprise recommending content based on the mental state of the user. (1) (0)

10. The system of claim 6, wherein the extracted feature data includes text input information, and the text input information includes one or more of keyboard input information, writing input information, and terminal state information, and (2) (1)

wherein the sensor data are measured through one or more of a keyboard, a stylus pen, a touch screen, an accelerometer sensor, a gyroscope sensor, a magnetometer sensor, an orientation sensor, a global positioning system (GPS), a barometer sensor, a fingerprint sensor, an illuminance sensor, a microphone, and a software sensor of the terminal.

11. The system of claim 10, wherein (0) (2)

12. The system of claim 10, wherein (0) (3)

the keyboard input information includes at least one of a typing speed, a length of the longest text, a length of the shortest and longest deleted text, a number of words typed per editing, a number of long touches per editing, a frequency of use of backspace key, a frequency of use of enter key, or a frequency of use of special sign,

the writing input information includes at least one of a writing input speed, a writing pressure, a character size, a straightness or curvature of a character stroke, a character interval, a row interval, or writing input regularity, and

the terminal state information includes at least one of a number of shakings of the terminal, a degree of inclination of the terminal, a remaining capacity of a battery, or a voice volume.

13. The system of claim 6, wherein the one or more measures comprise providing information on the mental state of the user, controlling a user interface based on the mental state, and/or recommending content based on the mental state of the user. (0)

14. The system of claim 6, wherein the one or more measures comprise controlling a user interface of the terminal based on the mental state, at least one of the one or more processors being configured to provide the user interface within at least one of a text or messaging application, an email application, a social network service (SNS) application, a multimedia application, a gaming application, an internet browsing application, a shopping application, and a navigation application. (2) (0)

17. The system of claim 1, wherein at least one of the one or more processors is configured to provide the pictorial representation to the user, (0) (2)

18. The system of claim 1, wherein the controlling of the implementation includes providing the pictorial representation for the user as feedback to the user of information of a determination of the emotion of the user. (0)

19. A processor-implemented method of determining a pictorial representation of a user, the method comprising: (5) (3)

collecting sensor data generated as the user is using a terminal configured for composing a message;

determining the pictorial representation for the user, based on extracted feature data from the sensor data, the extracted feature data reflecting an observed emotion of the user; and

controlling an implementation of one or more measures based on the pictorial representation for the user.

20. The method of claim 19, further comprising providing an emoticon corresponding to the pictorial representation for the user. (2) (0)

23. The method of claim 19, wherein the extracted feature data includes text input information. (0)

24. The method of claim 19, further comprising: (5) (3)

determining a mental state of the user based on the extracted feature data from the sensor data reflecting the observed emotion of the user;

determining the pictorial representation for the user, updated based on the extracted feature data from the sensor data and the mental state of the user; and

providing the updated pictorial representation to the user.

25. The method of claim 24, wherein the extracted feature data includes text input information, and the text input information includes one or more of keyboard input information, writing input information, and terminal state information. (0)

26. The method of claim 24, wherein the one or more measures comprise recommending content based on the mental state of the user. (1) (0)

28. The method of claim 24, wherein the extracted feature data includes text input information, and the text input information includes one or more of keyboard input information, writing input information, and terminal state information, and (2) (1)

29. The method of claim 28, wherein (0) (2)

30. The method of claim 28, wherein (0) (3)

the terminal state information includes at least one of a number of shakings of the terminal, a degree of inclination of the terminal, a remaining capacity of a battery, or a voice volume.

31. The method of claim 24, wherein the one or more measures comprise providing information on the mental state of the user, controlling a user interface based on the mental state, and/or recommending content based on the mental state of the user. (0)

32. The method of claim 24, wherein the one or more measures comprise controlling a user interface of the terminal based on the mental state, including providing the user interface within at least one of a text or messaging application, an email application, a social network service (SNS) application, a multimedia application, a gaming application, an internet browsing application, a shopping application, and a navigation application. (2) (0)

35. The method of claim 19, further comprising providing the pictorial representation to the user, (0) (2)

36. The method of claim 19, wherein the controlling of the implementation includes providing the pictorial representation for the user as feedback to the user of information of a determination of the emotion of the user. (0)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10803389

Apparatus and method for determining user's mental state

Patent Matrix® Search