Patent US10536758

Customized generation of highlight show with narrative component
[+] Show Details

US10536758

1. A computer-implemented method for generating a customized highlight show having a narrative, for presentation to a user, comprising: (10) (13)

at a web server, receiving a request for the customized highlight show from a client device and passing the request to an application server;

at a hardware processor of the application server, receiving an electronic signal comprising source content representing at least a portion of at least one sporting event;

at the hardware processor of the application server, determining, based on available metadata, which sport of a plurality of sports is depicted in the source content, wherein each sport in the plurality has a stored play definition, the play definition including criteria for determining play start time and play end time for that sport;

at the hardware processor of the application server, identifying at least one narrative relating to at least a portion of the source content, wherein the at least one narrative provides a coherent story that links a set of segments relating to at least one of a participant, team, story, and play associated with the at least one sporting event;

at the hardware processor of the application server, identifying the play definition for the sport depicted in the source content;

at at least one of the hardware processor of the application server and a hardware processor of an analytical server, based on the identified play definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual plays within the at least one sporting event;

at the hardware processor of at least one of the application server and the analytical server, performing video analysis on a video component of the source content to establish at least one of a suitable start and end time for each identified individual play;

at the hardware processor of at least one of the application server and the analytical server, automatically prioritizing the identified plays based at least in part on the degree to which they support the identified at least one narrative;

at the hardware processor of at least one of the application server and the analytical server, automatically generating a plurality of segments from the representation of the at least one sporting event, each segment having a start time and an end time, and each segment corresponding to at least one of the identified individual plays within the at least one sporting event, wherein, for each generated segment, at least one of the start and end times is selected based on at least one of the established suitable start and end times;

at the hardware processor of at least one of the application server and the analytical server, automatically adjusting at least one of the start and end times of at least one of the segments corresponding to at least one of the selected plays;

at the hardware processor of the application server, automatically generating a customized highlight show for the at least one sporting event, based on the identified and prioritized plays, wherein the customized highlight show comprises at least a subset of the generated segments using at least one of the adjusted start and end times;

transmitting the customized highlight show from the application server to the client device; and

at an output device of the client device, outputting the customized highlight show.

2. The computer-implemented method of claim 1, wherein automatically prioritizing the identified plays comprises: (8) (8)

obtaining auxiliary data describing the identified plays; and

augmenting the source content with the obtained auxiliary data;

and wherein automatically generating a plurality of segments from the representation of the at least one sporting event comprises:

generating highlight segments based on the augmented source content;

selecting highlight segments based on the degree to which they relate to the identified at least one narrative;

tagging the selected highlight segments; and

generating at least one output file comprising a representation of the tagged highlight segments;

and wherein automatically generating the customized highlight show for the at least one sporting event comprises automatically generating the customized highlight show based on the at least one output file.

3. The computer-implemented method of claim 2, wherein obtaining auxiliary data describing the identified plays comprises at least one selected from the group consisting of: (0) (4)

4. The computer-implemented method of claim 2, wherein obtaining auxiliary data describing the identified plays comprises: (0) (5)

loading the auxiliary data;

automatically determining whether there are any errors in the loaded data;

responsive to a determination of at least one error, automatically correcting the at least one error;

automatically determining whether there are any inconsistencies in the loaded data; and

responsive to a determination of at least one inconsistency, automatically reconciling the at least one inconsistency.

5. The computer-implemented method of claim 2, wherein augmenting the source content with the obtained auxiliary data comprises: (0) (3)

6. The computer-implemented method of claim 2, wherein automatically prioritizing the identified plays further comprises: (0) (2)

7. The computer-implemented method of claim 2, wherein generating highlight segments based on the augmented source content comprises performing at least one selected from the group consisting of: (0) (4)

automatically verifying plays within the augmented source content and storing data describing the identified plays;

automatically identifying possessions within the augmented source content and storing data describing the identified possessions;

automatically identifying sequences within the augmented source content and storing data describing the identified sequences; and

automatically identifying strings within the augmented source content and storing data describing the identified strings.

8. The computer-implemented method of claim 2, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative comprises: (1) (3)

automatically determining a narrative bonus for each identified play;

automatically determining segment priorities for the identified plays, based at least in part on the narrative bonuses; and

automatically selecting highlight segments, based on the determined segment priorities.

9. The computer-implemented method of claim 8, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative further comprises: (0) (2)

10. The computer-implemented method of claim 2, wherein tagging the selected highlight segments comprises: (0) (2)

11. The computer-implemented method of claim 2, wherein generating at least one output file comprises: (1) (4)

automatically creating individual segment profiles;

automatically sorting the segment profiles;

automatically generating a default file containing the sorted segment profiles; and

at a storage device, automatically storing the generated default file.

12. The computer-implemented method of claim 11, wherein generating at least one output file further comprises: (0) (2)

13. The computer-implemented method of claim 1, further comprising: (3) (2)

at the hardware processor of at least one of the application server and the analytical server, automatically determining at least one characteristic of the user;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the determined at least one characteristic of the user.

14. The computer-implemented method of claim 13, wherein automatically determining at least one characteristic of the user comprises automatically determining the user's affinity for at least one of a team, sport, player, and league. (0)

15. The computer-implemented method of claim 13, wherein automatically determining at least one characteristic of the user comprises automatically determining at least one selected from the group consisting of: (0) (3)

16. The computer-implemented method of claim 13, wherein automatically prioritizing the identified plays comprises automatically determining priorities based at least in part on excitement level that takes into account at least one determined characteristic of the user. (0)

17. The computer-implemented method of claim 1, wherein automatically prioritizing the identified plays comprises automatically determining priorities based at least in part on a determined excitement level. (0)

18. The computer-implemented method of claim 1, wherein outputting the customized highlight show comprises displaying video of the customized highlight show on a display device of the client device. (0)

19. The computer-implemented method of claim 1, wherein outputting the customized highlight show comprises outputting audio of the customized highlight show on the client device. (0)

20. The computer-implemented method of claim 1, wherein receiving an electronic signal comprising source content representing at least portion of a plurality of events comprises receiving an electronic signal representing at least one selected from the group consisting of: (0) (12)

a live broadcast;

a recorded broadcast;

a video archive;

content from a website;

content from a video-sharing site;

content stored on a server;

content stored on a mobile computing device;

content stored on a camera;

on-demand content;

content stored locally;

content captured by a device associated with the user; and

pre-curated content.

45. The method of claim 1, wherein each sport in the plurality has a stored string definition including criteria for determining whether a series of plays are related to one another and for determining string start time and string end time for that sport, the method further comprising: (0) (3)

at the hardware processor of the application server, identifying the string definition for the sport depicted in the source content; and

at the hardware processor of the application server, based on the identified string definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual strings within the at least one sporting event and to determine start and end times for the individual strings, wherein each string comprises a series of plays that are related to one another;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in strings that support the identified at least one narrative.

46. The method of claim 1, wherein each sport in the plurality has a stored possession definition including criteria for determining whether one or more plays are part of the same possession and for determining possession start time and possession end time for that sport, the method further comprising: (0) (3)

at the hardware processor of the application server, identifying the possession definition for the sport depicted in the source content; and

at the hardware processor of the application server, based on the identified possession definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual possessions within the at least one sporting event and to determine start and end times for the individual possessions, wherein each possession comprises at least one play;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in possessions that support the identified at least one narrative.

47. The method of claim 1, wherein each sport in the plurality has a stored sequence definition including criteria for determining whether one or more plays are part of the same sequence and for determining sequence start time and sequence end time for that sport, the method further comprising: (0) (3)

at the hardware processor of the application server, identifying the sequence definition for the sport depicted in the source content; and

at the hardware processor of the application server, based on the identified sequence definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual sequences within the at least one sporting event and to determine start and end times for the individual sequences, wherein each sequence comprises at least one play;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in sequences that support the identified at least one narrative.

54. The computer-implemented method of claim 1, further comprising: (0) (3)

at the hardware processor of the application server, determining an available time for the customized highlight show;

and wherein automatically generating a customized highlight show comprises automatically selecting plays so that the customized highlight show is of a length that comports with the determined available time;

and wherein automatically adjusting at least one of the start and end times of at least one of the segments comprises automatically adjusting at least one of the start and end times of at least one of the segments so that the total length of the segments corresponding to the selected plays comports with the determined available time.

21. At least one non-transitory computer-readable medium for generating a customized highlight show having a narrative, for presentation to a user, comprising instructions stored thereon, that when executed by at least one processor, perform the steps of: (8) (13)

at a web server, receiving a request for the customized highlight show from a client device and passing the request to an application server;

at the application server, receiving an electronic signal comprising source content representing at least a portion of at least one sporting event;

at the application server, determining, based on available metadata, which sport of a plurality of sports is depicted in the source content, wherein each sport in the plurality has a stored play definition, the play definition including criteria for determining play start time and play end time for that sport;

at the application server, identifying at least one narrative relating to at least a portion of the source content, wherein the at least one narrative provides a coherent story that links a set of segments relating to at least one of a participant, team, story, and play associated with the at least one sporting event;

at the application server, identifying the play definition for the sport depicted in the source content;

at at least one of the application server and an analytical server, based on the identified play definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual plays within the at least one sporting event;

at at least one of the application server and an analytical server, performing video analysis on a video component of the source content to establish at least one of a suitable start and end time for each identified individual play;

at at least one of the application server and the analytical server, automatically prioritizing the identified plays based at least in part on the degree to which they support the identified at least one narrative;

at at least one of the application server and an analytical server, automatically generating a plurality of segments from the representation of the at least one sporting event, each segment having a start time and an end time, and each segment corresponding to at least one of the identified individual plays within the at least one sporting event, wherein, for each generated segment, at least one of the start and end times is selected based on at least one of the established suitable start and end times;

at at least one of the application server and an analytical server, automatically adjusting at least one of the start and end times of at least one of the segments corresponding to at least one of the selected plays;

at the application server, automatically generating the customized highlight show for the at least one sporting event, based on the identified and prioritized plays, wherein the customized highlight show comprises at least a subset of the generated segments using at least one of the adjusted start and end times;

transmitting the customized highlight show from the application server to the client device; and

causing an output device of the client device to output the customized highlight show.

22. The at least one non-transitory computer-readable medium of claim 21, wherein automatically prioritizing the identified plays comprises: (4) (8)

obtaining auxiliary data describing the identified plays; and

augmenting the source content with the obtained auxiliary data;

and wherein automatically generating a plurality of segments from the representation of the at least one sporting event comprises:

generating highlight segments based on the augmented source content;

selecting highlight segments based on the degree to which they relate to the identified at least one narrative;

tagging the selected highlight segments; and

generating at least one output file comprising a representation of the tagged highlight segments;

and wherein automatically generating the customized highlight show for the at least one sporting event comprises automatically generating a customized highlight show based on the at least one output file.

23. The at least one non-transitory computer-readable medium of claim 22, wherein obtaining auxiliary data describing the identified plays comprises at least one selected from the group consisting of: (0) (4)

24. The at least one non-transitory computer-readable medium of claim 22, wherein obtaining auxiliary data describing the identified plays comprises: (0) (5)

loading the auxiliary data;

automatically determining whether there are any errors in the loaded data;

responsive to a determination of at least one error, automatically correcting the at least one error;

automatically determining whether there are any inconsistencies in the loaded data; and

responsive to a determination of at least one inconsistency, automatically reconciling the at least one inconsistency.

25. The at least one non-transitory computer-readable medium of claim 22, wherein generating highlight segments based on the augmented source content comprises performing at least one selected from the group consisting of: (0) (4)

automatically verifying plays within the augmented source content and storing data describing the identified plays;

automatically identifying possessions within the augmented source content and storing data describing the identified possessions;

automatically identifying sequences within the augmented source content and storing data describing the identified sequences; and

automatically identifying strings within the augmented source content and storing data describing the identified strings.

26. The at least one non-transitory computer-readable medium of claim 22, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative comprises: (1) (3)

automatically determining a narrative bonus for each identified play;

automatically determining segment priorities for the identified plays, based at least in part on the narrative bonuses; and

automatically selecting highlight segments, based on the determined segment priorities.

27. The at least one non-transitory computer-readable medium of claim 26, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative further comprises: (0) (2)

28. The at least one non-transitory computer-readable medium of claim 21, further comprising instructions that, when executed by the at least one processor, perform the step of: (1) (2)

30. The at least one non-transitory computer-readable medium of claim 21, wherein automatically prioritizing the identified plays comprises automatically determining priorities based at least in part on a determined excitement level. (0)

31. The at least one non-transitory computer-readable medium of claim 21, wherein receiving an electronic signal comprising source content representing at least portion of a plurality of events comprises receiving an electronic signal representing at least one selected from the group consisting of: (0) (12)

a live broadcast;

a recorded broadcast;

a video archive;

content from a website;

content from a video-sharing site;

content stored on a server;

content stored on a mobile computing device;

content stored on a camera;

on-demand content;

content stored locally;

content captured by a device associated with the user; and

pre-curated content.

48. The non-transitory computer-readable medium of claim 21, wherein each sport in the plurality has a stored string definition including criteria for determining whether a series of plays are related to one another and for determining string start time and string end time for that sport, the non-transitory computer-readable medium further comprising instructions that, when executed by the at least one processor, perform the steps of: (0) (3)

identifying the string definition for the sport depicted in the source content; and

based on the identified string definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual strings within the at least one sporting event and to determine start and end times for the individual strings, wherein each string comprises a series of plays that are related to one another;

49. The non-transitory computer-readable medium of claim 21, wherein each sport in the plurality has a stored possession definition including criteria for determining whether one or more plays are part of the same possession and for determining possession start time and possession end time for that sport, the non-transitory computer-readable medium further comprising instructions that, when executed by the at least one processor, perform the steps of: (0) (3)

identifying the possession definition for the sport depicted in the source content; and

based on the identified possession definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual possessions within the at least one sporting event and to determine start and end times for the individual possessions, wherein each possession comprises at least one play;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in possessions that support the identified at least one narrative.

50. The non-transitory computer-readable medium of claim 21, wherein each sport in the plurality has a stored sequence definition including criteria for determining whether one or more plays are part of the same sequence and for determining sequence start time and sequence end time for that sport, the non-transitory computer-readable medium further comprising instructions that, when executed by the at least one processor, perform the steps of: (0) (3)

identifying the sequence definition for the sport depicted in the source content; and

based on the identified sequence definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual sequences within the at least one sporting event and to determine start and end times for the individual sequences, wherein each sequence comprises at least one play;

wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in sequences that support the identified at least one narrative.

55. The at least one non-transitory computer-readable medium of claim 21, further comprising instructions that, when executed by the at least one processor, perform the step of: (0) (3)

32. A system for generating a customized highlight show having a narrative, for presentation to a user, comprising: (10) (8)

a web server, configured to receive a request for the customized highlight show from a client device and to pass the request to an application server;

the application server, communicatively coupled to the web server, comprising a hardware processor configured to perform the steps of: receiving an electronic signal comprising source content representing at least a portion of at least one sporting event;

determining, based on available metadata, which sport of a plurality of sports is depicted in the source content, wherein each sport in the plurality has a stored play definition, the play definition including criteria for determining play start time and play end time for that sport;

identifying at least one narrative relating to at least a portion of the source content, wherein the at least one narrative provides a coherent story that links a set of segments relating to at least one of a participant, team, story, and play associated with the at least one sporting event; and

identifying the play definition for the sport depicted in the source content; and

an analytical server, communicatively coupled to the application server, comprising a hardware processor configured to perform the steps of: based on the identified play definition for the sport depicted in the source content and based on the available metadata, performing an analysis to identify individual plays within the at least one sporting event;

performing video analysis on a video component of the source content to establish at least one of a suitable start and end time for each identified individual play; and

automatically prioritizing the identified plays based at least in part on the degree to which they support the identified at least one narrative;

wherein the hardware processor of the application server is further configured to perform the steps of:

automatically generating a plurality of segments from the representation of the at least one sporting event, each segment having a start time and an end time, and each segment corresponding to at least one of the identified individual plays within the at least one sporting event, wherein, for each generated segment, at least one of the start and end times is selected based on at least one of the established suitable start and end times;

automatically adjusting at least one of the start and end times of at least one of the segments corresponding to at least one of the selected plays;

automatically generating the customized highlight show for the at least one sporting event, based on the identified and prioritized plays, wherein the customized highlight show comprises at least a subset of the generated segments using at least one of the adjusted start and end times; and

transmitting the customized highlight show from the application server to the client device for output thereon.

33. The system of claim 32, wherein automatically prioritizing the identified plays comprises: (4) (8)

obtaining auxiliary data describing the identified plays; and

augmenting the source content with the obtained auxiliary data;

and wherein automatically generating a plurality of segments from the representation of the at least one sporting event comprises:

generating highlight segments based on the augmented source content;

selecting highlight segments based on the degree to which they relate to the identified at least one narrative;

tagging the selected highlight segments; and

generating at least one output file comprising a representation of the tagged highlight segments;

34. The system of claim 33, wherein obtaining auxiliary data describing the identified plays comprises at least one selected from the group consisting of: (0) (4)

35. The system of claim 33, wherein obtaining auxiliary data describing the identified plays comprises: (0) (5)

loading the auxiliary data;

automatically determining whether there are any errors in the loaded data;

responsive to a determination of at least one error, automatically correcting the at least one error;

automatically determining whether there are any inconsistencies in the loaded data; and

responsive to a determination of at least one inconsistency, automatically reconciling the at least one inconsistency.

36. The system of claim 33, wherein generating highlight segments based on the augmented source content comprises performing at least one selected from the group consisting of: (0) (4)

automatically verifying plays within the augmented source content and storing data describing the identified plays;

automatically identifying possessions within the augmented source content and storing data describing the identified possessions;

automatically identifying sequences within the augmented source content and storing data describing the identified sequences; and

automatically identifying strings within the augmented source content and storing data describing the identified strings.

37. The system of claim 33, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative comprises: (1) (3)

automatically determining a narrative bonus for each identified play;

automatically determining segment priorities for the identified plays, based at least in part on the narrative bonuses; and

automatically selecting highlight segments, based on the determined segment priorities.

38. The system of claim 37, wherein selecting highlight segments based on the degree to which they relate to the identified at least one narrative further comprises: (0) (2)

39. The system of claim 32, wherein the hardware processor of the analytical server is further configured to automatically determine at least one characteristic of the user; (1) (1)

41. The system of claim 32, wherein automatically prioritizing the identified plays comprises automatically determining priorities based at least in part on a determined excitement level. (0)

42. The system of claim 32, wherein transmitting the customized highlight show from the application server to the client device comprises transmitting the customized highlight show from the application server to the client device for display on a display device configured to display video of the customized highlight show. (0)

43. The system of claim 32, wherein transmitting the customized highlight show from the application server to the client device comprises transmitting the customized highlight show from the application server to the client device for output on an audio device configured to output audio of the customized highlight show. (0)

44. The system of claim 32, wherein receiving an electronic signal comprising source content representing at least portion of a plurality of events comprises receiving an electronic signal representing at least one selected from the group consisting of: (0) (12)

a live broadcast;

a recorded broadcast;

a video archive;

content from a website;

content from a video-sharing site;

content stored on a server;

content stored on a mobile computing device;

content stored on a camera;

on-demand content;

content stored locally;

content captured by a device associated with the user; and

pre-curated content.

51. The system of claim 32, wherein each sport in the plurality has a stored string definition including criteria for determining whether a series of plays are related to one another and for determining string start time and string end time for that sport, and wherein the hardware processor is further configured to perform the steps of: (0) (3)

identifying the string definition for the sport depicted in the source content; and

and wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in strings that support the identified at least one narrative.

52. The system of claim 32, wherein each sport in the plurality has a stored possession definition including criteria for determining whether one or more plays are part of the same possession and for determining possession start time and possession end time for that sport, and wherein the hardware processor is further configured to perform the steps of: (0) (3)

identifying the possession definition for the sport depicted in the source content; and

and wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in possessions that support the identified at least one narrative.

53. The system of claim 32, wherein each sport in the plurality has a stored sequence definition including criteria for determining whether one or more plays are part of the same sequence and for determining sequence start time and sequence end time for that sport, and wherein the hardware processor is further configured to perform the steps of: (0) (3)

identifying the sequence definition for the sport depicted in the source content; and

and wherein automatically prioritizing the identified plays comprises automatically prioritizing the identified plays based at least in part on the degree to which they are included in sequences that support the identified at least one narrative.

56. The system of claim 32, wherein the web server is further configured to determine an available time for the customized highlight show; (0) (2)

57. A computer-implemented method for generating a customized highlight show having a narrative, for presentation to a user, comprising: (0) (12)

at a web server, receiving a request for the customized highlight show from a client device and passing the request to an application server;

at a hardware processor of the application server, receiving an electronic signal comprising source content representing at least a portion of at least one sporting event;

at the hardware processor of the application server, identifying the play definition for the sport depicted in the source content;

transmitting the customized highlight show from the application server to the client device; and

at an output device of the client device, outputting the customized highlight show.

58. At least one non-transitory computer-readable medium for generating a customized highlight show having a narrative, for presentation to a user, comprising instructions stored thereon, that when executed by at least one processor, perform the steps of: (0) (12)

at a web server, receiving a request for the customized highlight show from a client device and passing the request to an application server;

at the application server, receiving an electronic signal comprising source content representing at least a portion of at least one sporting event;

at the application server, identifying the play definition for the sport depicted in the source content;

transmitting the customized highlight show from the application server to the client device; and

causing an output device of the client device to output the customized highlight show.

59. A system for generating a customized highlight show having a narrative, for presentation to a user, comprising: (0) (7)

a web server, configured to receive a request for the customized highlight show from a client device and to pass the request to an application server;

identifying the play definition for the sport depicted in the source content;

performing video analysis on a video component of the source content to establish at least one of a suitable start and end time for each identified individual play, wherein the video analysis comprises analysis of a video component representing a game clock; and

automatically prioritizing the identified plays based at least in part on the degree to which they support the identified at least one narrative;

wherein the hardware processor of the application server is further configured to perform the steps of:

transmitting the customized highlight show from the application server to the client device for output thereon.

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10536758

Customized generation of highlight show with narrative component

Patent Matrix® Search