Patent US10554713

Low latency application streaming using temporal frame transformation
[+] Show Details

US10554713

1. A system, comprising: (4) (2)

at least one processing device; and

a storage device configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device to: execute a first instance of an application;

generate a first instance first frame and a first instance second frame corresponding to the first instance of the application, the first instance first frame and the first instance second frame each comprising a first level quality attribute;

receive, from a remote server, a resolution delta frame identifying a difference between a second instance first quality first frame and a second instance second quality first frame corresponding to a second instance of the application executing on the remote server, the second instance first quality first frame comprising the first level quality attribute and the second instance second quality first frame comprising a second level quality attribute;

transform the first instance second frame into a transformed frame based at least in part on applying the resolution delta frame received from the remote server to the first instance second frame, the transformed frame comprising the second quality level attribute; and

transmit the transformed frame to a client.

2. The system of claim 1, the storage device further configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device further to: (0) (2)

3. The system of claim 1, (0) (2)

4. The system of claim 1, wherein the storage device further configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device further to: (2) (1)

substantially synchronize the first instance of the application with the second instance of the application executing on the remote server.

5. The system of claim 4, (0) (1)

6. The system of claim 4, the storage device further configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device further to: (0) (1)

7. The system of claim 1, the storage device further configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device further to: (0) (2)

8. A method, comprising: (5) (5)

executing, on an edge server, a first instance of an application;

generating, on the edge server, a motion delta frame comprising motion compensation information to identify differences between a first frame of the first instance of the application and a second frame of the first instance of the application, the first frame of the first instance and the second frame of the first instance comprising a first level quality attribute;

receiving, at the edge server from a remote server, a resolution delta frame identifying differences between a first quality first frame of a second instance of the application executing on the remote server and a second quality first frame of the second instance of the application executing on the remote server, the first quality first frame of the second instance comprising the first level quality attribute and the second quality first frame of the second instance comprising a second level quality attribute;

transforming, at the edge server, the second frame of the first instance into a transformed frame based at least in part on applying the motion delta frame and the resolution delta frame to the second frame of the first instance; and

transmitting, from the edge server, the transformed frame to a client.

9. The method of claim 8, (1) (1)

wherein the motion delta frame identifies macro-block differences between the first frame of the first instance of the application and the second frame of the first instance of the application.

10. The method of claim 9, (1) (1)

12. The method of claim 8, (1) (2)

wherein the first level quality attribute comprises a first resolution; and

wherein the second level quality attribute comprises a second resolution.

13. The method of claim 12, (0) (2)

14. The method of claim 8, further comprising: (0) (1)

15. The method of claim 8, further comprising: (0) (1)

16. The method of claim 8, further comprising: (0) (2)

17. A non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed, cause one or more processors to perform operations comprising: (3) (5)

executing a first instance of an application;

receiving, from a remote server, a resolution delta frame that indicates differences between a first resolution first frame of a second instance of the application executing on the remote server and a second resolution first frame of the second instance of the application executing on the remote server;

identifying a first resolution second frame of the first instance of the application;

transforming the first resolution second frame of the first instance into a second resolution transformed frame by applying the resolution delta frame to the first resolution second frame of the first instance of the application; and

transmitting the second resolution transformed frame to a client, the first resolution second frame of the first instance and a first resolution first frame of the second instance comprising a first resolution and the second resolution first frame of the second instance comprising a second resolution higher than the first resolution.

18. The non-transitory computer-readable medium of claim 17, wherein the operations further comprise: (0) (2)

19. The non-transitory computer-readable medium of claim 17, wherein the operations further comprise: (0) (1)

20. The non-transitory computer-readable medium of claim 17, wherein the operations further comprise: (0) (2)

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US10554713

Low latency application streaming using temporal frame transformation

Patent Matrix® Search