Patent US10554713 Smart Cities: Edge Computing

Search All Patents in Smart Cities: Edge Computing

Microsoft | Website | LinkedIn | Stock Symbol: MSFT | Headquarters: Redmond, WA

Patent US10554713

Issued 2020-02-04

Low Latency Application Streaming Using Temporal Frame Transformation

The present describes low latency streaming using temporal frame transformation. An execution component in an edge server executes a first instance of an application. A server interface component receives, from a remote server, a resolution delta frame indicating differences between a high resolution first frame and a low resolution first frame of a second instance of the application or, alternatively, receives the high resolution first frame. A video manipulation component generates a motion delta frame by identifying differences between a low resolution first frame and a low resolution second frame of the first instance of the application. The video manipulation component generates a high resolution transformed frame by applying the resolution delta frame and the motion delta frame to the low resolution second frame.

Much More than Average Length Specification

View the Patent Matrix® Diagram to Explore the Claim Relationships

USPTO Full Text Publication >

3 Independent Claims

1. A system, comprising: at least one processing device; and a storage device configured to store instructions that, when executed by the at least one processing device, cause the at least one processing device to: execute a first instance of an application; generate a first instance first frame and a first instance second frame corresponding to the first instance of the application, the first instance first frame and the first instance second frame each comprising a first level quality attribute; receive, from a remote server, a resolution delta frame identifying a difference between a second instance first quality first frame and a second instance second quality first frame corresponding to a second instance of the application executing on the remote server, the second instance first quality first frame comprising the first level quality attribute and the second instance second quality first frame comprising a second level quality attribute; transform the first instance second frame into a transformed frame based at least in part on applying the resolution delta frame received from the remote server to the first instance second frame, the transformed frame comprising the second quality level attribute; and transmit the transformed frame to a client.
8. A method, comprising: executing, on an edge server, a first instance of an application; generating, on the edge server, a motion delta frame comprising motion compensation information to identify differences between a first frame of the first instance of the application and a second frame of the first instance of the application, the first frame of the first instance and the second frame of the first instance comprising a first level quality attribute; receiving, at the edge server from a remote server, a resolution delta frame identifying differences between a first quality first frame of a second instance of the application executing on the remote server and a second quality first frame of the second instance of the application executing on the remote server, the first quality first frame of the second instance comprising the first level quality attribute and the second quality first frame of the second instance comprising a second level quality attribute; transforming, at the edge server, the second frame of the first instance into a transformed frame based at least in part on applying the motion delta frame and the resolution delta frame to the second frame of the first instance; and transmitting, from the edge server, the transformed frame to a client.
17. A non-transitory computer-readable medium having computer-executable instructions stored thereon that, when executed, cause one or more processors to perform operations comprising: executing a first instance of an application; receiving, from a remote server, a resolution delta frame that indicates differences between a first resolution first frame of a second instance of the application executing on the remote server and a second resolution first frame of the second instance of the application executing on the remote server; identifying a first resolution second frame of the first instance of the application; transforming the first resolution second frame of the first instance into a second resolution transformed frame by applying the resolution delta frame to the first resolution second frame of the first instance of the application; and transmitting the second resolution transformed frame to a client, the first resolution second frame of the first instance and a first resolution first frame of the second instance comprising a first resolution and the second resolution first frame of the second instance comprising a second resolution higher than the first resolution.