Patent US11063881

Methods and apparatus for network delay and distance estimation, computing resource selection, and related techniques
[+] Show Details

US11063881

1. A computerized method for selecting a computing resource from a plurality of computing resources to perform a computing process, the method comprising: (7) (3)

receiving, from a first remote computing device, first data indicative of a request to perform the computing process;

accessing second data indicative of a first set of estimated metrics comprising, for each computing resource of the plurality of computing resources, a first estimated metric between the first remote computing device and the computing resource, wherein: the first estimated metric comprises an estimated delay between the first remote computing device and the computing resource or an estimated distance between the first remote computing device and the computing resource; and

the first estimated metric is computed using a trained machine learning model that takes as input identifying information for the first remote computing device and the computing resource to determine the first estimated metric; and

processing the second data using a machine learning algorithm to select a candidate computing resource from the plurality of computing resources to perform the process, wherein: the machine learning algorithm selects the candidate computing resource based on: a second estimated metric between at least one second remote computing device and an associated computing resource from the plurality of computing resources performing a second computing process for the at least one second remote computing device; and

a capacity of each computing resource of the plurality of computing resources; and

processing the second data using the machine learning algorithm comprises processing the second data using a q-learning algorithm, comprising: executing, for at least a subset of the plurality of computing resources, a reward function to determine a reward value for each computing resource of the subset of computing resources, comprising computing, based on the reward function, data indicative of a quality for each computing resource of the subset of computing resources; and

selecting the candidate computing resource from the subset of computing resources based on the determined reward values.

2. The method of claim 1, further comprising determining the subset of computing resources by eliminating any computing resources of the plurality of computing resources without capacity to perform the computing process from consideration by the reinforcement learning algorithm. (0)

3. The method of claim 1, wherein: (0) (3)

the first set of estimated metrics comprise a first set of estimated distances;

the second estimated metric comprises a second estimated distance; and

selecting the candidate computing resource based on the second estimated metric between the at least one second remote computing device and the associated computing resource comprises: selecting the candidate computing resource by determining (a) a first estimated distance between the remote computing device and the candidate computing resource is less than (b) a second estimated distance between the at least one second remote computing device and the associated computing resource.

4. The method of claim 1, wherein: (0) (3)

5. The method of claim 1, wherein processing the second data using the machine learning algorithm comprises: (2) (2)

processing the second data using a plurality of machine learning algorithms to generate a plurality of sets of reward values for the plurality of computing resources; and

analyzing the sets of reward values to select the candidate computing resource.

6. The method of claim 5, wherein selecting the candidate computing resource from the subset of computing resources based on the determined reward values comprises determining the candidate computing resource has a highest reward value among the sets of reward values. (0)

7. The method of claim 5, wherein selecting the candidate computing resource from the subset of computing resources based on the determined reward values comprises: (0) (2)

8. The method of claim 1, wherein accessing the second data indicative of the first set of estimated metrics comprises: (2) (1)

computing, for each computing resource of the plurality of computing resources, a first estimated delay between the remote computing device and the computing resource by executing the trained machine learning model, comprising: inputting first identifying information for the remote computing device and second identifying information for the computing resource to the trained machine learning model; and

receiving, from the trained machine learning model, the first estimated delay.

9. The method of claim 8, wherein: (1) (3)

inputting the first identifying information comprises inputting a first IP address for the remote computing device;

inputting the second identifying information comprises inputting a second IP address for the computing resource; and

receiving the first estimated delay comprises receiving, from the trained machine learning model, an estimated round trip time between the remote computing device and the computing resource.

10. The method of claim 9, wherein inputting the first and second IP addresses comprises: (2) (1)

extracting, for each of the first IP address and the second IP address, one or more of: a geographical location;

an autonomous system;

a domain name server;

a virtual private network;

a continent name; and

a country name,

to generate first extracted location features for the remote computing device and second extracted location features for the computing resource.

11. The method of claim 10, further comprising encoding (a) one or more features of the first extracted location features and (b) one or more features of the second extracted location features from a non-numerical value to a numerical value. (0)

12. The method of claim 10, further comprising: (0) (1)

13. The method of claim 8, wherein executing the trained machine learning model comprises: (0) (3)

14. The method of claim 1, wherein: (0) (2)

15. The method of claim 1, wherein: (0) (2)

16. A non-transitory computer-readable media comprising instructions that, when executed by one or more processors on a computing device, are operable to cause the one or more processors to select a computing resource from a plurality of computing resources to perform a computing process, comprising: (0) (5)

receiving, from a first remote computing device, first data indicative of a request to perform the computing process;

the first estimated metric comprises an estimated delay between the first remote computing device and the computing resource or an estimated distance between the first remote computing device and the computing resource; and

a capacity of each computing resource of the plurality of computing resources; and

selecting the candidate computing resource from the subset of computing resources based on the determined reward values.

17. A system comprising a memory storing instructions, and a processor configured to execute the instructions to select a computing resource from a plurality of computing resources to perform a computing process by performing: (0) (3)

receiving, from a first remote computing device, first data indicative of a request to perform the computing process;

a capacity of each computing resource of the plurality of computing resources; and

selecting the candidate computing resource from the subset of computing resources based on the determined reward values.

View Abstract and Specification Size

PDF with Images and Document Face >

Full Text Publication >

Patent US11063881

Methods and apparatus for network delay and distance estimation, computing resource selection, and related techniques

Patent Matrix® Search