Search All Applications in Sports Analytics
Application US20200279398
Published 2020-09-03
System And Method For Calibrating Moving Camera Capturing Broadcast Video
A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.
Much More than Average Length Specification
View the Patent Matrix® Diagram to Explore the Claim Relationships
USPTO Full Text Publication >
- 1. A method of calibrating moving cameras capturing a sporting event, comprising:
retrieving, by a computing system, a broadcast video feed for a sporting event, the broadcast video feed comprising a plurality of video frames; labeling, by the computing system via a neural network, components of a playing surface captured in each video frame; matching, by the computing system, a subset of labeled video frames to a set of templates with various camera perspectives; fitting, by the computing system, a playing surface model to the set of labeled video frames that were matched to the set of templates; identifying, by the computing system, camera motion in each video frame using an optical flow model; generating, by the computing system, a homography matrix for each video frame based on the fitted playing surface model and camera motion; and calibrating, by the computing system, each camera based on the homography matrix generated for each video frame.
- 8. A system for calibrating moving cameras capturing a sporting event, comprising:
a processor; and a memory having programming instructions stored thereon, which, when executed by the processor, performs one or more operations, comprising:
retrieving a broadcast video feed for a sporting event, the broadcast video feed comprising a plurality of video frames;
labeling, via a neural network, components of a playing surface captured in each video frame;
matching a subset of labeled video frames to a set of templates with various camera perspectives;
fitting a playing surface model to the set of labeled video frames that were matched to the set of templates;
identifying camera motion in each video frame using an optical flow model;
generating a homography matrix for each video frame based on the fitted playing surface model and camera motion; and
calibrating each camera based on the homography matrix generated for each video frame.
- 15. A non-transitory computer readable medium including one or more sequences of instructions that, when executed by one or more processors, perform one or more operations comprising:
retrieving, by a computing system, a broadcast video feed for a sporting event, the broadcast video feed comprising a plurality of video frames; labeling, by the computing system via a neural network, components of a playing surface captured in each video frame; matching, by the computing system, a subset of labeled video frames to a set of templates with various camera perspectives; fitting, by the computing system, a playing surface model to the set of labeled video frames that were matched to the set of templates; identifying, by the computing system, camera motion in each video frame using an optical flow model; generating, by the computing system, a homography matrix for each video frame based on the fitted playing surface model and camera motion; and calibrating, by the computing system, each camera based on the homography matrix generated for each video frame.
