ΑΙhub.org
 

PitcherNet helps researchers throw strikes with AI analysis


by
21 May 2025



share this:

Image credit: University of Waterloo.

University of Waterloo researchers have developed new artificial intelligence (AI) technology that can accurately analyze pitcher performance and mechanics using low-resolution video of baseball games.

The system, developed for the Baltimore Orioles by the Waterloo team, plugs holes in much more elaborate and expensive technology already installed in most stadiums that host Major League Baseball (MLB), whose teams have increasingly tapped into data analytics in recent years.

Waterloo researchers convert video of a pitcher’s performance into a two-dimensional model that PitcherNet’s AI algorithm can later analyze. (Credit: University of Waterloo)

Those systems, produced by a company called Hawk-Eye Innovations, use multiple special cameras in each park to catch players in action, but the data they yield is typically available to the home team that owns the stadium those games are played in.

To add away games to their analytics operation, as well as use smartphone video taken by scouts in minor league and college games, the Orioles asked video and AI experts at Waterloo for help about three years ago.

The result is a comparatively simple system called PitcherNet, which overcomes challenges such as motion blurring to track the movements of pitchers on the mound, then yields data on metrics including pitch velocity and release point from standard broadcast and smartphone video.

Waterloo researchers used images generated during the training process to help build the PitcherNet AI technology. (University of Waterloo)

“The Orioles approached us with a problem because they weren’t able to analyze pose positions and, subsequently, the biomechanics of their pitchers at games that may not have access to high-resolution cameras,” said Dr. John Zelek, a professor of systems design engineering and co-director of the Vision and Image Processing (VIP) Lab at Waterloo.

“The goal of our project was to try to duplicate Hawk-Eye technology and go beyond it by producing similar output from broadcast video or a smartphone camera used by a scout sitting somewhere in the stands.”

To help train AI algorithms at the heart of the technology, researchers created three-dimensional avatars of pitchers so their movements could be viewed from numerous vantage points.

Broadcast video taken from centre field is used to create a three-dimensional human model by the PitcherNet system. (University of Waterloo)

Information from video processed by the system is provided to biomechanics analysts for the Orioles, who have committed to jointly funding the project for another year.

That data can be used to adjust how pitchers throw the ball to improve performance or avoid injuries, and assess the future success and durability of pitching prospects.

“Existing technology has already improved baseball analytics,” said Jerrin Bright, a PhD student who had a leading role in the project. “Since it’s limited to home games, however, there is a real need for solutions that work in any setting, especially for scouting. That’s where our system comes in.”

Researchers are now exploring the application of the underlying idea – AI analysis of player poses using standard broadcast and smartphone video – to other professional sports, including hockey and basketball, in addition to other aspects of baseball, such as batting.

A paper on the project, PitcherNet: Powering the Moneyball Evolution in Baseball Video Analytics, was presented at the 2024 IEEF/CVF Conference on Computer Vision and Pattern Recognition.




University of Waterloo




            AIhub is supported by:



Related posts :



RoboCup Logistics League: an interview with Alexander Ferrein, Till Hofmann and Wataru Uemura

  25 Sep 2025
Find out more about the RoboCup league focused on production logistics and the planning.

Data centers consume massive amounts of water – companies rarely tell the public exactly how much

  24 Sep 2025
Why do data centres need so much water, and how much do they use?

Interview with Luc De Raedt: talking probabilistic logic, neurosymbolic AI, and explainability

  23 Sep 2025
AIhub ambassador Liliane-Caroline Demers caught up with Luc de Raedt at IJCAI 2025 to find out more about his research.

Call for AAAI educational AI videos

  22 Sep 2025
Submit your contributions by 30 November 2025.

Self-supervised learning for soccer ball detection and beyond: interview with winners of the RoboCup 2025 best paper award

  19 Sep 2025
Method for improving ball detection can also be applied in other fields, such as precision farming.

How AI is opening the playbook on sports analytics

  18 Sep 2025
Waterloo researchers create simulated soccer datasets to unlock insights once reserved for pro teams.

Discrete flow matching framework for graph generation

and   17 Sep 2025
Read about work presented at ICML 2025 that disentangles sampling from training.

We risk a deluge of AI-written ‘science’ pushing corporate interests – here’s what to do about it

  16 Sep 2025
A single individual using AI can produce multiple papers that appear valid in a matter of hours.



 

AIhub is supported by:






 












©2025.05 - Association for the Understanding of Artificial Intelligence