ΑΙhub.org
 

PitcherNet helps researchers throw strikes with AI analysis


by
21 May 2025



share this:

Image credit: University of Waterloo.

University of Waterloo researchers have developed new artificial intelligence (AI) technology that can accurately analyze pitcher performance and mechanics using low-resolution video of baseball games.

The system, developed for the Baltimore Orioles by the Waterloo team, plugs holes in much more elaborate and expensive technology already installed in most stadiums that host Major League Baseball (MLB), whose teams have increasingly tapped into data analytics in recent years.

Waterloo researchers convert video of a pitcher’s performance into a two-dimensional model that PitcherNet’s AI algorithm can later analyze. (Credit: University of Waterloo)

Those systems, produced by a company called Hawk-Eye Innovations, use multiple special cameras in each park to catch players in action, but the data they yield is typically available to the home team that owns the stadium those games are played in.

To add away games to their analytics operation, as well as use smartphone video taken by scouts in minor league and college games, the Orioles asked video and AI experts at Waterloo for help about three years ago.

The result is a comparatively simple system called PitcherNet, which overcomes challenges such as motion blurring to track the movements of pitchers on the mound, then yields data on metrics including pitch velocity and release point from standard broadcast and smartphone video.

Waterloo researchers used images generated during the training process to help build the PitcherNet AI technology. (University of Waterloo)

“The Orioles approached us with a problem because they weren’t able to analyze pose positions and, subsequently, the biomechanics of their pitchers at games that may not have access to high-resolution cameras,” said Dr. John Zelek, a professor of systems design engineering and co-director of the Vision and Image Processing (VIP) Lab at Waterloo.

“The goal of our project was to try to duplicate Hawk-Eye technology and go beyond it by producing similar output from broadcast video or a smartphone camera used by a scout sitting somewhere in the stands.”

To help train AI algorithms at the heart of the technology, researchers created three-dimensional avatars of pitchers so their movements could be viewed from numerous vantage points.

Broadcast video taken from centre field is used to create a three-dimensional human model by the PitcherNet system. (University of Waterloo)

Information from video processed by the system is provided to biomechanics analysts for the Orioles, who have committed to jointly funding the project for another year.

That data can be used to adjust how pitchers throw the ball to improve performance or avoid injuries, and assess the future success and durability of pitching prospects.

“Existing technology has already improved baseball analytics,” said Jerrin Bright, a PhD student who had a leading role in the project. “Since it’s limited to home games, however, there is a real need for solutions that work in any setting, especially for scouting. That’s where our system comes in.”

Researchers are now exploring the application of the underlying idea – AI analysis of player poses using standard broadcast and smartphone video – to other professional sports, including hockey and basketball, in addition to other aspects of baseball, such as batting.

A paper on the project, PitcherNet: Powering the Moneyball Evolution in Baseball Video Analytics, was presented at the 2024 IEEF/CVF Conference on Computer Vision and Pattern Recognition.




University of Waterloo




            AIhub is supported by:



Related posts :



Using generative AI, researchers design compounds that can kill drug-resistant bacteria

  05 Sep 2025
The team used two different AI approaches to design novel antibiotics, including one that showed promise against MRSA.

#IJCAI2025 distinguished paper: Combining MORL with restraining bolts to learn normative behaviour

and   04 Sep 2025
The authors introduce a framework for guiding reinforcement learning agents to comply with social, legal, and ethical norms.

How the internet and its bots are sabotaging scientific research

  03 Sep 2025
What most people have failed to fully realise is that internet research has brought along risks of data corruption or impersonation.

#ICML2025 outstanding position paper: Interview with Jaeho Kim on addressing the problems with conference reviewing

  02 Sep 2025
Jaeho argues that the AI conference peer review crisis demands author feedback and reviewer rewards.

Forthcoming machine learning and AI seminars: September 2025 edition

  01 Sep 2025
A list of free-to-attend AI-related seminars that are scheduled to take place between 2 September and 31 October 2025.
monthly digest

AIhub monthly digest: August 2025 – causality and generative modelling, responsible multimodal AI, and IJCAI in Montréal and Guangzhou

  29 Aug 2025
Welcome to our monthly digest, where you can catch up with AI research, events and news from the month past.

Interview with Benyamin Tabarsi: Computing education and generative AI

  28 Aug 2025
Read the latest interview in our series featuring the AAAI/SIGAI Doctoral Consortium participants.

The value of prediction in identifying the worst-off: Interview with Unai Fischer Abaigar

  27 Aug 2025
We hear from the winner of an outstanding paper award at ICML2025.



 

AIhub is supported by:






 












©2025.05 - Association for the Understanding of Artificial Intelligence