ΑΙhub.org
 

Analysing ice hockey videos with deep learning


by
12 November 2021



share this:
Ice hockey match

Researchers at the University of Waterloo are developing technology to automatically analyse videos of hockey games using artificial intelligence. Their deep-learning technique can identify players by their sweater numbers with 90 percent accuracy.

“That is significant because the only major cue you have to identify a particular player in a hockey video is jersey number,” said Kanav Vats, a PhD student in systems design engineering who led the project. “Players on a team otherwise appear very similar because of their helmets and uniforms.”

Player identification is one aspect of a complicated challenge as members of the Vision and Image Processing (VIP) Lab at Waterloo work with an industry partner on AI software to analyse player performance and produce other data-driven insights.

The researchers built a data set of more than 54,000 images from National Hockey League games – the largest data set of its kind – and used it to train AI algorithms to recognize sweater numbers in new images.

Accuracy was boosted by representing the number 12, for instance, as both a two-digit number and two single digits, 1 and 2, put together, an approach known in the field of AI as multi-task learning.

“Using different representations to teach the same thing can improve performance,” Vats said. “We combined a holistic representation and a digit-wise representation with great results.”

The research team is also developing AI to track players in video, locate them on the ice and recognize what they are doing, such as taking a shot or checking an opposing player, for integration in a single system.

Detailed analytics have made great strides in hockey and other sports in recent years, but much of the work is still done by people watching broadcast video and taking notes.

“As you can imagine, a person manually annotating video of a full hockey game of three periods would take hours,” Vats said. “Machine-learning systems can produce data from videos in a matter of minutes.”

While they have focused so far on hockey, the researchers expect their technology could be transferred with modifications to other team sports, such as soccer.

Vats collaborated on the player identification work with his doctoral supervisors, Waterloo engineering professors David Clausi and John Zelek, and postdoctoral fellow Mehrnaz Fani.

He presented a paper, Multi-task learning for jersey number recognition in Ice Hockey, at the 4th International ACM Workshop on Multimedia Analysis in Sports in October 2021.



tags:


University of Waterloo




            AIhub is supported by:



Related posts :



Machine learning for atomic-scale simulations: balancing speed and physical laws

How much underlying physics can we safely “shortcut” without breaking a simulation?

Policy design for two-sided platforms with participation dynamics: Interview with Haruka Kiyohara

  09 Oct 2025
Studying the long-term impacts of decision-making algorithms on two-sided platforms such as e-commerce or music streaming apps.

The Machine Ethics podcast: What excites you about AI? Vol.2

This is a bonus episode looking back over answers to our question: What excites you about AI?

Interview with Janice Anta Zebaze: using AI to address energy supply challenges

  07 Oct 2025
Find out more about research combining renewable energy systems, tribology, and artificial intelligence.

How does AI affect how we learn? A cognitive psychologist explains why you learn when the work is hard

  06 Oct 2025
Early research is only beginning to scratch the surface of how AI technology will truly affect learning and cognition in the long run.

Interview with Zahra Ghorrati: developing frameworks for human activity recognition using wearable sensors

  03 Oct 2025
Find out more about research developing scalable and adaptive deep learning frameworks.

Diffusion beats autoregressive in data-constrained settings

  03 Oct 2025
How can we trade off more compute for less data?

Forthcoming machine learning and AI seminars: October 2025 edition

  02 Oct 2025
A list of free-to-attend AI-related seminars that are scheduled to take place between 3 October and 30 November 2025.



 

AIhub is supported by:






 












©2025.05 - Association for the Understanding of Artificial Intelligence