One-system-to-rule-them-all for sport video and metadata

Offentlig prosjektsammendrag

Forzasys was founded in 2014 as a spinoff from Simula Research Laboratory. The Forzify platform has provided live streaming of elite football games in Norway and Sweden since 2017, and enable users to watch full games, highlights and summaries, search for events, share events on social media and creating their own videos. The overall idea is to create a one-system-to-rule-them-all removing redundant components and functionality, reducing manual labour, and serving all consumers from the same system. In particular, the project aims to research and develop a system for efficient and integrated management of sports video content, including metadata for the video, athletes and users, used by people around the sport and by supporters, for both game analysis and entertainment/content consumption. Together with researchers from SimulaMet, we improve workflows and make videos and data easily accessible for search and sharing. This includes automating parts of the production workflows using AI where we seek solutions for automatic clipping, thumbnail selection, event detection, smart cropping, text generation, clip classification, etc. using technologies like large language models, generative and/or convolutional neural networks and so on. Such AI-bases functionality will largely cut the need for manual operations. For example, to create a teaser to be published on social media, media production personell usually spend a lot of time to search for content, download content, manually select and clip segments, potentially add effects, dynamically crop the video (to the social media aspect ratio), generate the video, and upload to produced compilation to the platform. Our goal is to make the system perform all operations from here to the end - "generate a video of all the goals from last week and publish at Instagram, Facebook and TikTok" - all in one operation.