Our services contain a broad range of soccer data analysis from providing multimodal datasets (image, video and sounds) to advanced components such as event detection, virtual advertising and keyword spotting. visit our website for more information.
Our main submodules are as below: (please click on each for more information)
- Event Detection (Image based): Using this module, you can process a full video of a soccer match, obtaining all of the events occurred in the match. The input could be a soccer match with any time duration, while the output, after processing and distinguishing events, is a tagged video, in which the events occurred on any time will be highlighted by a tag on the video.
Figure 1. sample output of event detection (image based) module
- Event Detection (Video based) : Soccer event detection is a foundation of Soccer match analysis. Given the fact that soccer is one of the most popular sport in the world, we tried to detect and classify some of the most important events using soccer video clips which can be of interest of soccer technical analyzer. For this purpose, we created a new dataset containing various event categories and applied different deep learning model on them.
Figure 2. sample output of event detection (video based) module
- Virtual Advertising: Showing and advertising your products or services in any Virtual environment is known as virtual advertising. This kind of advertisement can be done also in football videos by overlaying billboards placed around the field. Almost all existing related products do this by their hardware tools which are placed in the stadium but we tried to do that completely by a single software. By combining some modules of this work with the Perspective transformation module we also can advertise anything appropriate on the grass field.
Figure 3. sample output of Virtual Advertising module
- Perspective Transformation: Transforming the view of football video frame into the top view is called Perspective transformation. The goal of Perspective transformation is to help coaches manage the team and control the performance of each player. This can be used in applications which some information about players is needed. For example: average speed of players or finding the best position which player can play his role. The input is a football video frame and the output is the top view transformed picture. Some additional outputs also is generated which can be used for another applications. These are: 1-The edge image of white lines in the field of stadium. 2-The segmentation of field grass from other parts of field.
Figure 4. sample output of Perspective Transformation module
- Keyword Spotting: The primary purpose of developing a Keyword Spotting (KS) system is to detect important football events using the voice of a football reporter. This module helped Imaged and video-based event detection to achieve proper results. As shown in figure 4, the KSM result is a probability distribution of events that helps other modules to decide better in confusing situations. Also, with a threshold, this module can work individually. Therefore, this module can work as a module in any project or separately.
Figure 5. Output of Keyword Spotting Module (checkout more details and full video Here)
- Bird's eye view: Understanding the 3D layout of a scene from a single perspective image is one of the fundamental problems in computer vision. The position of the camera next to the playground changes according to where the focus of the game is at that moment. However, with current technology and computer vision, we can modify this viewing experience from a fully 2D perspective to a near 3D experience that includes a top view and this can be useful for many applications that need player information to evaluate them. We specifically tried to draw a bird's eye view for soccer games.
Figure 6. Output of Bird's eye view Module
finally, our datasets for each task which are collected for this project and available as open-source:
- Football Keywords Dataset (FKD)
- Line Detection Dataset (LDD)
- Segmentation Dataset
- Event Detection Dataset (Image Based)
- Event Detection Dataset (Video Based)
- Object Detection Dataset
Contributions to this repository are welcome. Examples of things you can contribute:
- Speed Improvements. Like re-writing some Python code in TensorFlow or Cython.
- Training on other datasets.
- Accuracy Improvements.
You can also join our team and help us build even more projects like this one. Please contact us
Feel free to contact us for any further information via below channels.
- Email: akhaee@ut.ac.ir
- Homepage: Mohammad Ali Akhaee
- Homepage: Ramin Toosi
- LinkedIn: Ramin Toosi
- Email: r.toosi@ut.ac.ir
- Homepage: Ali Karimi
- LinkedIn: Ali Karimi
- Email: alikarimi120@gmail.com
- Homepage: Alireza Yaghoobpour
- LinkedIn: Alireza Yaghoobpour
- Email: yaghoobpour@gmail.comr
- LinkedIn: Arghavan Aghadavood
- Email: Arghavanaghadav1375@gmail.com
- LinkedIn: Iman Masroori
- Email: imanmasrori@yahoo.com
- Homepage: Amir Mohamamd Rostami
- LinkedIn: Amir Mohamamd Rostami
- Email: amirmohammadrostami@yahoo.com
- LinkedIn: Amirhossein Kazerooni
- Email: amirhossein477@gmail.com
- LinkedIn: Mostafa Alavi
- Email: saiedmostafa.alavi@ee.sharif.edu
- MIT License
August 1, 2020
- First Release
