MSU Video Super-Resolution Quality Assessment Challenge 2024
MSU Video Super-Resolution Quality Assessment Challenge
Ivan Molodetskikh
The first Super-Resolution Quality Assessment Challenge!
- Large Super-Resolution Quality Assessment dataset covering many major Video Super-Resolution use cases
- Evaluating metrics on three subsets: Easy, Moderate and Hard
- The score on the hidden part of the test set will not be shown until the end of the challenge
Task
The task is to develop an Image/Video Super-Resolution Quality Assessment metric.
Motivation
Video and Image Super-resolution (SR) has garnered extensive research in recent years, with new articles appearing monthly. However, as comparison of known image/video quality metrics shows, the task of Super-Resolution Quality Assessment is different from the task of simple Image and Video Quality Assessment (you should compare the leaderboards of our benchmarks: Video Quality Metrics and Super-Resolution Quality Metrics). Therefore, competition of metrics oriented specifically to Super-Resolution is necessary.
Dataset
We provide the participants with train & validation subsets made of Ground-Truth videos and the same videos after applying bicubic downsampling, video codecs and Super-Resolution methods. Extra 15+ hidden test videos will be used for final evaluation. Participants will see test results for 30% of the hidden test videos, full results will be available by the end of the competition.
Dataset will be available as soon as challenge starts.
Organizers from MSU Graphics & Media Lab
Ivan Molodetskikh
Received his M.S. degree in computer science from the Moscow State University in 2020. He is currently a PhD student at the MSU Graphics & Media Lab. His research interests include image inpainting, semantic video matting and machine learning. Ivan had supervised the development of the MSU benchmark of super-resolution for quality enhancement and the development of a super-resolution detection method. Currently he is supervising research related to super-resolution in the Graphics & Media Lab.
Artem Borisov
He is currently in his 3rd year of undergraduate studies. Artem is the main contributor to the MSU Super-Resolution Quality Metrics Benchmark. His research interests include Super-Resolution, Super-Resolution Quality Assessment Metrics and its robustness, as well as Image and Video Quality Assessment Metrics</a>.
-
MSU Benchmark Collection
- Super-Resolution for Video Compression Benchmark
- Video Colorization Benchmark
- Defenses for Image Quality Metrics Benchmark
- Learning-Based Image Compression Benchmark
- Super-Resolution Quality Metrics Benchmark
- Video Saliency Prediction Benchmark
- Metrics Robustness Benchmark
- Video Upscalers Benchmark
- Video Deblurring Benchmark
- Video Frame Interpolation Benchmark
- HDR Video Reconstruction Benchmark
- No-Reference Video Quality Metrics Benchmark
- Full-Reference Video Quality Metrics Benchmark
- Video Alignment and Retrieval Benchmark
- Mobile Video Codecs Benchmark
- Video Super-Resolution Benchmark
- Shot Boundary Detection Benchmark
- The VideoMatting Project
- Video Completion
- Codecs Comparisons & Optimization
- VQMT
- MSU Datasets Collection
- Metrics Research
- Video Quality Measurement Tool 3D
- Video Filters
- Other Projects