Leaderboard of the MSU Metrics Robustness Benchmark

General comparison table

General comparison of metric robustness, stability scores are averaged over all adversarial attacks. Absolute gain, relative gain, energy distance and Wasserstein score are better when lower. Robustness score is better when higher.

UAP attack type

Iterative attack type

Stability score vs proxy metric chart

07 Jun 2023
See Also
MSU CVQAD – Compressed VQA Dataset
During our work we have created the database for video quality assessment with subjective scores
Video Saliency Prediction Benchmark
Explore the best video saliency prediction (VSP) algorithms
Super-Resolution for Video Compression Benchmark
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
Metrics Robustness Benchmark
Check your image or video quality metric for robustness to adversarial attacks
Video Upscalers Benchmark
The most extensive comparison of video super-resolution (VSR) algorithms by subjective quality
Video Deblurring Benchmark
Learn about the best video deblurring methods and choose the best model
Site structure