Leaderboard of the MSU Metrics Robustness Benchmark

General comparison table

General comparison of metric robustness, stability scores are averaged over all adversarial attacks. Absolute gain, relative gain, energy distance and Wasserstein score are better when lower. Robustness score is better when higher.

UAP attack type

Iterative attack type

Stability score vs proxy metric chart

07 Jun 2023
See Also
Video Colorization Benchmark
Explore the best video colorization algorithms
Defenses for Image Quality Metrics Benchmark
Explore defenses from adv attacks
Learning-Based Image Compression Benchmark
The First extensive comparison of Learned Image Compression algorithms
Super-Resolution Quality Metrics Benchmark
Discover 66 Super-Resolution Quality Metrics and choose the most appropriate for your videos
Video Saliency Prediction Benchmark
Explore the best video saliency prediction (VSP) algorithms
Super-Resolution for Video Compression Benchmark
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
Site structure