Participants of the MSU Metrics Robustness Benchmark

Metric Year Image or Video Implementation
CLIP-IQA [1] 2022 Image Link
META-IQA [2] 2020 Image Link
RANK-IQA [3] 2017 Image Link
HYPER-IQA [4] 2020 Image Link
KONCEPT [5] 2020 Image Link
FPR [6] 2022 Image Link
NIMA [7] 2018 Image Link
WSP [8] 2020 Image Link
MDTVSFA [9] 2021 Video Link
LINEARITY [10] 2020 Image Link
VSFA [11] 2019 Video Link
PAQ2PIQ [12] 2020 Image Link
SPAQ [13] 2020 Image Link
TRES [14] 2022 Image Link
MANIQA [15] 2022 Image Link
ASNA-MACS [16] 2021 Image Link
BRISQUE [17] 2012 Image Link
CKDN [18] 2021 Image Link
CVRKD-IQA [19] 2022 Image Link
CW-SSIM [20] 2011 Image Link
DBCNN [21] 2019 Image Link
DISTS [22] 2021 Image Link
EONSS [23] 2019 Image Link
GMSD [24] 2013 Image Link
IW-SSIM [25] 2020 Image Link
KONIQPLUSPLUS [26] 2020 Image Link
LIQE [27] 2023 Image Link
LPIPS-ALEX [28] 2018 Image Link
LPIPS-VGG [29] 2018 Image Link
AHIQ [30] 2022 Image Link
MS-SSIM [31] 2003 Image Link
MUSIQ [32] 2021 Image Link
NIQE [33] 2012 Image Link
NLPD [34] 2020 Image Link
PIEAPP [35] 2018 Image Link
STLPIPS [36] 2022 Image Link
SWIN-IQA [37] 2022 Image Link
UNIQUE [38] 2020 Image Link
VIF [39] 2006 Image Link
VSI [4] 2020 Image Link

References

  1. Wang, Jianyi, Kelvin C. K. Chan, and Chen Change Loy. ‘Exploring CLIP for Assessing the Look and Feel of Images’. In AAAI, 2023.
  2. Zhu, Hancheng, Leida Li, Jinjian Wu, Weisheng Dong, and Guangming Shi. ‘MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14143–52, 2020.
  3. Liu, Xialei, Joost Van De Weijer, and Andrew D. Bagdanov. ‘Rankiqa: Learning from Rankings for No-Reference Image Quality Assessment’. In Proceedings of the IEEE International Conference on Computer Vision, 1040–49, 2017.
  4. Su, Shaolin, Qingsen Yan, Yu Zhu, Cheng Zhang, Xin Ge, Jinqiu Sun, and Yanning Zhang. ‘Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3667–76, 2020.
  5. Hosu, Vlad, Hanhe Lin, Tamas Sziranyi, and Dietmar Saupe. ‘KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment’. IEEE Transactions on Image Processing 29 (2020): 4041–56.
  6. Chen, Baoliang, Lingyu Zhu, Chenqi Kong, Hanwei Zhu, Shiqi Wang, and Zhu Li. ‘No-Reference Image Quality Assessment by Hallucinating Pristine Features’. IEEE Transactions on Image Processing 31 (2022): 6139–51.
  7. Talebi, Hossein, and Peyman Milanfar. ‘NIMA: Neural Image Assessment’. IEEE Transactions on Image Processing 27, no. 8 (2018): 3998–4011.
  8. Su, Yicheng, and Jari Korhonen. ‘Blind Natural Image Quality Prediction Using Convolutional Neural Networks and Weighted Spatial Pooling’. In 2020 IEEE International Conference on Image Processing (ICIP), 191–95. IEEE, 2020.
  9. Dingquan Li, Tingting Jiang, and Ming Jiang. ‘Unified quality assessment of in-the-wild videos with mixed datasets training’. International Journal of Computer Vision, 129:1238–1257, 2021.
  10. Li, Dingquan, Tingting Jiang, and Ming Jiang. ‘Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment’. In Proceedings of the 28th ACM International Conference on Multimedia, 789–97, 2020.
  11. Dingquan Li, Tingting Jiang, and Ming Jiang. ‘Quality assessment of in-the-wild videos’. In Proceedings of the 27th ACM International Conference on Multimedia, pages 2351–2359, 2019
  12. Ying, Zhenqiang, Haoran Niu, Praful Gupta, Dhruv Mahajan, Deepti Ghadiyaram, and Alan Bovik. ‘From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3575–85, 2020.
  13. Fang, Yuming, Hanwei Zhu, Yan Zeng, Kede Ma, and Zhou Wang. ‘Perceptual Quality Assessment of Smartphone Photography’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3677–86, 2020.
  14. Golestaneh, S. Alireza, Saba Dadsetan, and Kris M. Kitani. ‘No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency’. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 1220–30, 2022.
  15. Yang, Sidi, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. ‘Maniqa: Multi-Dimension Attention Network for No-Reference Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1191–1200, 2022.
  16. Seyed Mehdi Ayyoubzadeh and Ali Royatg. ‘An Attention-based Siamese-Difference Neural Network with Surrogate Ranking Loss function for Perceptual Image Quality Assessment’. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021.
  17. Mittal, Anish and Moorthy, Anush Krishna and Bovik, Alan Conrad. ‘No-Reference Image Quality Assessment in the Spatial Domain’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4695-4708, 2012.
  18. Zheng, Heliang and Fu, Jianlong and Zeng, Yanhong and Zha, Zheng-Jun and Luo, Jiebo. ‘Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment’. In International Conference on Computer Vision, 2021.
  19. Yin, Guanghao and Wang, Wei and Yuan, Zehuan and Han, Chuchu and Ji, Wei and Sun, Shouqian and Wang, Changhu. ‘Content-Variant Reference Image Quality Assessment via Knowledge Distillation’. In the Association of the Advancement of Artificial Intelligence, 2022.
  20. Gao, Yang and Rehman, Abdul and Wang, Zhou. ‘CW-SSIM based image classification’. In IEEE International Conference on Image Processing, 1249-1252, 2011.
  21. Zhang, Weixia and Ma, Kede and Yan, Jia and Deng, Dexiang and Wang, Zhou. ‘Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network’. In IEEE Transactions on Circuits and Systems for Video Technology, 36-47, 2020
  22. Ding, Keyan and Ma, Kede and Wang, Shiqi and Simoncelli, Eero P. ‘Image Quality Assessment: Unifying Structure and Texture Similarity’. In Proceedings of the 29th ACM International Conference on Multimedia, 2483-2491, 2021.
  23. Wang, Zhongling and Athar, Shahrukh and Wang, Zhou. ‘Blind Quality Assessment of Multiply Distorted Images Using Deep Neural Networks’. In 16th International Conference on Image Analysis and Recognition, 89-101, 2019.
  24. W. Xue, L. Zhang, X. Mou and A. C. Bovik. ‘Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index‘. In IEEE Transactions on Image Processing, 684-695, 2014
  25. Zhou Wang, Qiang Li. ‘Information content weighting for perceptual image quality assessment’. In IEEE Transactions on image processing, 1185-1198, 2010.
  26. S. Su, V. Hosu, H. Lin, Y. Zhang, and D. Saupe. ‘Koniq++: Boosting no-reference image quality assessment in the wild by jointly predicting image quality and defects’. In The 32nd British Machine Vision Conference, 2021.
  27. Zhang, Weixia and Zhai, Guangtao and Wei, Ying and Yang, Xiaokang and Ma, Kede. ‘Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14071-14081, 2023.
  28. Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman and Oliver Wang. ‘The Unreasonable Effectiveness of Deep Features as a Perceptual Metric’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 586-595, 2018
  29. Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman and Oliver Wang. ‘The Unreasonable Effectiveness of Deep Features as a Perceptual Metric’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 586-595, 2018
  30. Shanshan Lao, Yuan Gong, Shuwei Shi, Sidi Yang, Tianhe Wu, Jiahao Wang, Weihao Xia, and Yujiu Yang. ‘Attentions help cnns see better: Attention-based hybrid image quality assessment network’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1140-1149, 2022.
  31. Z Wang, E.P. Simoncelli and A.C. Bovik. ‘Multiscale structural similarity for image quality assessment’. In The Thrity-Seventh Asilomar Conference on Signals, 2003.
  32. Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, and Feng Yang. ‘Musiq: Multi-scale image quality transformer’. In Proceedings of the International Conference on Computer Vision, 2021.
  33. A. Mittal, R. Soundararajan, and A.C. Bovik. ‘Making a ‘Completely Blind’ Image Quality Analyzer’. In IEEE Signal Processing Letters, 2013.
  34. Ding, Keyan and Ma, Kede and Wang, Shiqi and Simoncelli, Eero P. ‘Comparison of Image Quality Models for Optimization of Image Processing Systems’. In Clinical Orthopaedics and Related Research, 2020.
  35. Prashnani, Ekta and Cai, Hong and Mostofi, Yasamin and Sen, Pradeep. ‘PieAPP: Perceptual Image-Error Assessment Through Pairwise Preference’. In The IEEE Conference on Computer Vision and Pattern Recognition, 2018.
  36. Abhijay Ghildyal and Feng Liu. ‘Shift-tolerant Perceptual Similarity Metric’. In European Conference on Computer Vision, 2022.
  37. Liu, Jianzhao and Li, Xin and Peng, Yanding and Yu, Tao and Chen, Zhibo. ‘SwinIQA: Learned Swin Distance for Compressed Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1795-1799, 2022
  38. Zhang, Weixia and Ma, Kede and Zhai, Guangtao and Yang, Xiaokang. ‘Uncertainty-aware blind image quality assessment in the laboratory and wild’. In IEEE Transactions on Image Processing, 3474-3486, 2021.
  39. Sheikh, Hamid; Bovik, Alan. ‘Image Information and Visual Quality’. In IEEE Transactions on Image Processing. 15 (2): 430–444, 2006.
  40. Müller, M. U., Ekhtiari, N., Almeida, R. M., and Rieke, C.. ‘SUPER-RESOLUTION OF MULTISPECTRAL SATELLITE IMAGES USING CONVOLUTIONAL NEURAL NETWORKS’. In ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 33–40, 2020.
07 Jun 2023
See Also
Video Colorization Benchmark
Explore the best video colorization algorithms
Super-Resolution for Video Compression Benchmark
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
Defenses for Image Quality Metrics Benchmark
Explore defenses from adv attacks
Learning-Based Image Compression Benchmark
The First extensive comparison of Learned Image Compression algorithms
Super-Resolution Quality Metrics Benchmark
Discover 66 Super-Resolution Quality Metrics and choose the most appropriate for your videos
Video Saliency Prediction Benchmark
Explore the best video saliency prediction (VSP) algorithms
Site structure