Participants of the MSU Metrics Robustness Benchmark
Metric | Year | Image or Video | Implementation |
---|---|---|---|
CLIP-IQA [1] | 2022 | Image | Link |
META-IQA [2] | 2020 | Image | Link |
RANK-IQA [3] | 2017 | Image | Link |
HYPER-IQA [4] | 2020 | Image | Link |
KONCEPT [5] | 2020 | Image | Link |
FPR [6] | 2022 | Image | Link |
NIMA [7] | 2018 | Image | Link |
WSP [8] | 2020 | Image | Link |
MDTVSFA [9] | 2021 | Video | Link |
LINEARITY [10] | 2020 | Image | Link |
VSFA [11] | 2019 | Video | Link |
PAQ2PIQ [12] | 2020 | Image | Link |
SPAQ [13] | 2020 | Image | Link |
TRES [14] | 2022 | Image | Link |
MANIQA [15] | 2022 | Image | Link |
ASNA-MACS [16] | 2021 | Image | Link |
BRISQUE [17] | 2012 | Image | Link |
CKDN [18] | 2021 | Image | Link |
CVRKD-IQA [19] | 2022 | Image | Link |
CW-SSIM [20] | 2011 | Image | Link |
DBCNN [21] | 2019 | Image | Link |
DISTS [22] | 2021 | Image | Link |
EONSS [23] | 2019 | Image | Link |
GMSD [24] | 2013 | Image | Link |
IW-SSIM [25] | 2020 | Image | Link |
KONIQPLUSPLUS [26] | 2020 | Image | Link |
LIQE [27] | 2023 | Image | Link |
LPIPS-ALEX [28] | 2018 | Image | Link |
LPIPS-VGG [29] | 2018 | Image | Link |
AHIQ [30] | 2022 | Image | Link |
MS-SSIM [31] | 2003 | Image | Link |
MUSIQ [32] | 2021 | Image | Link |
NIQE [33] | 2012 | Image | Link |
NLPD [34] | 2020 | Image | Link |
PIEAPP [35] | 2018 | Image | Link |
STLPIPS [36] | 2022 | Image | Link |
SWIN-IQA [37] | 2022 | Image | Link |
UNIQUE [38] | 2020 | Image | Link |
VIF [39] | 2006 | Image | Link |
VSI [4] | 2020 | Image | Link |
References
- Wang, Jianyi, Kelvin C. K. Chan, and Chen Change Loy. ‘Exploring CLIP for Assessing the Look and Feel of Images’. In AAAI, 2023.
- Zhu, Hancheng, Leida Li, Jinjian Wu, Weisheng Dong, and Guangming Shi. ‘MetaIQA: Deep Meta-Learning for No-Reference Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14143–52, 2020.
- Liu, Xialei, Joost Van De Weijer, and Andrew D. Bagdanov. ‘Rankiqa: Learning from Rankings for No-Reference Image Quality Assessment’. In Proceedings of the IEEE International Conference on Computer Vision, 1040–49, 2017.
- Su, Shaolin, Qingsen Yan, Yu Zhu, Cheng Zhang, Xin Ge, Jinqiu Sun, and Yanning Zhang. ‘Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3667–76, 2020.
- Hosu, Vlad, Hanhe Lin, Tamas Sziranyi, and Dietmar Saupe. ‘KonIQ-10k: An Ecologically Valid Database for Deep Learning of Blind Image Quality Assessment’. IEEE Transactions on Image Processing 29 (2020): 4041–56.
- Chen, Baoliang, Lingyu Zhu, Chenqi Kong, Hanwei Zhu, Shiqi Wang, and Zhu Li. ‘No-Reference Image Quality Assessment by Hallucinating Pristine Features’. IEEE Transactions on Image Processing 31 (2022): 6139–51.
- Talebi, Hossein, and Peyman Milanfar. ‘NIMA: Neural Image Assessment’. IEEE Transactions on Image Processing 27, no. 8 (2018): 3998–4011.
- Su, Yicheng, and Jari Korhonen. ‘Blind Natural Image Quality Prediction Using Convolutional Neural Networks and Weighted Spatial Pooling’. In 2020 IEEE International Conference on Image Processing (ICIP), 191–95. IEEE, 2020.
- Dingquan Li, Tingting Jiang, and Ming Jiang. ‘Unified quality assessment of in-the-wild videos with mixed datasets training’. International Journal of Computer Vision, 129:1238–1257, 2021.
- Li, Dingquan, Tingting Jiang, and Ming Jiang. ‘Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment’. In Proceedings of the 28th ACM International Conference on Multimedia, 789–97, 2020.
- Dingquan Li, Tingting Jiang, and Ming Jiang. ‘Quality assessment of in-the-wild videos’. In Proceedings of the 27th ACM International Conference on Multimedia, pages 2351–2359, 2019
- Ying, Zhenqiang, Haoran Niu, Praful Gupta, Dhruv Mahajan, Deepti Ghadiyaram, and Alan Bovik. ‘From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3575–85, 2020.
- Fang, Yuming, Hanwei Zhu, Yan Zeng, Kede Ma, and Zhou Wang. ‘Perceptual Quality Assessment of Smartphone Photography’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3677–86, 2020.
- Golestaneh, S. Alireza, Saba Dadsetan, and Kris M. Kitani. ‘No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency’. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 1220–30, 2022.
- Yang, Sidi, Tianhe Wu, Shuwei Shi, Shanshan Lao, Yuan Gong, Mingdeng Cao, Jiahao Wang, and Yujiu Yang. ‘Maniqa: Multi-Dimension Attention Network for No-Reference Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1191–1200, 2022.
- Seyed Mehdi Ayyoubzadeh and Ali Royatg. ‘An Attention-based Siamese-Difference Neural Network with Surrogate Ranking Loss function for Perceptual Image Quality Assessment’. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021.
- Mittal, Anish and Moorthy, Anush Krishna and Bovik, Alan Conrad. ‘No-Reference Image Quality Assessment in the Spatial Domain’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4695-4708, 2012.
- Zheng, Heliang and Fu, Jianlong and Zeng, Yanhong and Zha, Zheng-Jun and Luo, Jiebo. ‘Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment’. In International Conference on Computer Vision, 2021.
- Yin, Guanghao and Wang, Wei and Yuan, Zehuan and Han, Chuchu and Ji, Wei and Sun, Shouqian and Wang, Changhu. ‘Content-Variant Reference Image Quality Assessment via Knowledge Distillation’. In the Association of the Advancement of Artificial Intelligence, 2022.
- Gao, Yang and Rehman, Abdul and Wang, Zhou. ‘CW-SSIM based image classification’. In IEEE International Conference on Image Processing, 1249-1252, 2011.
- Zhang, Weixia and Ma, Kede and Yan, Jia and Deng, Dexiang and Wang, Zhou. ‘Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network’. In IEEE Transactions on Circuits and Systems for Video Technology, 36-47, 2020
- Ding, Keyan and Ma, Kede and Wang, Shiqi and Simoncelli, Eero P. ‘Image Quality Assessment: Unifying Structure and Texture Similarity’. In Proceedings of the 29th ACM International Conference on Multimedia, 2483-2491, 2021.
- Wang, Zhongling and Athar, Shahrukh and Wang, Zhou. ‘Blind Quality Assessment of Multiply Distorted Images Using Deep Neural Networks’. In 16th International Conference on Image Analysis and Recognition, 89-101, 2019.
- W. Xue, L. Zhang, X. Mou and A. C. Bovik. ‘Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index‘. In IEEE Transactions on Image Processing, 684-695, 2014
- Zhou Wang, Qiang Li. ‘Information content weighting for perceptual image quality assessment’. In IEEE Transactions on image processing, 1185-1198, 2010.
- S. Su, V. Hosu, H. Lin, Y. Zhang, and D. Saupe. ‘Koniq++: Boosting no-reference image quality assessment in the wild by jointly predicting image quality and defects’. In The 32nd British Machine Vision Conference, 2021.
- Zhang, Weixia and Zhai, Guangtao and Wei, Ying and Yang, Xiaokang and Ma, Kede. ‘Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 14071-14081, 2023.
- Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman and Oliver Wang. ‘The Unreasonable Effectiveness of Deep Features as a Perceptual Metric’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 586-595, 2018
- Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman and Oliver Wang. ‘The Unreasonable Effectiveness of Deep Features as a Perceptual Metric’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 586-595, 2018
- Shanshan Lao, Yuan Gong, Shuwei Shi, Sidi Yang, Tianhe Wu, Jiahao Wang, Weihao Xia, and Yujiu Yang. ‘Attentions help cnns see better: Attention-based hybrid image quality assessment network’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1140-1149, 2022.
- Z Wang, E.P. Simoncelli and A.C. Bovik. ‘Multiscale structural similarity for image quality assessment’. In The Thrity-Seventh Asilomar Conference on Signals, 2003.
- Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, and Feng Yang. ‘Musiq: Multi-scale image quality transformer’. In Proceedings of the International Conference on Computer Vision, 2021.
- A. Mittal, R. Soundararajan, and A.C. Bovik. ‘Making a ‘Completely Blind’ Image Quality Analyzer’. In IEEE Signal Processing Letters, 2013.
- Ding, Keyan and Ma, Kede and Wang, Shiqi and Simoncelli, Eero P. ‘Comparison of Image Quality Models for Optimization of Image Processing Systems’. In Clinical Orthopaedics and Related Research, 2020.
- Prashnani, Ekta and Cai, Hong and Mostofi, Yasamin and Sen, Pradeep. ‘PieAPP: Perceptual Image-Error Assessment Through Pairwise Preference’. In The IEEE Conference on Computer Vision and Pattern Recognition, 2018.
- Abhijay Ghildyal and Feng Liu. ‘Shift-tolerant Perceptual Similarity Metric’. In European Conference on Computer Vision, 2022.
- Liu, Jianzhao and Li, Xin and Peng, Yanding and Yu, Tao and Chen, Zhibo. ‘SwinIQA: Learned Swin Distance for Compressed Image Quality Assessment’. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1795-1799, 2022
- Zhang, Weixia and Ma, Kede and Zhai, Guangtao and Yang, Xiaokang. ‘Uncertainty-aware blind image quality assessment in the laboratory and wild’. In IEEE Transactions on Image Processing, 3474-3486, 2021.
- Sheikh, Hamid; Bovik, Alan. ‘Image Information and Visual Quality’. In IEEE Transactions on Image Processing. 15 (2): 430–444, 2006.
- Müller, M. U., Ekhtiari, N., Almeida, R. M., and Rieke, C.. ‘SUPER-RESOLUTION OF MULTISPECTRAL SATELLITE IMAGES USING CONVOLUTIONAL NEURAL NETWORKS’. In ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 33–40, 2020.
See Also
PSNR and SSIM: application areas and criticism
Learn about limits and applicability of the most popular metrics
Learning-Based Image Compression Benchmark
The First extensive comparison of Learned Image Compression algorithms
Super-Resolution for Video Compression Benchmark
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
Video Colorization Benchmark
Explore the best video colorization algorithms
Defenses for Image Quality Metrics Benchmark
Explore defenses from adv attacks
Super-Resolution Quality Metrics Benchmark
Discover 66 Super-Resolution Quality Metrics and choose the most appropriate for your videos
Site structure
-
MSU Benchmark Collection
- Learning-Based Image Compression Benchmark
- Super-Resolution for Video Compression Benchmark
- Video Colorization Benchmark
- Defenses for Image Quality Metrics Benchmark
- Super-Resolution Quality Metrics Benchmark
- Deinterlacer Benchmark
- Video Saliency Prediction Benchmark
- Metrics Robustness Benchmark
- Video Upscalers Benchmark
- Video Deblurring Benchmark
- Video Frame Interpolation Benchmark
- HDR Video Reconstruction Benchmark
- No-Reference Video Quality Metrics Benchmark
- Full-Reference Video Quality Metrics Benchmark
- Video Alignment and Retrieval Benchmark
- Mobile Video Codecs Benchmark
- Video Super-Resolution Benchmark
- Shot Boundary Detection Benchmark
- The VideoMatting Project
- Video Completion
- Codecs Comparisons & Optimization
- VQMT
- MSU Datasets Collection
- Metrics Research
- Video Quality Measurement Tool 3D
- Video Filters
- Other Projects