Leaderboard of the MSU Video Quality Metrics Benchmark

Leaderboard

The chart below shows the correlation of metrics with subjective scores on our dataset. You can choose the type of correlation and compression standard of codecs used for compression. We recommend that you focus on Spearman’s rank correlation coefficient.

Correlation type: Compression Standard:

The table below shows the correlations of metrics with subjective scores on our dataset. Click on the labels to sort the table.

Correlation type:

To calcualte correlations for different video categories dataset is divided into 3 sets on bitrates range: all bitrates, low bitrates (below 2000 Kbps), high bitrates (above 4500 Kbps); and 4 sets on compression standard: AV1, H.265, H.264, VVC.

Correlation type:

Metrics performance on different compression standards

Below you can see the comparison of the metrics performance on videos compressed by codecs with different compression standards. In addition, the chart shows 95% confidence interval for each point.

Correlation type:

Speed-Quality Plot

Chart below shows Speed-Quality characteristics of metrics.

Correlation type:

Contacts

We would highly appreciate any suggestions and ideas on how to improve our benchmark. Please contact us via email: vqa@videoprocessing.ai.

12 Mar 2022
See Also
MSU Video Quality Measurement Tool: Picture types
VQMT 14.0 Online help: List of all picture types available in VQMT and their aliases
MSU HDR Video Reconstruction Benchmark
The most comprehensive comparison of HDR video reconstruction methods
MSU HDR Video Reconstruction Benchmark Participants
The list of participants of MSU HDR Video ReconstructionBenchmark
MSU HDR Video Reconstruction Benchmark Methodology
Evaluation Methodology of MSU HDR Video Reconstruction Benchmark
MSU HDR Video Reconstruction Benchmark Dataset
MSU HDR Video Reconstruction Benchmark Dataset
MSU Super-Resolution for Video Compression Benchmark 2022
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
Site structure