Leaderboard

The chart below shows the correlation of metrics with subjective scores on our dataset. You can choose the type of correlation and compression standard of codecs used for compression. We recommend that you focus on Spearman’s rank correlation coefficient.

The table below shows the correlations of metrics with subjective scores on our dataset. Click on the labels to sort the table.

To analyze metric performance in more detail, we added a few mutually nonexclusive categories with 196 videos from the dataset: Shaking, Nature, Sports, Gaming / Animation.

Metrics performance on different compression standards

Below you can see the comparison of the metrics performance on videos compressed by codecs with different compression standards. In addition, the chart shows 95% confidence interval for each point.

Speed-Quality Plot

Chart below shows Speed-Quality characteristics of metrics.

Submitting

To submit your method please visit this section of the home page.

Contacts

We would highly appreciate any suggestions and ideas on how to improve our benchmark. Please contact us via email: vqa@videoprocessing.ai.

Cite us

The citation will be here soon.