MSU Perceptual Video Quality Tool

Easy subjective video testing organization for companies and universities

How to make subjective video quality comparison with MSU PVQT:

  1. Collect materials for the test

    We support more than 300 video formats and all main image formats

    See Recommendations on materials.

  2. Choose method and create test with PVQT Editor

    Now we support DSIS, DSCQS I and II, SCACJ, SAMVIQ from ITU-R BT.500 and EBU

    See Methods’ brief.

  3. Invite observers and organize tests with PVQT Player

    Observers can pass test in local network, in specially prepared room or individually. ITU-R BT.500 recommends at least 15 observers to complete the test. If you need observers to test your videos, please, mail us

    See Test organization variants.

  4. Collect and process results

    You see results in real-time in most cases. Statistical estimates as well as Bradley-Terry model results for pairwise comparison are available in PVQT

    See Result inspection section in documentation.

PVQT 2.0 FREE licenses for BETA testing: Get now!

remains to the end of 6-month BETA-testing

Table of contents:

How to use PVQT

PVQT main window

What is PVQT?

PVQT is a tool, developed by MSU Graphics & Media Lab. Video Group for evaluating of subjective quality (with reference or without one) of a video and image files.

The tool was developed according to ITU-R BT.500 “Methodology for the subjective assessment of the quality of television pictures”. The program does not exactly repeat the standard, as it is focused on the measurement of quality for television, but PVQT is aimed for quality measure of digital materials. Also, it has some additional features not described in the standard.

PVQT structure

PVQT consists of 2 basic parts:

Materials selection

To create PVQT test you need one or more groups of source files. The source files can be videos or images: PVQT supports all basic video and image formats. Each group consists of different versions of one picture, which will be compared with another picture of that group. Group can have a reference. In that case all pictures will be compared to the reference. Without reference there can be pairwise comparison with SCACJ method.

ITU-R BT.500 recommends videos to be at most 10 s length. In case of images, you can tune duration that the image displays. Whole test should be no longer 30 m including voting, training questions and period between videos. You can have several sessions with breaks, each for 30 minutes. See ITU-R BT.500 for details.

Main Features overview

Main ITU-R and BTU methods
300+ Video and all Main Image Formats
All popular video codecs, including HEVC
Real-Time result observation
Convenient control of all test passes in real-time
No-reference pairwise methods
Use SCACJ to collect pairwise results, you don't need to have references for this method
Confidence interval calculation
Automatic calculation of mean, standard deviation, confidence interval
Results table
View breaf results with information about each observer or detailed results in summary table
Bradley-Terry model
Automatic estimation of Bradley-Terry ranks for pairwise comparison
Several techniques of test organization
Observers can view test in classroom, individually, or simultaneously
LAN test passing
Use shared folders to pass test on different computers without any copying operations
Video playback bufferization
Playback has a tunable bufferization to avoid video lags
Smart diagnostic
PVQT performs checks for standard compatibility and for possible problems, all you see in message window
Fast checking of test
PVQT performs test checking before each run. This prevents test failure in middle of progress
Continuation of test
You can continue a test interrupted due to tech problem, power failure or by request without loss of progress
Training questions
Adjust the number of training questions, which helps observer to stabilize opinion and understand the task
See on big screen, TV or projector
Control test on one monitor, see on big screen, TV or projector. PVQT has built-in multiscreen support
Fast debug
Debug test to check it, run test immediately from Editor
Test estimates
PVQT calculates estimated time of test and number of questions
Use multiple sequences in one task. Observer shouldn't see variants of only one sequence
Result collecting via E-Mail
In case of distributed observers test you can collect results via E-Mails
JSON support
PVQT saves a detailed protocol in JSON format for each test pass
Online test
Any number of observers take the test simultaneously, each on their mobile device. They're looking at the material on the big screen. No additional mobile applications needed to install
Custom tests
Customize the wording of the question, instructions, way of passing the test. Add any number of questions. You can use custom tests for paired, reference comparison, or to view single videos
Result collecting via FTP
In case of distributed observers, results can be automatically uploaded to FTP server. Test manager chooses a folder and login settings

* available in experimental version


File Edition Content Price Type
MSU_PVQT_2.1r12075BETA_pro_64.exe (recommended) Experimental 6-month Player & Editor FREE Windows Installer 64-Bit
MSU_PVQT_Player_2.1r12075BETA_pro_64.exe Experimental 6-month Player FREE Windows Installer 64-Bit
MSU_PVQT_2.0r12033BETA_pro_32.exe BETA 6-month Player & Editor FREE Windows Installer 32-Bit
MSU_PVQT_Player_2.0r12033BETA_pro_32.exe BETA 6-month Player FREE Windows Installer 32-Bit
MSU_PVQT_Documentation.pdf Documentation FREE PDF document

Methods’ brief

Organization of testing




16 Oct 2018
See Also
MSU Video Upscalers Benchmark 2021
The most comprehensive comparison of video super resolution (VSR) algorithms by subjective quality
MSU Video Quality Measurement Tool: Picture types
VQMT 13.1 Online help: List of all picture types available in VQMT and their aliases
MSU Video Quality Measurement Tool: Usage of VQMT metrics in CLI
VQMT 13.1 Online help: Description of VQMT metrics, their parameters and using in CLI
MSU Video Quality Measurement Tool: VQMT various lists and tables
VQMT 13.1 Online help: Information about VQMT visualization formats, read modes, etc...
MSU Video Quality Measurement Tool: Command-line help
VQMT 13.1 Online help: Information about all VQMT CLI options for Pro/Premium versions
MSU Video Quality Measurement Tool: Configuration description
VQMT 13.1 Online help: Description of the format of the VQMT configuration file
Site structure