Main page — VQMT

This is part of MSU Video Quality Measurement tool Online Help for MSU VQMT 13.0

MSU Video Quality Measurement Tool (MSU VQMT) project:

Online help for MSU VQMT 13.0 contents:

Content

List of available metrics

psnr

PSNR

http://www.compression.ru/video/quality_measure/info.html#psnr

  • Color components: Y, U, V, R, G, B, LUV-L, RGB, YUV
  • Type: reference metric
  • Usage: -metr psnr <color component>

hdr-psnr

PSNR

http://www.compression.ru/video/quality_measure/info.html#psnr

  • Color components: PU-L, PU encoding BT.709 L, PU encoding BT.2020 L, ICtCp BT.2100 PQ ICtCp
  • Type: reference metric
  • Usage: -metr hdr-psnr <color component>

This metric can be configured using next parameter(s):

  • Peak luminance (nits)
    PSNR peak luminance value. 0 means display luminance
    Default value: 0.00000000000000000
    Usage: -set "peak_lum=<value>", where <value> can be:
    • value in range 0..10000

identity

Identity

http://www.compression.ru/video/quality_measure/info.html#identity

  • Color components: Y, U, V, R, G, B, LUV-L, RGB, YUV
  • Type: reference metric
  • Usage: -metr identity <color component>

This metric can be configured using next parameter(s):

  • Mode
    Possible types:
    • binary - 1 images are similar, 0 in other case
    • pixels - proportion of similar pixels, 1 - all pixels are same (0..1)
      Default value: binary
      Usage: -set "mode=<value>", where <value> can be:
    • binary
    • pixels

ssim

SSIM

http://www.compression.ru/video/quality_measure/info.html#ssim

  • Color components: Y, U, V
  • Type: reference metric
  • Usage: -metr ssim <color component>
  • Usage: -metr ssim_precise <color component>
  • Usage: -metr ssim_gpu_id <color component>
  • Usage: -metr ssim_cuda <color component>
  • Usage: -metr ssim <color component> -dev OpenCL0

msssim

MSSSIM

http://www.compression.ru/video/quality_measure/info.html#ssim

hdr-ssim

HDR SSIM

http://www.compression.ru/video/quality_measure/info.html#ssim

  • Color components: PU-L, PU encoding BT.709 L, PU encoding BT.2020 L
  • Type: reference metric
  • Usage: -metr hdr-ssim <color component> -dev CPU
  • Usage: -metr hdr-ssim <color component> -dev CPU
  • Usage: -metr hdr-ssim <color component> -dev OpenCL0

hdr-msssim

HDR MSSSIM

http://www.compression.ru/video/quality_measure/info.html#ssim

3ssim

3SSIM

http://www.compression.ru/video/quality_measure/info.html#3ssim

  • Color components: Y, U, V
  • Type: reference metric
  • Usage: -metr 3ssim <color component>
  • Usage: -metr 3ssim_cuda <color component>
  • Usage: -metr 3ssim <color component> -dev OpenCL0

vqm

VQM

http://www.compression.ru/video/quality_measure/info.html#vqm

  • Color components: Y
  • Type: reference metric
  • Usage: -metr vqm <color component>

blocking

Blocking

http://www.compression.ru/video/quality_measure/info.html#blockingmeasure

  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr blocking <color component>

blurring

Blurring

http://www.compression.ru/video/quality_measure/info.html#ybluringmeasure

  • Color components: Y, R, G, B
  • Type: no-reference metric
  • Usage: -metr blurring <color component>
  • Color components: Y, U, V, R, G, B
  • Usage: -metr blurring_delta <color component>

delta

Delta

http://www.compression.ru/video/quality_measure/info.html#delta

  • Color components: Y, U, V, R, G, B, LUV-L
  • Type: reference metric
  • Usage: -metr delta <color component>

delta-ictcp

Delta

http://www.compression.ru/video/quality_measure/info.html#delta

  • Color components: ICtCp BT.2100 PQ ICtCp
  • Type: reference metric
  • Usage: -metr delta-ictcp <color component>

msad

MSAD

http://www.compression.ru/video/quality_measure/info.html#msad

  • Color components: Y, U, V, R, G, B, LUV-L
  • Type: reference metric
  • Usage: -metr msad <color component>

mse

MSE

http://www.compression.ru/video/quality_measure/info.html#mse

  • Color components: Y, U, V, R, G, B, LUV-L
  • Type: reference metric
  • Usage: -metr mse <color component>

time-shift

Time shift

http://www.compression.ru/video/quality_measure/info.html#shift

  • Color components: Y
  • Type: reference metric
  • Usage: -metr time-shift <color component>

This metric can be configured using next parameter(s):

  • Max. shift
    Maximum shift, that can be detected. Note: large values leads big memory consumption
    Default value: 5
    Usage: -set "max-shift=<value>", where <value> can be:
    • value in range 0..25
  • Direction
    Detect only positive shifts (frame dups), negatives (frame drops) or both
    Default value: both
    Usage: -set "direction=<value>", where <value> can be:
    • positive
    • negative
    • both
  • Destination metric
    This metric will be used to measure similarity between frames
    Default value: psnr
    Usage: -set "metric=<value>", where <value> can be:
    • psnr
    • ssim
  • Show metric values
    Metric will output now only shift, but destination metric values
    Default value: false
    Usage: -set "show-metric=<value>", where <value> can be:
    • true
    • false
  • Threshold
    We will consider shift only if metric for neighbour frame better than this thresold multiplied to metric for similar frame
    Default value: 0.99500000476837158
    Usage: -set "threshold=<value>", where <value> can be:
    • any floating point number
  • Smoothing
    Will smooth metric values over time. If equal n, than smoothing will be in the interval frame-n..frame+n
    Default value: 1
    Usage: -set "smoothing=<value>", where <value> can be:
    • value in range 0..25

si

SI / TI

http://www.compression.ru/video/quality_measure/info.html#si

  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr si <color component> -dev CPU

ti

SI / TI

http://www.compression.ru/video/quality_measure/info.html#ti

  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr ti <color component> -dev CPU

hdr-vqm

HDRVQM

https://sites.google.com/site/narwariam/home/research/hdr-vqm

  • Color components: PU-L, PU encoding BT.709 L, PU encoding BT.2020 L
  • Type: reference metric
  • Usage: -metr hdr-vqm <color component>

This metric can be configured using next parameter(s):

  • Fixation frames
    Number of frame for calculation of spatio-temporal tubes. 0 - auto (0.6 seconds, based on fps of first video)
    Default value: 0
    Usage: -set "fixation_frames=<value>", where <value> can be:
    • value in range 0..50
  • FFT cols
    Video will be scaled to this value (bicubic). 0 - auto (clothest to video size)
    Default value: 1024
    Usage: -set "fft_cols=<value>", where <value> can be:
    • value in range 64..32768
  • FFT rows
    Video will be scaled to this value (bicubic). 0 - auto (clothest to video size)
    Default value: 512
    Usage: -set "fft_rows=<value>", where <value> can be:
    • value in range 64..32768
  • Pooling Percentage
    Pooling Percentage for long-term pooling
    Default value: 0.30000001192092896
    Usage: -set "pooling_precent=<value>", where <value> can be:
    • value in range 0.10000000000000001..1.0000000000000000
  • Dispaly: cols
    Columns of the target display
    Default value: 1920.0000000000000
    Usage: -set "display_cols=<value>", where <value> can be:
    • value in range 500..10000
  • Dispaly: rows
    Rows of the target display
    Default value: 1080.0000000000000
    Usage: -set "display_rows=<value>", where <value> can be:
    • value in range 500..10000
  • Dispaly: area
    Area of the target display
    Default value: 6100.0000000000000
    Usage: -set "display_area=<value>", where <value> can be:
    • value in range 500.00000000000000..100000.00000000000
  • Dispaly: distance
    Viewer’s dispaly distance, cm
    Default value: 178.00000000000000
    Usage: -set "display_distance=<value>", where <value> can be:
    • value in range 10.000000000000000..100.00000000000000

niqe

NIQE

http://www.compression.ru/video/quality_measure/info.html#niqe

  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr niqe <color component>

This metric can be configured using next parameter(s):

  • Mean threshold
    Values of metric greater than this value will be skipped during mean calculation. 0 for disable skipping
    Default value: 15.000000000000000
    Usage: -set "mean_thresh=<value>", where <value> can be:
    • any floating point number
  • Threshold smoothing
    Values of metric greater than ‘Mean threshold’ + ‘Threshold smoothing’ will be skipped, values less than ‘Mean threshold’ - ‘Threshold smoothing’ will be assumed with weight 1. Intermediate values will be taken with intermediate weight
    Default value: 5.0000000000000000
    Usage: -set "mean_thresh_smoothing=<value>", where <value> can be:
    • any floating point number
  • Type of normalization
    • fast - the fastest algorithm, low precision
      • native - like in native NIQE implementation. Slowest one
      • precise - the most precise algorithm
        Default value: native
        Usage: -set "norm_alg=<value>", where <value> can be:
    • fast
    • native
    • precise
  • Usage: -metr niqe <color component> -dev OpenCL0

This metric can be configured using next parameter(s):

  • Mean threshold
    Values of metric greater than this value will be skipped during mean calculation. 0 for disable skipping
    Default value: 15.000000000000000
    Usage: -set "mean_thresh=<value>", where <value> can be:
    • any floating point number
  • Threshold smoothing
    Values of metric greater than ‘Mean threshold’ + ‘Threshold smoothing’ will be skipped, values less than ‘Mean threshold’ - ‘Threshold smoothing’ will be assumed with weight 1. Intermediate values will be taken with intermediate weight
    Default value: 5.0000000000000000
    Usage: -set "mean_thresh_smoothing=<value>", where <value> can be:
    • any floating point number

vmaf

Netflix VMAF

  • Color components: Y
  • Type: reference metric
  • Usage: -metr vmaf <color component>

This metric can be configured using next parameter(s):

  • Model preset
    Choose built-in model or ‘custom’ for loading model from file. Built-in models:
    • default - VMAF default behaviour:
      • VMAF v0.6.1 for running without confidence interval and per-model values
      • VMAF v0.6.1 4k for previous case if applying 4k model
      • VMAF v0.6.3 for running with confidence interval or per-model values
      • VMAF v0.6.2 4k for previous case if applying 4k model (NOTE: no v0.6.3 for 4k)
    • vmaf_v061 - Netflix model VMAF v0.6.1 (2k or 4k)
    • vmaf_v062 - Netflix model VMAF v0.6.2 (2k or 4k), supports confidence interval
    • vmaf_v063 - Netflix model VMAF v0.6.3 (only 2k), supports confidence interval
    • all_models - vmaf_v061 - vmaf_v063 computed sumultaneously
    • basic_features - view only basic features from VMAF. Model will not be applied
    • standard_features - features that is used in VMAF v0.6.1 and VMAF score (2k or 4k)
    • all_features - view all features from VMAF. Model will not be applied
    • all - all feature and next models:
      • VMAF v0.6.1 (2k or 4k)
      • VMAF v0.6.2 (2k or 4k)
      • VMAF v0.6.3
        Default value: default
        Usage: -set "model_preset=<value>", where <value> can be:
    • default
    • vmaf_v061
    • vmaf_v062
    • vmaf_v063
    • vmaf_v060
    • all_models
    • basic_features
    • standard_features
    • all_features
    • all
    • custom
  • Custom model (*.pkl)
    you can specify path to *.pkl file here (or multiple ;-separated *.pkl files). Model file should be placed near pkl file.
    NOTE: this only means if preset is set to ‘custom’
    Default value: ``
    Usage: -set "custom_model_files=<value>", where <value> can be:
    • any string
  • 4k
    selection 4k model policy:
    • auto - select 4k if exists suitable model and input video is 4k
    • forced_2k - always 2k model
    • forced_4k - 4k if exsists: VMAF v0.6.1-2
      NOTE: this param does not affects custom model
      Default value: auto
      Usage: -set "4k=<value>", where <value> can be:
    • auto
    • forced_2k
    • forced_4k
  • Confidence interval
    turn on additional VMAF features: 95%-confidence interval output and other statistical information
    Default value: false
    Usage: -set "confidence_interval=<value>", where <value> can be:
    • true
    • false
  • Per-model values
    output values for all bootstrap models if confidence interval is on
    Default value: false
    Usage: -set "permodel_values=<value>", where <value> can be:
    • true
    • false
  • Visualize algorithm (if on)
    if visualization turned on you can select feature to visualize. It’s impossible to calculate distribution of real VMAF value, so you can only visualize one of supposed features
    Default value: default
    Usage: -set "visualize_alg=<value>", where <value> can be:
    • default
    • adm
    • ansnr
    • motion
    • vif
  • Use phone model
    turn on postprocessing of metric value that produces more precise results for handheld devices. Select ‘both’ to see both results with and without postprocessing
    Default value: no
    Usage: -set "phone_model=<value>", where <value> can be:
    • no
    • yes
    • both
  • Disable clipping values
    turn off clipping value to range set by model (0..100 for example)
    Default value: false
    Usage: -set "disable_clip=<value>", where <value> can be:
    • true
    • false
  • Usage: -metr vmaf <color component> -dev OpenCL0

Test

Test OpenCL

bfm

Brightness Flicking

http://compression.ru/video/quality_measure/metric_plugins/bfm_en.htm

  • Plugin metric: yes
  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr bfm <color component>

bi_psnr

Brightness Independent PSNR

http://www.compression.ru/video/quality_measure/metric_plugins/bi-psnr_en.htm

  • Plugin metric: yes
  • Color components: Y
  • Type: reference metric
  • Usage: -metr bi_psnr <color component>

dfm

Drop Frame Metric

http://compression.ru/video/quality_measure/metric_plugins/dfm_en.htm

  • Plugin metric: yes
  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr dfm <color component>

ne

Noise Estimation

http://www.compression.ru/video/quality_measure/metric_plugins/ne_en.htm

  • Plugin metric: yes
  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr ne <color component>

This metric can be configured using next parameter(s):

  • Noise level definition algorithm
    Values:
    • frequency_domain (Frequency Domain) - amount of frequencies in fourier transformation of image. Range of this variant is (constant image) 0..1 (very noisy). For more info, see Kanjar De and V. Masilamani “Image Sharpness Measure for Blurred Images in Frequency Domain”
      This method visualizes grayscale centered DFT image of input picture. Scaled absolute values of DFT is visualized, 255 (white) means frequencies with abs max(DFT)/100 and greater.
    • MAD - For each frame do HAAR wavelet decomposition. Than evaluate median of HH-component’s absolute values. Final value of the metrics is the normalized median.
    • block_based (Block Based) - Frames are tessellated into a number of 8x8 blocks. Standard deviations of intensity (measures of intensity variation) are computed for all the blocks and sorted. The block with the smallest standard deviation has the least change of intensity. The smaller the standard deviation, the smother the block. The intensity variation of a smooth block may be due to noise, in which the standard deviation of the block is close to that of the Gaussian noise added. Normalized average arithmetic values of 30% of all blocks with the least values grows is the final value of the metric.
    • spatio_temporal (Spatio-Temporal Gradients) - For each frame is doing wavelet decomposition.computing temporal and spatial histograms.The initial estimation of noise level is defined by value at which temporal or spatial histogram achieves the maximal value.The decision of whether to use the spatial or temporal histogram is based on the deviation of the histogram from the Rayleigh distribution.Then this estimation is corrected, using Kolmogorov - Smirnoff test.The normalized corrected estimation is the final value of the metric.

    Default value: frequency_domain
    Usage: -set "noise-definition=<value>", where <value> can be:

    • frequency_domain
    • MAD
    • block_based
    • spatio_temporal

scd

Scene Change Detector

http://compression.ru/video/quality_measure/metric_plugins/scd_en.htm

  • Plugin metric: yes
  • Color components: Y
  • Type: no-reference metric
  • Usage: -metr scd <color component>

This metric can be configured using next parameter(s):

  • Similarity measurement algorithm
    Values:
    • pixel_level - Pixel-level frames comparison
    • global - Global Histogram comparison
    • block_based - Block-Based Histogram comparison
    • motion_based - Motion-Based similarity measure
      Default value: Block-Based Histogram comparison
      Usage: -set "similarity-measurement=<value>", where <value> can be:
    • pixel_level
    • global
    • block_based
    • motion_based

testocl

testocl

http://www.compression.ru/video/quality_measure/info.html#

  • Color components: Y, U, V, R, G, B, LUV-L
  • Type: reference metric
  • Usage: -metr testocl <color component> -dev OpenCL0

This page is automatically generated by 13.0 beta r12626 on 2021-02-05. In case of any question or suggestion, please mail us: video-measure@compression.ru

05 Feb 2021
See Also
Super-Resolution for Video Compression Benchmark
Learn about the best SR methods for compressed videos and choose the best model to use with your codec
MSU Video Quality Measurement Tool: Documentation TOC
Table of content for all version of MSU VQMT online help
MSU Video Quality Measurement Tool: Picture types
VQMT 14.0 Online help: List of all picture types available in VQMT and their aliases
MSU Video Quality Measurement Tool: Usage of VQMT metrics in CLI
VQMT 14.0 Online help: Description of VQMT metrics, their parameters and using in CLI
MSU Video Quality Measurement Tool: VQMT various lists and tables
VQMT 14.0 Online help: Information about VQMT visualization formats, read modes, etc...
MSU Video Quality Measurement Tool: Command-line help
VQMT 14.0 Online help: Information about all VQMT CLI options for Pro/Premium versions
Site structure
MSU Graphics & Media Lab Video Group
2019–2022