Netflix VMAF (Video Multimethod Assessment Fusion)

General info

Metric type

full-reference temporal metric

Value range

(completely different) 0..100 (similar to original)
-∞..∞ if truncation to 0..100 is off
dependent on model in case of custom model

Value interpretation

bigger better quality, value 100 does not mean that the images match pixel by pixel

MSU VQMT implementations

CPU multithreaded OpenCL (since VQMT 13)

MSU VQMT visualization

block-wise (for VMAF visualization), pixel-wise (for ADM, VIF, ANSNR visualisation)

Available colorspaces

Y

Output values

metric value,
bagging values (if on),
confidence intervals (if on),
values of elementary features (if on)

Aggregated values

standard set

MSU VQMT usages

-metr vmaf [-dev <OpenCL device>]

External links

Original paper

Algorithm description

VMAF is modern reference metric developed by Netflix in cooperation with the University of Southern California. VQMT has full support of VMAF with multiple configuration switches. MSU VQMT support the following VMAF models: VMAF 0.60, VMAF 0.61 (2k, 4k), VMAF 0.62 (2k, 4k), VMAF 0.63 (2k), also, you can compute phone model and elementary features of VMAF. You can use custom model in pkl format with VQMT.

VMAF consist of 4 features (ADM, VIF, Motion, ANSNR) and 35 elementary features, but VMAF models uses only 6 of them: adm2, motion2, vif_scale0, vif_scale1, vif_scale2, vif_scale3. VMAF applies an SVM model to this set of features, which depends on current settings. After applying SVM, the value is clipped to interval 0..100 by default. Motion feature is the only temporal feature, it consider adjacent frames. To calculate VMAF value for current frame it is needed to use the previous frame and the next frame.

VMAF can also compute confidence intervals by applying multiple models and calculating standard deviation of result. VMAF has models, that aimed for 4k and 2k. By default, VQMT will automatically select the correct model by the resolution of input video.

Since VQMT 13 VMAF has a real block-wise visualization, which computes individual VMAF value for each 16x16 block of image. You also can visualize every feature besides motion (ADM, VIF, ANSNR).

Benchmark

Choose benchmark:
Implementation System & settings Colors Resolution FPS Sec. per frame
VQMT 14.0 OpenCL OpenCL Y HD 720p 78.35 0.014
VQMT 14.0 OpenCL OpenCL Y FullHD 1080p 38.95 0.028
VQMT 14.0 OpenCL OpenCL Y 4K 2160p 9.94 0.113
VQMT 14.0 default multithreaded Y HD 720p 17.68 0.06
VQMT 14.0 default multithreaded Y FullHD 1080p 8.03 0.134
VQMT 14.0 default multithreaded Y 4K 2160p 1.86 0.616
VQMT 14.0 default singlethreaded Y HD 720p 5.93 0.177
VQMT 14.0 default singlethreaded Y FullHD 1080p 2.78 0.38
VQMT 14.0 default singlethreaded Y 4K 2160p 0.66 1.567
Measurements were done on VQMT 14.0 BETA r12792 PRO for Windows.
CPU: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 8 cores
GPU: NVIDIA CUDA/GeForce GTX 660 Ti
Values can vary depending on system configuration, input format and other factors
Implementation System & settings Colors Resolution FPS Sec. per frame
VQMT 13.1 OpenCL OpenCL Y HD 720p 80.5 0.013
VQMT 13.1 OpenCL OpenCL Y FullHD 1080p 40.25 0.027
VQMT 13.1 OpenCL OpenCL Y 4K 2160p 10.12 0.11
VQMT 13.1 default multithreaded Y HD 720p 17.96 0.058
VQMT 13.1 default multithreaded Y FullHD 1080p 8.03 0.132
VQMT 13.1 default multithreaded Y 4K 2160p 1.91 0.593
VQMT 13.1 default singlethreaded Y HD 720p 6.23 0.166
VQMT 13.1 default singlethreaded Y FullHD 1080p 2.91 0.356
VQMT 13.1 default singlethreaded Y 4K 2160p 0.69 1.484
Measurements were done on VQMT 13.1 r12792 PRO for Windows.
CPU: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz, 8 cores
GPU: NVIDIA CUDA/GeForce GTX 660 Ti
Values can vary depending on system configuration, input format and other factors
Implementation System & settings Colors Resolution FPS Sec. per frame
VQMT 14.0 OpenCL OpenCL Y HD 720p 291.17 0.005
VQMT 14.0 OpenCL OpenCL Y FullHD 1080p 132.3 0.011
VQMT 14.0 OpenCL OpenCL Y 4K 2160p 32.23 0.048
VQMT 14.0 default multithreaded Y HD 720p 192.66 0.007
VQMT 14.0 default multithreaded Y FullHD 1080p 42.9 0.032
VQMT 14.0 default multithreaded Y 4K 2160p 10.34 0.189
VQMT 14.0 default singlethreaded Y HD 720p 6.56 0.157
VQMT 14.0 default singlethreaded Y FullHD 1080p 3.01 0.339
VQMT 14.0 default singlethreaded Y 4K 2160p 0.8 1.267
Measurements were done on VQMT 14.0 BETA r12792 PRO for Linux.
CPU: Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz, 64 cores
GPU: NVIDIA CUDA/TITAN RTX
Values can vary depending on system configuration, input format and other factors

Example

Choose example:
Original
LQ H264, VMAF-y=40.39
MSU VQMT visualization
Original
Blurring, VMAF-y=10.94
MSU VQMT visualization
Original
Random points, VMAF-y=96.51
MSU VQMT visualization
Original
Luminance shift, VMAF-y=98.13
MSU VQMT visualization
Original
JPEG Q=2, VMAF-y=21.31
MSU VQMT visualization
Original
JPEG Q=5, VMAF-y=34.31
MSU VQMT visualization
Original
JPEG Q=10, VMAF-y=57.80
MSU VQMT visualization
Original
JPEG Q=15, VMAF-y=69.19
MSU VQMT visualization
Original
JPEG Q=20, VMAF-y=77.00
MSU VQMT visualization
Original
JPEG Q=40, VMAF-y=87.53
MSU VQMT visualization
Original
JPEG Q=80, VMAF-y=94.31
MSU VQMT visualization
Choose example:
Original
LQ H264, VMAF-y=70.30
MSU VQMT visualization
Original
Blurring, VMAF-y=6.43
MSU VQMT visualization
Original
Random points, VMAF-y=95.32
MSU VQMT visualization
Original
Luminance shift, VMAF-y=100.00
MSU VQMT visualization
Original
JPEG Q=2, VMAF-y=48.68
MSU VQMT visualization
Original
JPEG Q=5, VMAF-y=60.95
MSU VQMT visualization
Original
JPEG Q=10, VMAF-y=76.68
MSU VQMT visualization
Original
JPEG Q=15, VMAF-y=82.54
MSU VQMT visualization
Original
JPEG Q=20, VMAF-y=85.99
MSU VQMT visualization
Original
JPEG Q=40, VMAF-y=90.84
MSU VQMT visualization
Original
JPEG Q=80, VMAF-y=93.91
MSU VQMT visualization
Choose example:
Original
LQ H264, VMAF-y=3.65
MSU VQMT visualization
Original
Blurring, VMAF-y=4.13
MSU VQMT visualization
Original
Random points, VMAF-y=95.88
MSU VQMT visualization
Original
Luminance shift, VMAF-y=97.00
MSU VQMT visualization
Original
JPEG Q=2, VMAF-y=30.93
MSU VQMT visualization
Original
JPEG Q=5, VMAF-y=43.09
MSU VQMT visualization
Original
JPEG Q=10, VMAF-y=62.62
MSU VQMT visualization
Original
JPEG Q=15, VMAF-y=73.63
MSU VQMT visualization
Original
JPEG Q=20, VMAF-y=78.76
MSU VQMT visualization
Original
JPEG Q=40, VMAF-y=88.20
MSU VQMT visualization
Original
JPEG Q=80, VMAF-y=94.32
MSU VQMT visualization

Legacy notes