Automatic local color correction in S3D video

Introduction

When shooting stereoscopic video, many factors can cause color mismatch between camera views, such as illuminated camera filters, glare, polarized light, etc. We have developed an automatic method for elimination of color mismatch between stereo video views. A comparison with analogues showed that it has a higher-quality result and works faster.

Color mismatch in released "Spy Kids 3D: Game Over"

Example of color distortion, "Spy Kids 3D: Game Over", 0:14:19


Color difference between views

Color difference between views


Result of automatic correction by the proposed algorithm

Corrected colors

Proposed method

The proposed approach includes:

Experiments

The algorithm was compared to Ocula 3.0 (for Nuke 7.0) in Minimum Correction and Average Correction modes, and YuvSoft Stereo Processing Suite Pro 1.0 (Adobe After Effects CS 5.5)

Objective comparison

Ocula 3.0 Average Ocula 3.0 Minimum YuvSoft SPS 1.0 Proposed method
SSIM 0.9981 0.9980 0.9951 0.9992
Y-PSNR 31.786 39.772 33.289 45.707
Working time, FPS 0.09 0.11 0.25 1.37

Artificially made distortions

Before color correction

Artificial distortion


Result of the proposed algorithm

Automatically corrected colors


Comparison between algorithms (difference with original frame)

Comparison of color difference

Distortions in real video

Frame from "Pirates of the Caribbean: On Stranger Tides" trailer

Distortions in real video


Result of the proposed algorithm

Automatically corrected colors


Comparison between algorithms (difference with compensated frame)

Comparison of color difference

29 May 2019
See Also
Video Colorization Benchmark
Explore the best video colorization algorithms
MSU 3D-video Quality Analysis. Report 12
MSU 3D-video Quality Analysis. Report 11
MSU 3D-video Quality Analysis. Report 10
Detection of stereo window violation
How to find objects that are present only in one view?
Depth continuity estimation in S3D video
How smooth is the depth transition between scenes?
Site structure