Automatic local color correction in S3D video

• Author: Vitaliy Lyudvichenko
• Supervisor: dr. Dmitry Vatolin

Introduction

When shooting stereoscopic video, many factors can cause color mismatch between camera views, such as illuminated camera filters, glare, polarized light, etc. We have developed an automatic method for elimination of color mismatch between stereo video views. A comparison with analogues showed that it has a higher-quality result and works faster.

Color mismatch in released "Spy Kids 3D: Game Over"

Color difference between views

Result of automatic correction by the proposed algorithm

Proposed method

The proposed approach includes:

• The algorithm for matching stereo views containing light distortion;
• The global color correction algorithm for the usage at the pre-processing stage during the comparison of stereoscopic views;
• The method for assessing the quality of comparing views;
• The algorithm that, according to the source views, disparity and confidence maps, applies a color conversion to the views, eliminating local inconsistencies between the views.

Experiments

The algorithm was compared to Ocula 3.0 (for Nuke 7.0) in Minimum Correction and Average Correction modes, and YuvSoft Stereo Processing Suite Pro 1.0 (Adobe After Effects CS 5.5)

Objective comparison

	Ocula 3.0 Average	Ocula 3.0 Minimum	YuvSoft SPS 1.0	Proposed method
SSIM	0.9981	0.9980	0.9951	0.9992
Y-PSNR	31.786	39.772	33.289	45.707
Working time, FPS	0.09	0.11	0.25	1.37

Artificially made distortions

Before color correction

Result of the proposed algorithm

Comparison between algorithms (difference with original frame)

Distortions in real video

Frame from "Pirates of the Caribbean: On Stranger Tides" trailer

Result of the proposed algorithm

Comparison between algorithms (difference with compensated frame)