Automatic local color correction in S3D video
- Author: Vitaliy Lyudvichenko
- Supervisor: dr. Dmitriy Vatolin
Introduction
When shooting stereoscopic video, many factors can cause color mismatch between camera views, such as illuminated camera filters, glare, polarized light, etc. We have developed an automatic method for elimination of color mismatch between stereo video views. A comparison with analogues showed that it has a higher-quality result and works faster.
Color mismatch in released "Spy Kids 3D: Game Over"
Color difference between views
Result of automatic correction by the proposed algorithm
Proposed method
The proposed approach includes:
- The algorithm for matching stereo views containing light distortion;
- The global color correction algorithm for the usage at the pre-processing stage during the comparison of stereoscopic views;
- The method for assessing the quality of comparing views;
- The algorithm that, according to the source views, disparity and confidence maps, applies a color conversion to the views, eliminating local inconsistencies between the views.
Experiments
The algorithm was compared to Ocula 3.0 (for Nuke 7.0) in Minimum Correction and Average Correction modes, and YuvSoft Stereo Processing Suite Pro 1.0 (Adobe After Effects CS 5.5)
Objective comparison
Ocula 3.0 Average | Ocula 3.0 Minimum | YuvSoft SPS 1.0 | Proposed method | |
---|---|---|---|---|
SSIM | 0.9981 | 0.9980 | 0.9951 | 0.9992 |
Y-PSNR | 31.786 | 39.772 | 33.289 | 45.707 |
Working time, FPS | 0.09 | 0.11 | 0.25 | 1.37 |
Artificially made distortions
Before color correction
Result of the proposed algorithm
Comparison between algorithms (difference with original frame)
Distortions in real video
Frame from "Pirates of the Caribbean: On Stranger Tides" trailer
Result of the proposed algorithm
Comparison between algorithms (difference with compensated frame)
-
MSU Benchmark Collection
- MSU Video Upscalers Benchmark 2022
- MSU Video Deblurring Benchmark 2022
- MSU Video Frame Interpolation Benchmark 2022
- MSU HDR Video Reconstruction Benchmark 2022
- MSU Super-Resolution for Video Compression Benchmark 2022
- MSU No-Reference Video Quality Metrics Benchmark 2022
- MSU Full-Reference Video Quality Metrics Benchmark 2022
- MSU Video Alignment and Retrieval Benchmark
- MSU Mobile Video Codecs Benchmark 2021
- MSU Video Super-Resolution Benchmark
- MSU Shot Boundary Detection Benchmark 2020
- MSU Deinterlacer Benchmark
- The VideoMatting Project
- Video Completion
- Codecs Comparisons & Optimization
- VQMT
- MSU Datasets Collection
- Metrics Research
- Video Quality Measurement Tool 3D
- Video Filters
- Other Projects