Perspective distortions estimation
- Author: Alexandra Anzina
- Supervisor: dr. Dmitriy Vatolin
Introduction
Sometimes, during stereoscopic movie shooting cameras can be installed incorrectly, resulting in a variety of geometric distortions. Particular case of geometric distortions is an artifact that occurs when stereoscopic cameras are vertically misaligned. We propose a new algorithm to detect a mismatch in the vertical position of the cameras.
Proposed method
Due to the geometric properties of optics, objects decrease in size proportionally to the distance between the object and camera. This phenomenon is called a linear perspective. In this regard, the algorithm is based on the assumption that, if the vertical position of the cameras does not match, the vertical shift value changes proportionally to the distance.
The algorithm is based on motion estimation and a modified version of RANSAC.
Experiments
For the analysis of stereoscopic frames where the artifact was not expressed explicitly, compensation was applied — the horizontal shift of the right image so that the background objects had horizontal disparity values equal to zero.
In this work, 14 stereoscopic movies were analyzed and 122 scenes with this artifact were found.
The efficiency of this method was proven on the artificially created test set, the average confidence in the results was approximately 90%. Pearson correlation coefficient between ground truth and algorithm values was 0.993.
A validation dataset was also created, consisting of 200 scenes taken from 4 stereo films.
Results
The average speed of the algorithm on the Intel Core i7-6500U 2.50GHz CPU is 1.04 seconds per 960 × 544 resolution frame with 96.8% of the time spent on calculating the disparity and confidence maps.
-
MSU Benchmark Collection
- MSU Video Upscalers Benchmark 2022
- MSU Video Deblurring Benchmark 2022
- MSU Video Frame Interpolation Benchmark 2022
- MSU HDR Video Reconstruction Benchmark 2022
- MSU Super-Resolution for Video Compression Benchmark 2022
- MSU No-Reference Video Quality Metrics Benchmark 2022
- MSU Full-Reference Video Quality Metrics Benchmark 2022
- MSU Video Alignment and Retrieval Benchmark
- MSU Mobile Video Codecs Benchmark 2021
- MSU Video Super-Resolution Benchmark
- MSU Shot Boundary Detection Benchmark 2020
- MSU Deinterlacer Benchmark
- The VideoMatting Project
- Video Completion
- Codecs Comparisons & Optimization
- VQMT
- MSU Datasets Collection
- Metrics Research
- Video Quality Measurement Tool 3D
- Video Filters
- Other Projects