Parallax range estimation in S3D video
The parallax in S3D video is defined as the offset of a pixel in the right view relative to its position in the left view. This offset is commonly denoted as a percentage of screen width. If a pixel’s position in the right view is to the right of its position in the left view (positive parallax), we perceive the point further than the screen:
At zero parallax the pixel’s depth corresponds to the screen level. Pixels with negative parallax are viewed closer than the screen:
To get a point infinitely far away, we should make the parallax equal to the distance between the eyes. If the parallax is higher than that distance, the point becomes “father than infinite”, which is impossible in real life and can cause pain to the viewer:
We can easily observe that a 3D movie will have huge parallaxes when watched on a cinema screen because the screen width is big in comparison with the pupillary distance. If we watch the same movie on a mobile 3D-capable monitor, the screen width and hence parallaxes would be small (that is why mobile screens have “small depth”):
Estimating the range of parallaxes can show us how well the movie will be perceived.
We propose a method for estimating parallax distribution. The method’s outline is as follows:
- A stereo matching algorithm is used to determine disparity between left and right views;
- A histogram of lengths of matching vectors is computed;
- The histogram is cut off at the ends to eliminate outliers.
The resulting histogram shows the range of parallaxes in the movie.
We estimated parallaxes in 105 movies. The following diagram depicts average extreme negative and positive disparities for each movie relative to its release date:
The “Avatar” movie (2009) was selected as a baseline in parallax range comparison, with parallaxes from -0.5 percent of screen width to 1.0, which is the most comfortable range. Some recent movies are still far from the ideal parallax distribution.
Each column represents a movie. Bottom red bars mean almost flat scenes, while top red bars mean excessively large parallaxes.
MSU Benchmark Collection
- MSU Video Upscalers Benchmark 2022
- MSU Video Deblurring Benchmark 2022
- MSU Video Frame Interpolation Benchmark 2022
- MSU HDR Video Reconstruction Benchmark 2022
- MSU Super-Resolution for Video Compression Benchmark 2022
- MSU No-Reference Video Quality Metrics Benchmark 2022
- MSU Full-Reference Video Quality Metrics Benchmark 2022
- MSU Video Alignment and Retrieval Benchmark
- MSU Mobile Video Codecs Benchmark 2021
- MSU Video Super-Resolution Benchmark
- MSU Shot Boundary Detection Benchmark 2020
- MSU Deinterlacer Benchmark
- The VideoMatting Project
- Video Completion
- Codecs Comparisons & Optimization
- MSU Datasets Collection
- Metrics Research
- Video Quality Measurement Tool 3D
- Video Filters
- Other Projects