Automatic Segmentation

Interest in advanced interactivity with multimedia data significantly increased last years. This causes an advent of new standards proposing functionality for manipulation with multimedia data (an example of such a standard is MPEG4). That is why segmentation algorithms find its application in wide range of areas including content-based representation of multimedia data, improvement of coding efficiency in video compression standards, sophisticated query and retrieval of video and other content-based functionalities for multimedia applications.

Our developed algorithm performs detection and tracking of foreground (FG) objects in video. This is done by calculation of global motion with further estimation of local motion. Detection of a FG object position is then performed based on the information about global and local motion. The principal advantage of the method is its ability to detect a FG object even in case of ultra slow motion which is not common for algorithms of this type. Another important advantages include:

Examples

This section contains segmentation results of the developed algorithm and its comparison with an algorithm developed at University of Florida.

The first example (pic. 1, 2) demonstrates result obtained using ‘dancer’ test video sequence:

Original frame Segmentation result
Pic.1 Original frame Pic.2 Segmentation result

The second example (pic. 3, 4) shows result obtained using ‘table tennis’ test video sequence:

Original frame Segmentation result
Pic.3 Original frame Pic.4 Segmentation result

The next example (pic. 5, 6) shows segmentation result of ‘bus’ test video sequence:

Original frame Segmentation result
Pic.5 Original frame Pic.6 Segmentation result

Quality comparison of the developed method and the algorithm of University of Florida is shown in the pictures below. This example shows the results for a test video sequence ‘mother & daughter’. This sequence has two obstacles for successful segmentation. The first one is the proximity of colors belonging to different objects. And the second one (obstacle for foreground-background classification) is very slow motion of FG objects. Method of University of Florida produces segments consisting of parts actually belonging to several objects: the blue segment has parts in the area of woman’s silhouette, blue segment points are presented around woman’s head. However this comparison is not fully correct because the algorithms perform segmentation of different types.


Pic.7 Original frame
University of Florida result
Pic.8 University of Florida result
(different segments are marked by different colors)
Proposed method result
Pic.9 Proposed method result

Download

For commercial license of this filter please contact us via

E-mail: video-licensing@graphics.cs.msu.ru

10 Mar 2011
See Also
MSU Image- and video-quality metrics analysis
Description of a project in MSU Graphics and Media Laboratory
MSU Video Group / Video data filtering and compession
VirtualDub MSU Logo Remover
The filter is intended to remove logo from films
MSU Stereo To Multiview 3D Video Conversion ( Glasses-free 3D-Displays Video Content creation)
Stereo to multiview video conversion algorithm for glasses-free autostereoscopic 3D displays
MSU Video Super-Resolution Filter
This filter increases resolution of video sequence while saving and improving details and reducing artifacts.
MSU Video Group / Video data filtering and compession
Site structure