This paper is based on the authors' previous work of dynamic layer model, which extends the estimation of layer model to incremental estimation formulation. The key idea of this paper is that they use multiple background and foreground layers to segment the scene for tracking purpose. The multiple background layers would help to solve the complex background occluding problems and also do well for the object tracking.