So, it would seem that using a median optical flow amount for segmenting background is reasonable in certain quite limited circumstances. Can anyone explain to me how this algorithm would work in the presence of a really 3D background (forest of trees at different depths who's velocities are clearly scaled by their depths)? Is that addressed in either of the papers?