It seems like they got a lot of mileage out of using a very simple appearance model for objects (color histograms). One of the reasons they use these histograms is that they are invariant to position. I wonder if a SIFT like feature might provide more discriminative power between objects and also some degree of pose independence. On the otherhand given the problem setting such a feature might be overkill.