I wanted to post my progress on segmentation before I start working on clustering and video sequences. Here are images that show the current state of segmentation (down to under 2s per frame) of a more realistic Vancouver scene captured on video: (reconstruction, mean-shift filtering, original image)