This research models human behavior as sequential assembly of primitive actions,and analyzes natural behavior by building computational models in routine spacein a situated manor. There are four contributions presented in this thesis.First, we built a real-time computer vision system that can simulate basichuman visuomotor behaviors. A major psychological background is the theoryof visual routines,.