Autonomous robots have to find their way through a dynamic environment and react on events timely. Realtime processing of visual information is set to play a key role for this purpose. Exemplary for two special robots the extraction of data from image sequences relevant for robot control is demonstrated. For this reason, detailed assumptions of what is to be seen and what can be seen are put up in the form of models. A recognition system is developed and implemented that executes the abstraction of the model data from the image data using techniques like image correlation in the frequency domain and Hough Transformation. The extracted data is used for controlling one of the robots.