Gesture recognition is needed for a variety of applications. One particular application of gesture-based systems is to implement a speaking aid for the deaf. Among several factors constituting a hand gesture, the arm movement pattern is one of the most challenging features to recognize. In this paper, we propose a neural-network-based approach to recognition of spatio-tempora patterns of nonlinear 3D arm movements. Compared to Hidden-Markov-Model-based methods, the most appealing property of the proposed method is its simplicity. The effectiveness of this method is evaluated by a database consisted of 10 persons.