We present a method to recognize three-dimensional objects from phase-shift digital holograms. The holograms are used to reconstruct various views of the objects. These views are combined to create nonlinear composite filters in order to achieve distortion invariance. We present experiments to illustrate the recognition of a 3D object in the presence of out-of-plane rotation and longitudinal shift along the z-axis.