Did you add the [Cudafy] attribute to the structs? You will also have to tell the Cudafy translator to handle these structs, too.
See the CudafyByExample project for example of how to do this - ray tracing sample would be useful.