In this paper, we are going to explore the possibility to apply deconvolution network, sum-product network and contextualized word embeddings (ELMo) on learning encoded sentence representation and sentiment identification.