Authors
Richard Socher, Eric H Huang, Jeffrey Pennington, Christopher D Manning, Andrew Y Ng
Publication date
2011
Conference
Advances in Neural Information Processing Systems
Volume
2011
Pages
801--809
Description
Paraphrase detection is the task of examining two sentences and determining whether they have the same meaning. In order to obtain high accuracy on this task, thorough syntactic and semantic analysis of the two statements is needed. We introduce a method for paraphrase detection based on recursive autoencoders (RAE). Our unsupervised RAEs are based on a novel unfolding objective and learn feature vectors for phrases in syntactic trees. These features are used to measure the word-and phrase-wise similarity between two sentences. Since sentences may be of arbitrary length, the resulting matrix of similarity measures is of variable size. We introduce a novel dynamic pooling layer which computes a fixed-sized representation from the variable-sized matrices. The pooled representation is then used as input to a classifier. Our method outperforms other state-of-the-art approaches on the challenging MSRP paraphrase corpus.
Total citations
2011201220132014201520162017201820192020202120222023202442054801411431361511239373684617
Scholar articles
R Socher, E Huang, J Pennin, CD Manning, A Ng - Advances in neural information processing systems, 2011