I am looking for paraphrase data sets.
I am aware of the PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." HLT-NAACL. 2013.). I am looking for more such data sets.following:
PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." HLT-NAACL. 2013.). Its English portion, PPDB:Eng, contains over 220 million paraphrase pairs.
The Microsoft Research Paraphrase Corpus (2005):
5800 pairs of sentences which have been extracted from news sources on the web, along with human annotations indicating whether each pair captures a paraphrase/semantic equivalence relationship. No more than 1 sentence has been extracted from any given news article. We have made a concerted effort to correctly associate with each sentence information about its provenance and any associated information about its author. If any attribution information is incorrect or missing, please send email to [email protected] and we will update the file.
- The DIRT Paraphrase Collection (Dekang Lin and Patrick Pantel. 2001. Discovery of Inference Rules for Question Answering. Natural Language Engineering 7(4):343-360.)