Thanks for uploading code. I'm really interested in your work.
My question is how to preprocess dbpedia datasets, because descriptions.txt contains, something like
Paris,_Texas 2056 paris texas city county seat lamar county texas united states 2010 census population city 25 171 situated northeast texas western edge piney woods northeast dallas–fort worth metroplex ...
and I can't find out where the sentence boundary is. Also, I'd like to replace lemmatized token to original one.
If you'd know how the preprocessing of dbpedia was done, I'd really appreciate it.
Thanks.
Thanks for uploading code. I'm really interested in your work.
My question is how to preprocess dbpedia datasets, because
descriptions.txtcontains, something likeParis,_Texas 2056 paris texas city county seat lamar county texas united states 2010 census population city 25 171 situated northeast texas western edge piney woods northeast dallas–fort worth metroplex ...and I can't find out where the sentence boundary is. Also, I'd like to replace lemmatized token to original one.
If you'd know how the preprocessing of dbpedia was done, I'd really appreciate it.
Thanks.