> top > projects > pubmed-sentences-benchmark
A benchmark data for text segmentation into sentences.
The source of annotation is the GENIA treebank v1.0.
Following is the process taken.
  1. began with the GENIA treebank v1.0.
  2. sentence annotations were extracted and converted to PubAnnotation JSON.
  3. uploaded. 12 abstracts met alignment failure.
  4. among the 12 failure cases, 4 had a dot('.') character where there should be colon (':'). They were manually fixed then successfully uploaded: 7903907, 8053950, 8508358, 9415639.
  5. among the 12 failed abstracts, 8 were "250 word truncation" cases. They were manually fixed and successfully uploaded. During the fixing, manual annotations were added for the missing pieces of text.
  6. 30 abstracts had extra text in the end, indicating copyright statement, e.g., "Copyright 1998 Academic Press." They were annotated as a sentence in GTB. However, the text did not exist anymore in PubMed. Therefore, the extra texts were removed, together with the sentence annotation to them.

Updated at 2017-08-15 16:14:09 UTC
Status Released
Maintainer Jin-Dong Kim
Author GENIA project
License Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
PubMed 1,999
Annotations (18,506)
Not prepared yet for this project.
Contact the manager of this project.
Evaluations Evaluations (0)