> top > projects > pubmed-sentences-benchmark
pubmed-sentences-benchmark  
Description
A benchmark data for text segmentation into sentences.
The source of annotation is the GENIA treebank v1.0.
Following is the process taken.
  1. began with the GENIA treebank v1.0.
  2. sentence annotations were extracted and converted to PubAnnotation JSON.
  3. uploaded. 12 abstracts met alignment failure.
  4. among the 12 failure cases, 4 had a dot('.') character where there should be colon (':'). They were manually fixed then successfully uploaded: 7903907, 8053950, 8508358, 9415639.
  5. among the 12 failed abstracts, 8 were "250 word truncation" cases. They were manually fixed and successfully uploaded. During the fixing, manual annotations were added for the missing pieces of text.
  6. 30 abstracts had extra text in the end, indicating copyright statement, e.g., "Copyright 1998 Academic Press." They were annotated as a sentence in GTB. However, the text did not exist anymore in PubMed. Therefore, the extra texts were removed, together with the sentence annotation to them.

Status Released
Maintainer Jin-Dong Kim
Author GENIA project
License Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Documents
PubMed 1,999
Annotations (18,506)
Download Not prepared yet for this project.