PubMed:26549429 JSONTXT

{"project":"NCBITAXON","denotations":[{"id":"T1","span":{"begin":1011,"end":1021},"obj":"OrganismTaxon"}],"attributes":[{"id":"A1","pred":"db_id","subj":"T1","obj":"NCBItxid:1768868"}],"text":"Testing and Validation of Computational Methods for Mass Spectrometry.\nHigh-throughput methods based on mass spectrometry (proteomics, metabolomics, lipidomics, etc.) produce a wealth of data that cannot be analyzed without computational methods. The impact of the choice of method on the overall result of a biological study is often underappreciated, but different methods can result in very different biological findings. It is thus essential to evaluate and compare the correctness and relative performance of computational methods. The volume of the data as well as the complexity of the algorithms render unbiased comparisons challenging. This paper discusses some problems and challenges in testing and validation of computational methods. We discuss the different types of data (simulated and experimental validation data) as well as different metrics to compare methods. We also introduce a new public repository for mass spectrometric reference data sets ( http://compms.org/RefData ) that contains a collection of publicly available data sets for performance evaluation for a wide range of different methods."}

{"project":"sentences","denotations":[{"id":"TextSentencer_T1","span":{"begin":0,"end":70},"obj":"Sentence"},{"id":"TextSentencer_T2","span":{"begin":71,"end":246},"obj":"Sentence"},{"id":"TextSentencer_T3","span":{"begin":247,"end":424},"obj":"Sentence"},{"id":"TextSentencer_T4","span":{"begin":425,"end":536},"obj":"Sentence"},{"id":"TextSentencer_T5","span":{"begin":537,"end":644},"obj":"Sentence"},{"id":"TextSentencer_T6","span":{"begin":645,"end":746},"obj":"Sentence"},{"id":"TextSentencer_T7","span":{"begin":747,"end":879},"obj":"Sentence"},{"id":"TextSentencer_T8","span":{"begin":880,"end":1119},"obj":"Sentence"},{"id":"T1","span":{"begin":0,"end":70},"obj":"Sentence"},{"id":"T2","span":{"begin":71,"end":246},"obj":"Sentence"},{"id":"T3","span":{"begin":247,"end":424},"obj":"Sentence"},{"id":"T4","span":{"begin":425,"end":536},"obj":"Sentence"},{"id":"T5","span":{"begin":537,"end":644},"obj":"Sentence"},{"id":"T6","span":{"begin":645,"end":746},"obj":"Sentence"},{"id":"T7","span":{"begin":747,"end":879},"obj":"Sentence"},{"id":"T8","span":{"begin":880,"end":1119},"obj":"Sentence"}],"namespaces":[{"prefix":"_base","uri":"http://pubannotation.org/ontology/tao.owl#"}],"text":"Testing and Validation of Computational Methods for Mass Spectrometry.\nHigh-throughput methods based on mass spectrometry (proteomics, metabolomics, lipidomics, etc.) produce a wealth of data that cannot be analyzed without computational methods. The impact of the choice of method on the overall result of a biological study is often underappreciated, but different methods can result in very different biological findings. It is thus essential to evaluate and compare the correctness and relative performance of computational methods. The volume of the data as well as the complexity of the algorithms render unbiased comparisons challenging. This paper discusses some problems and challenges in testing and validation of computational methods. We discuss the different types of data (simulated and experimental validation data) as well as different metrics to compare methods. We also introduce a new public repository for mass spectrometric reference data sets ( http://compms.org/RefData ) that contains a collection of publicly available data sets for performance evaluation for a wide range of different methods."}

{"project":"pubmed-enju-pas","denotations":[{"id":"EnjuParser_T0","span":{"begin":0,"end":7},"obj":"NN"},{"id":"EnjuParser_T1","span":{"begin":8,"end":11},"obj":"CC"},{"id":"EnjuParser_T2","span":{"begin":12,"end":22},"obj":"NN"},{"id":"EnjuParser_T3","span":{"begin":23,"end":25},"obj":"IN"},{"id":"EnjuParser_T4","span":{"begin":26,"end":39},"obj":"NNP"},{"id":"EnjuParser_T5","span":{"begin":40,"end":47},"obj":"NNP"},{"id":"EnjuParser_T6","span":{"begin":48,"end":51},"obj":"IN"},{"id":"EnjuParser_T7","span":{"begin":52,"end":56},"obj":"NNP"},{"id":"EnjuParser_T8","span":{"begin":57,"end":69},"obj":"NNP"},{"id":"EnjuParser_T9","span":{"begin":71,"end":86},"obj":"JJ"},{"id":"EnjuParser_T10","span":{"begin":87,"end":94},"obj":"NNS"},{"id":"EnjuParser_T11","span":{"begin":95,"end":100},"obj":"VBN"},{"id":"EnjuParser_T12","span":{"begin":101,"end":103},"obj":"IN"},{"id":"EnjuParser_T13","span":{"begin":104,"end":108},"obj":"NN"},{"id":"EnjuParser_T14","span":{"begin":109,"end":121},"obj":"NN"},{"id":"EnjuParser_T15","span":{"begin":122,"end":123},"obj":"-LRB-"},{"id":"EnjuParser_T16","span":{"begin":123,"end":133},"obj":"NNS"},{"id":"EnjuParser_T17","span":{"begin":133,"end":134},"obj":"-COMMA-"},{"id":"EnjuParser_T18","span":{"begin":135,"end":147},"obj":"NNS"},{"id":"EnjuParser_T19","span":{"begin":147,"end":148},"obj":"-COMMA-"},{"id":"EnjuParser_T20","span":{"begin":149,"end":159},"obj":"NNS"},{"id":"EnjuParser_T21","span":{"begin":159,"end":160},"obj":"-COMMA-"},{"id":"EnjuParser_T22","span":{"begin":161,"end":165},"obj":"FW"},{"id":"EnjuParser_T23","span":{"begin":165,"end":166},"obj":"-RRB-"},{"id":"EnjuParser_T24","span":{"begin":167,"end":174},"obj":"VBP"},{"id":"EnjuParser_T25","span":{"begin":175,"end":176},"obj":"DT"},{"id":"EnjuParser_T26","span":{"begin":177,"end":183},"obj":"NN"},{"id":"EnjuParser_T27","span":{"begin":184,"end":186},"obj":"IN"},{"id":"EnjuParser_T28","span":{"begin":187,"end":191},"obj":"NNS"},{"id":"EnjuParser_T29","span":{"begin":192,"end":196},"obj":"WDT"},{"id":"EnjuParser_T30","span":{"begin":197,"end":200},"obj":"MD"},{"id":"EnjuParser_T31","span":{"begin":200,"end":203},"obj":"RB"},{"id":"EnjuParser_T32","span":{"begin":204,"end":206},"obj":"VB"},{"id":"EnjuParser_T33","span":{"begin":207,"end":215},"obj":"VBN"},{"id":"EnjuParser_T34","span":{"begin":216,"end":223},"obj":"IN"},{"id":"EnjuParser_T35","span":{"begin":224,"end":237},"obj":"JJ"},{"id":"EnjuParser_T36","span":{"begin":238,"end":245},"obj":"NNS"},{"id":"EnjuParser_T37","span":{"begin":247,"end":250},"obj":"DT"},{"id":"EnjuParser_T38","span":{"begin":251,"end":257},"obj":"NN"},{"id":"EnjuParser_T39","span":{"begin":258,"end":260},"obj":"IN"},{"id":"EnjuParser_T40","span":{"begin":261,"end":264},"obj":"DT"},{"id":"EnjuParser_T41","span":{"begin":265,"end":271},"obj":"NN"},{"id":"EnjuParser_T42","span":{"begin":272,"end":274},"obj":"IN"},{"id":"EnjuParser_T43","span":{"begin":275,"end":281},"obj":"NN"},{"id":"EnjuParser_T44","span":{"begin":282,"end":284},"obj":"IN"},{"id":"EnjuParser_T45","span":{"begin":285,"end":288},"obj":"DT"},{"id":"EnjuParser_T46","span":{"begin":289,"end":296},"obj":"JJ"},{"id":"EnjuParser_T47","span":{"begin":297,"end":303},"obj":"NN"},{"id":"EnjuParser_T48","span":{"begin":304,"end":306},"obj":"IN"},{"id":"EnjuParser_T49","span":{"begin":307,"end":308},"obj":"DT"},{"id":"EnjuParser_T50","span":{"begin":309,"end":319},"obj":"JJ"},{"id":"EnjuParser_T51","span":{"begin":320,"end":325},"obj":"NN"},{"id":"EnjuParser_T52","span":{"begin":326,"end":328},"obj":"VBZ"},{"id":"EnjuParser_T53","span":{"begin":329,"end":334},"obj":"RB"},{"id":"EnjuParser_T54","span":{"begin":335,"end":351},"obj":"VBN"},{"id":"EnjuParser_T55","span":{"begin":351,"end":352},"obj":"-COMMA-"},{"id":"EnjuParser_T56","span":{"begin":353,"end":356},"obj":"CC"},{"id":"EnjuParser_T57","span":{"begin":357,"end":366},"obj":"JJ"},{"id":"EnjuParser_T58","span":{"begin":367,"end":374},"obj":"NNS"},{"id":"EnjuParser_T59","span":{"begin":375,"end":378},"obj":"MD"},{"id":"EnjuParser_T60","span":{"begin":379,"end":385},"obj":"VB"},{"id":"EnjuParser_T61","span":{"begin":386,"end":388},"obj":"IN"},{"id":"EnjuParser_T62","span":{"begin":389,"end":393},"obj":"RB"},{"id":"EnjuParser_T63","span":{"begin":394,"end":403},"obj":"JJ"},{"id":"EnjuParser_T64","span":{"begin":404,"end":414},"obj":"JJ"},{"id":"EnjuParser_T65","span":{"begin":415,"end":423},"obj":"NNS"},{"id":"EnjuParser_T66","span":{"begin":425,"end":427},"obj":"PRP"},{"id":"EnjuParser_T67","span":{"begin":428,"end":430},"obj":"VBZ"},{"id":"EnjuParser_T68","span":{"begin":431,"end":435},"obj":"RB"},{"id":"EnjuParser_T69","span":{"begin":436,"end":445},"obj":"JJ"},{"id":"EnjuParser_T70","span":{"begin":446,"end":448},"obj":"TO"},{"id":"EnjuParser_T71","span":{"begin":449,"end":457},"obj":"VB"},{"id":"EnjuParser_T72","span":{"begin":458,"end":461},"obj":"CC"},{"id":"EnjuParser_T73","span":{"begin":462,"end":469},"obj":"VB"},{"id":"EnjuParser_T74","span":{"begin":470,"end":473},"obj":"DT"},{"id":"EnjuParser_T75","span":{"begin":474,"end":485},"obj":"NN"},{"id":"EnjuParser_T76","span":{"begin":486,"end":489},"obj":"CC"},{"id":"EnjuParser_T77","span":{"begin":490,"end":498},"obj":"JJ"},{"id":"EnjuParser_T78","span":{"begin":499,"end":510},"obj":"NN"},{"id":"EnjuParser_T79","span":{"begin":511,"end":513},"obj":"IN"},{"id":"EnjuParser_T80","span":{"begin":514,"end":527},"obj":"JJ"},{"id":"EnjuParser_T81","span":{"begin":528,"end":535},"obj":"NNS"},{"id":"EnjuParser_T82","span":{"begin":537,"end":540},"obj":"DT"},{"id":"EnjuParser_T83","span":{"begin":541,"end":547},"obj":"NN"},{"id":"EnjuParser_T84","span":{"begin":548,"end":550},"obj":"IN"},{"id":"EnjuParser_T85","span":{"begin":551,"end":554},"obj":"DT"},{"id":"EnjuParser_T86","span":{"begin":555,"end":559},"obj":"NNS"},{"id":"EnjuParser_T87","span":{"begin":560,"end":562},"obj":"RB"},{"id":"EnjuParser_T88","span":{"begin":563,"end":567},"obj":"RB"},{"id":"EnjuParser_T89","span":{"begin":568,"end":570},"obj":"IN"},{"id":"EnjuParser_T90","span":{"begin":571,"end":574},"obj":"DT"},{"id":"EnjuParser_T91","span":{"begin":575,"end":585},"obj":"NN"},{"id":"EnjuParser_T92","span":{"begin":586,"end":588},"obj":"IN"},{"id":"EnjuParser_T93","span":{"begin":589,"end":592},"obj":"DT"},{"id":"EnjuParser_T94","span":{"begin":593,"end":603},"obj":"NNS"},{"id":"EnjuParser_T95","span":{"begin":604,"end":610},"obj":"VBP"},{"id":"EnjuParser_T96","span":{"begin":611,"end":619},"obj":"JJ"},{"id":"EnjuParser_T97","span":{"begin":620,"end":631},"obj":"NNS"},{"id":"EnjuParser_T98","span":{"begin":632,"end":643},"obj":"NN"},{"id":"EnjuParser_T99","span":{"begin":645,"end":649},"obj":"DT"},{"id":"EnjuParser_T100","span":{"begin":650,"end":655},"obj":"NN"},{"id":"EnjuParser_T101","span":{"begin":656,"end":665},"obj":"VBZ"},{"id":"EnjuParser_T102","span":{"begin":666,"end":670},"obj":"DT"},{"id":"EnjuParser_T103","span":{"begin":671,"end":679},"obj":"NNS"},{"id":"EnjuParser_T104","span":{"begin":680,"end":683},"obj":"CC"},{"id":"EnjuParser_T105","span":{"begin":684,"end":694},"obj":"NNS"},{"id":"EnjuParser_T106","span":{"begin":695,"end":697},"obj":"IN"},{"id":"EnjuParser_T107","span":{"begin":698,"end":705},"obj":"NN"},{"id":"EnjuParser_T108","span":{"begin":706,"end":709},"obj":"CC"},{"id":"EnjuParser_T109","span":{"begin":710,"end":720},"obj":"NN"},{"id":"EnjuParser_T110","span":{"begin":721,"end":723},"obj":"IN"},{"id":"EnjuParser_T111","span":{"begin":724,"end":737},"obj":"JJ"},{"id":"EnjuParser_T112","span":{"begin":738,"end":745},"obj":"NNS"},{"id":"EnjuParser_T113","span":{"begin":747,"end":749},"obj":"PRP"},{"id":"EnjuParser_T114","span":{"begin":750,"end":757},"obj":"VBP"},{"id":"EnjuParser_T115","span":{"begin":758,"end":761},"obj":"DT"},{"id":"EnjuParser_T116","span":{"begin":762,"end":771},"obj":"JJ"},{"id":"EnjuParser_T117","span":{"begin":772,"end":777},"obj":"NNS"},{"id":"EnjuParser_T118","span":{"begin":778,"end":780},"obj":"IN"},{"id":"EnjuParser_T119","span":{"begin":781,"end":785},"obj":"NNS"},{"id":"EnjuParser_T120","span":{"begin":786,"end":787},"obj":"-LRB-"},{"id":"EnjuParser_T121","span":{"begin":787,"end":796},"obj":"JJ"},{"id":"EnjuParser_T122","span":{"begin":797,"end":800},"obj":"CC"},{"id":"EnjuParser_T123","span":{"begin":801,"end":813},"obj":"JJ"},{"id":"EnjuParser_T124","span":{"begin":814,"end":824},"obj":"NN"},{"id":"EnjuParser_T125","span":{"begin":825,"end":829},"obj":"NNS"},{"id":"EnjuParser_T126","span":{"begin":829,"end":830},"obj":"-RRB-"},{"id":"EnjuParser_T127","span":{"begin":831,"end":833},"obj":"RB"},{"id":"EnjuParser_T128","span":{"begin":834,"end":838},"obj":"RB"},{"id":"EnjuParser_T129","span":{"begin":839,"end":841},"obj":"IN"},{"id":"EnjuParser_T130","span":{"begin":842,"end":851},"obj":"JJ"},{"id":"EnjuParser_T131","span":{"begin":852,"end":859},"obj":"NNS"},{"id":"EnjuParser_T132","span":{"begin":860,"end":862},"obj":"TO"},{"id":"EnjuParser_T133","span":{"begin":863,"end":870},"obj":"VB"},{"id":"EnjuParser_T134","span":{"begin":871,"end":878},"obj":"NNS"},{"id":"EnjuParser_T135","span":{"begin":880,"end":882},"obj":"PRP"},{"id":"EnjuParser_T136","span":{"begin":883,"end":887},"obj":"RB"},{"id":"EnjuParser_T137","span":{"begin":888,"end":897},"obj":"VBP"},{"id":"EnjuParser_T138","span":{"begin":898,"end":899},"obj":"DT"},{"id":"EnjuParser_T139","span":{"begin":900,"end":903},"obj":"JJ"},{"id":"EnjuParser_T140","span":{"begin":904,"end":910},"obj":"JJ"},{"id":"EnjuParser_T141","span":{"begin":911,"end":921},"obj":"NN"},{"id":"EnjuParser_T142","span":{"begin":922,"end":925},"obj":"IN"},{"id":"EnjuParser_T143","span":{"begin":926,"end":930},"obj":"NN"},{"id":"EnjuParser_T144","span":{"begin":931,"end":944},"obj":"JJ"},{"id":"EnjuParser_T145","span":{"begin":945,"end":954},"obj":"NN"},{"id":"EnjuParser_T146","span":{"begin":955,"end":959},"obj":"NNS"},{"id":"EnjuParser_T147","span":{"begin":960,"end":964},"obj":"NNS"},{"id":"EnjuParser_T148","span":{"begin":965,"end":966},"obj":"-LRB-"},{"id":"EnjuParser_T149","span":{"begin":967,"end":971},"obj":"NN"},{"id":"EnjuParser_T150","span":{"begin":971,"end":972},"obj":"-COLON-"},{"id":"EnjuParser_T151","span":{"begin":972,"end":992},"obj":"NNP"},{"id":"EnjuParser_T152","span":{"begin":993,"end":994},"obj":"-RRB-"},{"id":"EnjuParser_T153","span":{"begin":995,"end":999},"obj":"WDT"},{"id":"EnjuParser_T154","span":{"begin":1000,"end":1008},"obj":"VBZ"},{"id":"EnjuParser_T155","span":{"begin":1009,"end":1010},"obj":"DT"},{"id":"EnjuParser_T156","span":{"begin":1011,"end":1021},"obj":"NN"},{"id":"EnjuParser_T157","span":{"begin":1022,"end":1024},"obj":"IN"},{"id":"EnjuParser_T158","span":{"begin":1025,"end":1033},"obj":"RB"},{"id":"EnjuParser_T159","span":{"begin":1034,"end":1043},"obj":"JJ"},{"id":"EnjuParser_T160","span":{"begin":1044,"end":1048},"obj":"NNS"},{"id":"EnjuParser_T161","span":{"begin":1049,"end":1053},"obj":"NNS"},{"id":"EnjuParser_T162","span":{"begin":1054,"end":1057},"obj":"IN"},{"id":"EnjuParser_T163","span":{"begin":1058,"end":1069},"obj":"NN"},{"id":"EnjuParser_T164","span":{"begin":1070,"end":1080},"obj":"NN"},{"id":"EnjuParser_T165","span":{"begin":1081,"end":1084},"obj":"IN"},{"id":"EnjuParser_T166","span":{"begin":1085,"end":1086},"obj":"DT"},{"id":"EnjuParser_T167","span":{"begin":1087,"end":1091},"obj":"JJ"},{"id":"EnjuParser_T168","span":{"begin":1092,"end":1097},"obj":"NN"},{"id":"EnjuParser_T169","span":{"begin":1098,"end":1100},"obj":"IN"},{"id":"EnjuParser_T170","span":{"begin":1101,"end":1110},"obj":"JJ"},{"id":"EnjuParser_T171","span":{"begin":1111,"end":1118},"obj":"NNS"}],"relations":[{"id":"EnjuParser_R0","pred":"arg1Of","subj":"EnjuParser_T0","obj":"EnjuParser_T1"},{"id":"EnjuParser_R1","pred":"arg2Of","subj":"EnjuParser_T2","obj":"EnjuParser_T1"},{"id":"EnjuParser_R2","pred":"arg1Of","subj":"EnjuParser_T1","obj":"EnjuParser_T3"},{"id":"EnjuParser_R3","pred":"arg2Of","subj":"EnjuParser_T5","obj":"EnjuParser_T3"},{"id":"EnjuParser_R4","pred":"arg1Of","subj":"EnjuParser_T5","obj":"EnjuParser_T4"},{"id":"EnjuParser_R5","pred":"arg1Of","subj":"EnjuParser_T1","obj":"EnjuParser_T6"},{"id":"EnjuParser_R6","pred":"arg2Of","subj":"EnjuParser_T8","obj":"EnjuParser_T6"},{"id":"EnjuParser_R7","pred":"arg1Of","subj":"EnjuParser_T8","obj":"EnjuParser_T7"},{"id":"EnjuParser_R8","pred":"arg1Of","subj":"EnjuParser_T10","obj":"EnjuParser_T9"},{"id":"EnjuParser_R9","pred":"arg1Of","subj":"EnjuParser_T10","obj":"EnjuParser_T11"},{"id":"EnjuParser_R10","pred":"arg2Of","subj":"EnjuParser_T12","obj":"EnjuParser_T11"},{"id":"EnjuParser_R11","pred":"arg2Of","subj":"EnjuParser_T14","obj":"EnjuParser_T12"},{"id":"EnjuParser_R12","pred":"arg1Of","subj":"EnjuParser_T14","obj":"EnjuParser_T13"},{"id":"EnjuParser_R13","pred":"arg1Of","subj":"EnjuParser_T10","obj":"EnjuParser_T15"},{"id":"EnjuParser_R14","pred":"arg2Of","subj":"EnjuParser_T19","obj":"EnjuParser_T15"},{"id":"EnjuParser_R15","pred":"arg3Of","subj":"EnjuParser_T23","obj":"EnjuParser_T15"},{"id":"EnjuParser_R16","pred":"arg1Of","subj":"EnjuParser_T16","obj":"EnjuParser_T17"},{"id":"EnjuParser_R17","pred":"arg2Of","subj":"EnjuParser_T18","obj":"EnjuParser_T17"},{"id":"EnjuParser_R18","pred":"arg1Of","subj":"EnjuParser_T17","obj":"EnjuParser_T19"},{"id":"EnjuParser_R19","pred":"arg2Of","subj":"EnjuParser_T20","obj":"EnjuParser_T19"},{"id":"EnjuParser_R20","pred":"arg1Of","subj":"EnjuParser_T19","obj":"EnjuParser_T21"},{"id":"EnjuParser_R21","pred":"arg1Of","subj":"EnjuParser_T19","obj":"EnjuParser_T22"},{"id":"EnjuParser_R22","pred":"arg1Of","subj":"EnjuParser_T10","obj":"EnjuParser_T24"},{"id":"EnjuParser_R23","pred":"arg2Of","subj":"EnjuParser_T26","obj":"EnjuParser_T24"},{"id":"EnjuParser_R24","pred":"arg1Of","subj":"EnjuParser_T26","obj":"EnjuParser_T25"},{"id":"EnjuParser_R25","pred":"arg1Of","subj":"EnjuParser_T26","obj":"EnjuParser_T27"},{"id":"EnjuParser_R26","pred":"arg2Of","subj":"EnjuParser_T28","obj":"EnjuParser_T27"},{"id":"EnjuParser_R27","pred":"arg1Of","subj":"EnjuParser_T28","obj":"EnjuParser_T29"},{"id":"EnjuParser_R28","pred":"arg1Of","subj":"EnjuParser_T28","obj":"EnjuParser_T30"},{"id":"EnjuParser_R29","pred":"arg2Of","subj":"EnjuParser_T33","obj":"EnjuParser_T30"},{"id":"EnjuParser_R30","pred":"arg1Of","subj":"EnjuParser_T33","obj":"EnjuParser_T31"},{"id":"EnjuParser_R31","pred":"arg1Of","subj":"EnjuParser_T28","obj":"EnjuParser_T32"},{"id":"EnjuParser_R32","pred":"arg2Of","subj":"EnjuParser_T33","obj":"EnjuParser_T32"},{"id":"EnjuParser_R33","pred":"arg2Of","subj":"EnjuParser_T28","obj":"EnjuParser_T33"},{"id":"EnjuParser_R34","pred":"arg1Of","subj":"EnjuParser_T33","obj":"EnjuParser_T34"},{"id":"EnjuParser_R35","pred":"arg2Of","subj":"EnjuParser_T36","obj":"EnjuParser_T34"},{"id":"EnjuParser_R36","pred":"arg1Of","subj":"EnjuParser_T36","obj":"EnjuParser_T35"},{"id":"EnjuParser_R37","pred":"arg1Of","subj":"EnjuParser_T38","obj":"EnjuParser_T37"},{"id":"EnjuParser_R38","pred":"arg1Of","subj":"EnjuParser_T38","obj":"EnjuParser_T39"},{"id":"EnjuParser_R39","pred":"arg2Of","subj":"EnjuParser_T41","obj":"EnjuParser_T39"},{"id":"EnjuParser_R40","pred":"arg1Of","subj":"EnjuParser_T41","obj":"EnjuParser_T40"},{"id":"EnjuParser_R41","pred":"arg1Of","subj":"EnjuParser_T41","obj":"EnjuParser_T42"},{"id":"EnjuParser_R42","pred":"arg2Of","subj":"EnjuParser_T43","obj":"EnjuParser_T42"},{"id":"EnjuParser_R43","pred":"arg1Of","subj":"EnjuParser_T41","obj":"EnjuParser_T44"},{"id":"EnjuParser_R44","pred":"arg2Of","subj":"EnjuParser_T47","obj":"EnjuParser_T44"},{"id":"EnjuParser_R45","pred":"arg1Of","subj":"EnjuParser_T47","obj":"EnjuParser_T45"},{"id":"EnjuParser_R46","pred":"arg1Of","subj":"EnjuParser_T47","obj":"EnjuParser_T46"},{"id":"EnjuParser_R47","pred":"arg1Of","subj":"EnjuParser_T47","obj":"EnjuParser_T48"},{"id":"EnjuParser_R48","pred":"arg2Of","subj":"EnjuParser_T51","obj":"EnjuParser_T48"},{"id":"EnjuParser_R49","pred":"arg1Of","subj":"EnjuParser_T51","obj":"EnjuParser_T49"},{"id":"EnjuParser_R50","pred":"arg1Of","subj":"EnjuParser_T51","obj":"EnjuParser_T50"},{"id":"EnjuParser_R51","pred":"arg1Of","subj":"EnjuParser_T38","obj":"EnjuParser_T52"},{"id":"EnjuParser_R52","pred":"arg2Of","subj":"EnjuParser_T54","obj":"EnjuParser_T52"},{"id":"EnjuParser_R53","pred":"arg1Of","subj":"EnjuParser_T54","obj":"EnjuParser_T53"},{"id":"EnjuParser_R54","pred":"arg2Of","subj":"EnjuParser_T38","obj":"EnjuParser_T54"},{"id":"EnjuParser_R55","pred":"arg1Of","subj":"EnjuParser_T56","obj":"EnjuParser_T55"},{"id":"EnjuParser_R56","pred":"arg1Of","subj":"EnjuParser_T54","obj":"EnjuParser_T56"},{"id":"EnjuParser_R57","pred":"arg2Of","subj":"EnjuParser_T60","obj":"EnjuParser_T56"},{"id":"EnjuParser_R58","pred":"arg1Of","subj":"EnjuParser_T58","obj":"EnjuParser_T57"},{"id":"EnjuParser_R59","pred":"arg1Of","subj":"EnjuParser_T58","obj":"EnjuParser_T59"},{"id":"EnjuParser_R60","pred":"arg2Of","subj":"EnjuParser_T60","obj":"EnjuParser_T59"},{"id":"EnjuParser_R61","pred":"arg1Of","subj":"EnjuParser_T58","obj":"EnjuParser_T60"},{"id":"EnjuParser_R62","pred":"arg1Of","subj":"EnjuParser_T60","obj":"EnjuParser_T61"},{"id":"EnjuParser_R63","pred":"arg2Of","subj":"EnjuParser_T65","obj":"EnjuParser_T61"},{"id":"EnjuParser_R64","pred":"arg1Of","subj":"EnjuParser_T63","obj":"EnjuParser_T62"},{"id":"EnjuParser_R65","pred":"arg1Of","subj":"EnjuParser_T65","obj":"EnjuParser_T63"},{"id":"EnjuParser_R66","pred":"arg1Of","subj":"EnjuParser_T65","obj":"EnjuParser_T64"},{"id":"EnjuParser_R67","pred":"arg1Of","subj":"EnjuParser_T72","obj":"EnjuParser_T66"},{"id":"EnjuParser_R68","pred":"arg1Of","subj":"EnjuParser_T72","obj":"EnjuParser_T67"},{"id":"EnjuParser_R69","pred":"arg2Of","subj":"EnjuParser_T69","obj":"EnjuParser_T67"},{"id":"EnjuParser_R70","pred":"arg1Of","subj":"EnjuParser_T69","obj":"EnjuParser_T68"},{"id":"EnjuParser_R71","pred":"arg1Of","subj":"EnjuParser_T72","obj":"EnjuParser_T69"},{"id":"EnjuParser_R72","pred":"arg1Of","subj":"EnjuParser_T72","obj":"EnjuParser_T70"},{"id":"EnjuParser_R73","pred":"arg2Of","subj":"EnjuParser_T76","obj":"EnjuParser_T71"},{"id":"EnjuParser_R74","pred":"arg1Of","subj":"EnjuParser_T71","obj":"EnjuParser_T72"},{"id":"EnjuParser_R75","pred":"arg2Of","subj":"EnjuParser_T73","obj":"EnjuParser_T72"},{"id":"EnjuParser_R76","pred":"arg2Of","subj":"EnjuParser_T76","obj":"EnjuParser_T73"},{"id":"EnjuParser_R77","pred":"arg1Of","subj":"EnjuParser_T76","obj":"EnjuParser_T74"},{"id":"EnjuParser_R78","pred":"arg1Of","subj":"EnjuParser_T75","obj":"EnjuParser_T76"},{"id":"EnjuParser_R79","pred":"arg2Of","subj":"EnjuParser_T78","obj":"EnjuParser_T76"},{"id":"EnjuParser_R80","pred":"arg1Of","subj":"EnjuParser_T78","obj":"EnjuParser_T77"},{"id":"EnjuParser_R81","pred":"arg1Of","subj":"EnjuParser_T76","obj":"EnjuParser_T79"},{"id":"EnjuParser_R82","pred":"arg2Of","subj":"EnjuParser_T81","obj":"EnjuParser_T79"},{"id":"EnjuParser_R83","pred":"arg1Of","subj":"EnjuParser_T81","obj":"EnjuParser_T80"},{"id":"EnjuParser_R84","pred":"arg1Of","subj":"EnjuParser_T83","obj":"EnjuParser_T82"},{"id":"EnjuParser_R85","pred":"arg1Of","subj":"EnjuParser_T83","obj":"EnjuParser_T84"},{"id":"EnjuParser_R86","pred":"arg2Of","subj":"EnjuParser_T86","obj":"EnjuParser_T84"},{"id":"EnjuParser_R87","pred":"arg1Of","subj":"EnjuParser_T86","obj":"EnjuParser_T85"},{"id":"EnjuParser_R88","pred":"arg1Of","subj":"EnjuParser_T89","obj":"EnjuParser_T87"},{"id":"EnjuParser_R89","pred":"arg1Of","subj":"EnjuParser_T89","obj":"EnjuParser_T88"},{"id":"EnjuParser_R90","pred":"arg1Of","subj":"EnjuParser_T83","obj":"EnjuParser_T89"},{"id":"EnjuParser_R91","pred":"arg2Of","subj":"EnjuParser_T91","obj":"EnjuParser_T89"},{"id":"EnjuParser_R92","pred":"arg1Of","subj":"EnjuParser_T91","obj":"EnjuParser_T90"},{"id":"EnjuParser_R93","pred":"arg1Of","subj":"EnjuParser_T91","obj":"EnjuParser_T92"},{"id":"EnjuParser_R94","pred":"arg2Of","subj":"EnjuParser_T94","obj":"EnjuParser_T92"},{"id":"EnjuParser_R95","pred":"arg1Of","subj":"EnjuParser_T94","obj":"EnjuParser_T93"},{"id":"EnjuParser_R96","pred":"arg1Of","subj":"EnjuParser_T89","obj":"EnjuParser_T95"},{"id":"EnjuParser_R97","pred":"arg2Of","subj":"EnjuParser_T98","obj":"EnjuParser_T95"},{"id":"EnjuParser_R98","pred":"arg1Of","subj":"EnjuParser_T98","obj":"EnjuParser_T96"},{"id":"EnjuParser_R99","pred":"arg1Of","subj":"EnjuParser_T98","obj":"EnjuParser_T97"},{"id":"EnjuParser_R100","pred":"arg1Of","subj":"EnjuParser_T100","obj":"EnjuParser_T99"},{"id":"EnjuParser_R101","pred":"arg1Of","subj":"EnjuParser_T100","obj":"EnjuParser_T101"},{"id":"EnjuParser_R102","pred":"arg2Of","subj":"EnjuParser_T104","obj":"EnjuParser_T101"},{"id":"EnjuParser_R103","pred":"arg1Of","subj":"EnjuParser_T104","obj":"EnjuParser_T102"},{"id":"EnjuParser_R104","pred":"arg1Of","subj":"EnjuParser_T103","obj":"EnjuParser_T104"},{"id":"EnjuParser_R105","pred":"arg2Of","subj":"EnjuParser_T105","obj":"EnjuParser_T104"},{"id":"EnjuParser_R106","pred":"arg1Of","subj":"EnjuParser_T104","obj":"EnjuParser_T106"},{"id":"EnjuParser_R107","pred":"arg2Of","subj":"EnjuParser_T108","obj":"EnjuParser_T106"},{"id":"EnjuParser_R108","pred":"arg1Of","subj":"EnjuParser_T107","obj":"EnjuParser_T108"},{"id":"EnjuParser_R109","pred":"arg2Of","subj":"EnjuParser_T109","obj":"EnjuParser_T108"},{"id":"EnjuParser_R110","pred":"arg1Of","subj":"EnjuParser_T108","obj":"EnjuParser_T110"},{"id":"EnjuParser_R111","pred":"arg2Of","subj":"EnjuParser_T112","obj":"EnjuParser_T110"},{"id":"EnjuParser_R112","pred":"arg1Of","subj":"EnjuParser_T112","obj":"EnjuParser_T111"},{"id":"EnjuParser_R113","pred":"arg1Of","subj":"EnjuParser_T113","obj":"EnjuParser_T114"},{"id":"EnjuParser_R114","pred":"arg2Of","subj":"EnjuParser_T129","obj":"EnjuParser_T114"},{"id":"EnjuParser_R115","pred":"arg1Of","subj":"EnjuParser_T129","obj":"EnjuParser_T115"},{"id":"EnjuParser_R116","pred":"arg1Of","subj":"EnjuParser_T117","obj":"EnjuParser_T116"},{"id":"EnjuParser_R117","pred":"arg1Of","subj":"EnjuParser_T117","obj":"EnjuParser_T118"},{"id":"EnjuParser_R118","pred":"arg2Of","subj":"EnjuParser_T119","obj":"EnjuParser_T118"},{"id":"EnjuParser_R119","pred":"arg1Of","subj":"EnjuParser_T117","obj":"EnjuParser_T120"},{"id":"EnjuParser_R120","pred":"arg2Of","subj":"EnjuParser_T125","obj":"EnjuParser_T120"},{"id":"EnjuParser_R121","pred":"arg3Of","subj":"EnjuParser_T126","obj":"EnjuParser_T120"},{"id":"EnjuParser_R122","pred":"arg1Of","subj":"EnjuParser_T125","obj":"EnjuParser_T121"},{"id":"EnjuParser_R123","pred":"arg1Of","subj":"EnjuParser_T121","obj":"EnjuParser_T122"},{"id":"EnjuParser_R124","pred":"arg2Of","subj":"EnjuParser_T123","obj":"EnjuParser_T122"},{"id":"EnjuParser_R125","pred":"arg1Of","subj":"EnjuParser_T125","obj":"EnjuParser_T123"},{"id":"EnjuParser_R126","pred":"arg1Of","subj":"EnjuParser_T125","obj":"EnjuParser_T124"},{"id":"EnjuParser_R127","pred":"arg1Of","subj":"EnjuParser_T129","obj":"EnjuParser_T127"},{"id":"EnjuParser_R128","pred":"arg1Of","subj":"EnjuParser_T129","obj":"EnjuParser_T128"},{"id":"EnjuParser_R129","pred":"arg1Of","subj":"EnjuParser_T117","obj":"EnjuParser_T129"},{"id":"EnjuParser_R130","pred":"arg2Of","subj":"EnjuParser_T131","obj":"EnjuParser_T129"},{"id":"EnjuParser_R131","pred":"arg1Of","subj":"EnjuParser_T131","obj":"EnjuParser_T130"},{"id":"EnjuParser_R132","pred":"arg1Of","subj":"EnjuParser_T133","obj":"EnjuParser_T132"},{"id":"EnjuParser_R133","pred":"modOf","subj":"EnjuParser_T114","obj":"EnjuParser_T132"},{"id":"EnjuParser_R134","pred":"arg1Of","subj":"EnjuParser_T113","obj":"EnjuParser_T133"},{"id":"EnjuParser_R135","pred":"arg2Of","subj":"EnjuParser_T134","obj":"EnjuParser_T133"},{"id":"EnjuParser_R136","pred":"arg1Of","subj":"EnjuParser_T137","obj":"EnjuParser_T136"},{"id":"EnjuParser_R137","pred":"arg1Of","subj":"EnjuParser_T135","obj":"EnjuParser_T137"},{"id":"EnjuParser_R138","pred":"arg2Of","subj":"EnjuParser_T141","obj":"EnjuParser_T137"},{"id":"EnjuParser_R139","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T138"},{"id":"EnjuParser_R140","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T139"},{"id":"EnjuParser_R141","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T140"},{"id":"EnjuParser_R142","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T142"},{"id":"EnjuParser_R143","pred":"arg2Of","subj":"EnjuParser_T147","obj":"EnjuParser_T142"},{"id":"EnjuParser_R144","pred":"arg1Of","subj":"EnjuParser_T147","obj":"EnjuParser_T143"},{"id":"EnjuParser_R145","pred":"arg1Of","subj":"EnjuParser_T147","obj":"EnjuParser_T144"},{"id":"EnjuParser_R146","pred":"arg1Of","subj":"EnjuParser_T147","obj":"EnjuParser_T145"},{"id":"EnjuParser_R147","pred":"arg1Of","subj":"EnjuParser_T147","obj":"EnjuParser_T146"},{"id":"EnjuParser_R148","pred":"arg1Of","subj":"EnjuParser_T147","obj":"EnjuParser_T148"},{"id":"EnjuParser_R149","pred":"arg2Of","subj":"EnjuParser_T149","obj":"EnjuParser_T148"},{"id":"EnjuParser_R150","pred":"arg3Of","subj":"EnjuParser_T152","obj":"EnjuParser_T148"},{"id":"EnjuParser_R151","pred":"arg1Of","subj":"EnjuParser_T149","obj":"EnjuParser_T150"},{"id":"EnjuParser_R152","pred":"arg2Of","subj":"EnjuParser_T151","obj":"EnjuParser_T150"},{"id":"EnjuParser_R153","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T153"},{"id":"EnjuParser_R154","pred":"arg1Of","subj":"EnjuParser_T141","obj":"EnjuParser_T154"},{"id":"EnjuParser_R155","pred":"arg2Of","subj":"EnjuParser_T156","obj":"EnjuParser_T154"},{"id":"EnjuParser_R156","pred":"arg1Of","subj":"EnjuParser_T156","obj":"EnjuParser_T155"},{"id":"EnjuParser_R157","pred":"arg1Of","subj":"EnjuParser_T156","obj":"EnjuParser_T157"},{"id":"EnjuParser_R158","pred":"arg2Of","subj":"EnjuParser_T161","obj":"EnjuParser_T157"},{"id":"EnjuParser_R159","pred":"arg1Of","subj":"EnjuParser_T159","obj":"EnjuParser_T158"},{"id":"EnjuParser_R160","pred":"arg1Of","subj":"EnjuParser_T161","obj":"EnjuParser_T159"},{"id":"EnjuParser_R161","pred":"arg1Of","subj":"EnjuParser_T161","obj":"EnjuParser_T160"},{"id":"EnjuParser_R162","pred":"arg1Of","subj":"EnjuParser_T156","obj":"EnjuParser_T162"},{"id":"EnjuParser_R163","pred":"arg2Of","subj":"EnjuParser_T164","obj":"EnjuParser_T162"},{"id":"EnjuParser_R164","pred":"arg1Of","subj":"EnjuParser_T164","obj":"EnjuParser_T163"},{"id":"EnjuParser_R165","pred":"arg1Of","subj":"EnjuParser_T164","obj":"EnjuParser_T165"},{"id":"EnjuParser_R166","pred":"arg2Of","subj":"EnjuParser_T168","obj":"EnjuParser_T165"},{"id":"EnjuParser_R167","pred":"arg1Of","subj":"EnjuParser_T168","obj":"EnjuParser_T166"},{"id":"EnjuParser_R168","pred":"arg1Of","subj":"EnjuParser_T168","obj":"EnjuParser_T167"},{"id":"EnjuParser_R169","pred":"arg1Of","subj":"EnjuParser_T168","obj":"EnjuParser_T169"},{"id":"EnjuParser_R170","pred":"arg2Of","subj":"EnjuParser_T171","obj":"EnjuParser_T169"},{"id":"EnjuParser_R171","pred":"arg1Of","subj":"EnjuParser_T171","obj":"EnjuParser_T170"}],"namespaces":[{"prefix":"_base","uri":"http://kmcs.nii.ac.jp/enju/"}],"text":"Testing and Validation of Computational Methods for Mass Spectrometry.\nHigh-throughput methods based on mass spectrometry (proteomics, metabolomics, lipidomics, etc.) produce a wealth of data that cannot be analyzed without computational methods. The impact of the choice of method on the overall result of a biological study is often underappreciated, but different methods can result in very different biological findings. It is thus essential to evaluate and compare the correctness and relative performance of computational methods. The volume of the data as well as the complexity of the algorithms render unbiased comparisons challenging. This paper discusses some problems and challenges in testing and validation of computational methods. We discuss the different types of data (simulated and experimental validation data) as well as different metrics to compare methods. We also introduce a new public repository for mass spectrometric reference data sets ( http://compms.org/RefData ) that contains a collection of publicly available data sets for performance evaluation for a wide range of different methods."}