PMC:4289553 / 13274-15171 JSONTXT

{"target":"http://pubannotation.org/docs/sourcedb/PMC/sourceid/4289553","sourcedb":"PMC","sourceid":"4289553","source_url":"https://www.ncbi.nlm.nih.gov/pmc/4289553","text":"For the TBI artificial cohort, with a development set consisting of 8655 subjects and 1930 events (event rate 22.3%), the CART models performed poorly, irrespective of the reference model (Table 3). The models generated with the same modelling technique as the reference model showed the best performance, except when the reference model was generated with CART, in which case the LR model had the best performance (AUC 0.712, Table 3). All models, except the CART model, showed the lowest AUC when the reference model CART was used (Table 3).The NN model needed the largest number of events per variable to reach AUCmax. For each of the reference models, the LR model showed the most rapid increase to a stable AUC (Figure 5).Again, we calculated the relative performance of a model by setting the performance of the model resulting from the modelling technique that generated the reference model at 100%. Figure 6 shows the relative performance of the models for each reference model.For all models, optimism decreased with an increasing number of events per variable. The LR model needed 18–23 events per variable to reach an optimism \u003c0.01, whereas the optimism of the RF model remained high, except for the reference model RF, in which case optimism was \u003c0.01 at 163 events per variable (Figure 7).\nTable 3 AUCmax per reference model, TBI cohort\nReference model\nLR CART SVM NN RF\nLR 0.806 0.712 0.743 0.762 0.817\nCART 0.710 0.702 0.676 0.652 0.684\nSVM 0.754 0.677 0.765 .0765 0.838\nNN 0.800 0.701 0.746 0.802 0.828\nRF 0.744 0.685 0.750 0.776 0.988\nBold numbers are for model performance when the underlying model was specified according to the modelling technique considered.\nFigure 5 Validated AUC-values vs. number of events per variable, TBI cohort.\nFigure 6 Relative validated AUC-values vs. events per variable, TBI cohort.\nFigure 7 Optimism vs. events per variable, TBI cohort.","divisions":[{"label":"table-wrap","span":{"begin":1304,"end":1686}},{"label":"label","span":{"begin":1304,"end":1311}},{"label":"caption","span":{"begin":1312,"end":1351}},{"label":"p","span":{"begin":1312,"end":1351}},{"label":"table","span":{"begin":1352,"end":1558}},{"label":"tr","span":{"begin":1352,"end":1367}},{"label":"th","span":{"begin":1352,"end":1367}},{"label":"tr","span":{"begin":1368,"end":1385}},{"label":"th","span":{"begin":1368,"end":1370}},{"label":"th","span":{"begin":1371,"end":1375}},{"label":"th","span":{"begin":1376,"end":1379}},{"label":"th","span":{"begin":1380,"end":1382}},{"label":"th","span":{"begin":1383,"end":1385}},{"label":"tr","span":{"begin":1386,"end":1419}},{"label":"td","span":{"begin":1386,"end":1388}},{"label":"td","span":{"begin":1389,"end":1395}},{"label":"td","span":{"begin":1396,"end":1401}},{"label":"td","span":{"begin":1402,"end":1407}},{"label":"td","span":{"begin":1408,"end":1413}},{"label":"td","span":{"begin":1414,"end":1419}},{"label":"tr","span":{"begin":1420,"end":1455}},{"label":"td","span":{"begin":1420,"end":1424}},{"label":"td","span":{"begin":1425,"end":1430}},{"label":"td","span":{"begin":1431,"end":1437}},{"label":"td","span":{"begin":1438,"end":1443}},{"label":"td","span":{"begin":1444,"end":1449}},{"label":"td","span":{"begin":1450,"end":1455}},{"label":"tr","span":{"begin":1456,"end":1490}},{"label":"td","span":{"begin":1456,"end":1459}},{"label":"td","span":{"begin":1460,"end":1465}},{"label":"td","span":{"begin":1466,"end":1471}},{"label":"td","span":{"begin":1472,"end":1478}},{"label":"td","span":{"begin":1479,"end":1484}},{"label":"td","span":{"begin":1485,"end":1490}},{"label":"tr","span":{"begin":1491,"end":1524}},{"label":"td","span":{"begin":1491,"end":1493}},{"label":"td","span":{"begin":1494,"end":1499}},{"label":"td","span":{"begin":1500,"end":1505}},{"label":"td","span":{"begin":1506,"end":1511}},{"label":"td","span":{"begin":1512,"end":1518}},{"label":"td","span":{"begin":1519,"end":1524}},{"label":"tr","span":{"begin":1525,"end":1558}},{"label":"td","span":{"begin":1525,"end":1527}},{"label":"td","span":{"begin":1528,"end":1533}},{"label":"td","span":{"begin":1534,"end":1539}},{"label":"td","span":{"begin":1540,"end":1545}},{"label":"td","span":{"begin":1546,"end":1551}},{"label":"td","span":{"begin":1552,"end":1558}},{"label":"table-wrap-foot","span":{"begin":1559,"end":1686}},{"label":"p","span":{"begin":1559,"end":1686}},{"label":"figure","span":{"begin":1687,"end":1764}},{"label":"label","span":{"begin":1687,"end":1695}},{"label":"caption","span":{"begin":1696,"end":1764}},{"label":"p","span":{"begin":1696,"end":1764}},{"label":"figure","span":{"begin":1765,"end":1841}},{"label":"label","span":{"begin":1765,"end":1773}},{"label":"caption","span":{"begin":1774,"end":1841}},{"label":"p","span":{"begin":1774,"end":1841}},{"label":"label","span":{"begin":1842,"end":1850}}],"tracks":[]}