============================================================================== NEDC Eval EEG (v3.3.0) File: cnn_lstm_out/summary.txt Date: Fri Apr 10 08:07:51 2020 Parameter File: /data/isip/tools/haswell/nfc/util/python/nedc_eval_eeg/params.txt Data: Ref: ../lists/cnn_lstm_ref.list Hyp: ../lists/cnn_lstm_hyp.list ============================================================================== NIST ATWV SCORING SUMMARY (F4DE_3.3.1): PER LABEL RESULTS: LABEL: SEIZ Targets: 613 <** Hits: 185 <** Misses: 428 <** False Alarms: 89 <** Insertions: 89 Deletions: 428 True Positives (TP): 185 True Negatives (TN): 1065 False Positives (FP): 89 False Negatives (FN): 428 Sensitivity (TPR, Recall): 30.1794% Specificity (TNR): 92.2877% Precision (PPV): 67.5182% Negative Pred. Value (NPV): 71.3329% Miss Rate (FNR): 69.8206% False Positive Rate (FPR): 7.7123% False Discovery Rate (FDR): 32.4818% False Omission Rate (FOR): 28.6671% Accuracy: 70.7414% Misclassification Rate: 29.2586% Prevalence: 34.6916% F1 Score (F Ratio): 0.4171 Matthews (MCC): 0.2954 False Alarm Rate: 12.7807 per 24 hours TWV: 0.1537 <** LABEL: BCKG Targets: 1597 <** Hits: 1065 <** Misses: 532 <** False Alarms: 164 <** Insertions: 164 Deletions: 532 True Positives (TP): 1065 True Negatives (TN): 185 False Positives (FP): 164 False Negatives (FN): 532 Sensitivity (TPR, Recall): 66.6875% Specificity (TNR): 53.0086% Precision (PPV): 86.6558% Negative Pred. Value (NPV): 25.8020% Miss Rate (FNR): 33.3125% False Positive Rate (FPR): 46.9914% False Discovery Rate (FDR): 13.3442% False Omission Rate (FOR): 74.1980% Accuracy: 64.2343% Misclassification Rate: 35.7657% Prevalence: 82.0658% F1 Score (F Ratio): 0.7537 Matthews (MCC): 0.1566 False Alarm Rate: 23.5509 per 24 hours TWV: 0.3936 <** SUMMARY: Total: 2210 Hits: 1250 Misses: 960 False Alarms: 253 Insertions: 253 Deletions: 960 True Positives(TP): 1250 False Positives (FP): 253 Sensitivity (TPR, Recall): 56.5611% Miss Rate (FNR): 43.4389% Accuracy: 67.3310% Misclassification Rate: 32.6690% Prevalence: 59.5206% F1 Score: 0.6733 Matthews (MCC): 0.0000 Total Duration: 601659.0000 secs Total False Alarms: 253.0000 events Total False Alarm Rate: 36.3315 per 24 hours Average TWV: 0.2737 <** ============================================================================== NEDC DP ALIGNMENT SCORING SUMMARY (V2.0.0): NEDC DP Alignment Confusion Matrix Ref/Hyp: seiz bckg seiz: 197.00 (100.00%) 0.00 ( 0.00%) bckg: 6.00 ( 0.51%) 1162.00 ( 99.49%) PER LABEL RESULTS: LABEL: SEIZ Targets: 613 Hits: 197 Misses: 416 False Alarms: 71 Insertions: 71 <** Deletions: 416 <** True Positives (TP): 197 True Negatives (TN): 1162 False Positives (FP): 71 False Negatives (FN): 416 Sensitivity (TPR, Recall): 32.1370% Specificity (TNR): 94.2417% Precision (PPV): 73.5075% Negative Pred. Value (NPV): 73.6375% Miss Rate (FNR): 67.8630% False Positive Rate (FPR): 5.7583% False Discovery Rate (FDR): 26.4925% False Omission Rate (FOR): 26.3625% Accuracy: 73.6186% Misclassification Rate: 26.3814% Prevalence: 33.2069% F1 Score (F Ratio): 0.4472 Matthews (MCC): 0.3527 False Alarm Rate: 10.1958 per 24 hours LABEL: BCKG Targets: 1597 Hits: 1162 Misses: 435 False Alarms: 67 Insertions: 67 <** Deletions: 429 <** True Positives (TP): 1162 True Negatives (TN): 197 False Positives (FP): 67 False Negatives (FN): 435 Sensitivity (TPR, Recall): 72.7614% Specificity (TNR): 74.6212% Precision (PPV): 94.5484% Negative Pred. Value (NPV): 31.1709% Miss Rate (FNR): 27.2386% False Positive Rate (FPR): 25.3788% False Discovery Rate (FDR): 5.4516% False Omission Rate (FOR): 68.8291% Accuracy: 73.0253% Misclassification Rate: 26.9747% Prevalence: 85.8141% F1 Score (F Ratio): 0.8224 Matthews (MCC): 0.3491 False Alarm Rate: 9.6214 per 24 hours SUMMARY: Total: 2210 Hits: 1359 Misses: 851 False Alarms: 138 Insertions: 138 <** Deletions: 845 <** True Positives(TP): 1359 False Positives (FP): 138 Sensitivity (TPR, Recall): 61.4932% Miss Rate (FNR): 38.5068% Accuracy: 73.3207% Misclassification Rate: 26.6793% Prevalence: 59.6169% F1 Score: 0.6673 Matthews (MCC): 0.0000 Total Duration: 601659.0000 secs Total False Alarms: 138.0000 events Total False Alarm Rate: 19.8172 per 24 hours ============================================================================== NEDC Epoch Scoring Summary (v2.0.0): NEDC Epoch Confusion Matrix Ref/Hyp: seiz bckg seiz: 16296.00 ( 7.47%) 201844.00 ( 92.53%) bckg: 3504.00 ( 0.16%) 2184992.00 ( 99.84%) PER LABEL RESULTS: LABEL: SEIZ Targets: 218140 Hits: 16296 Misses: 201844 False Alarms: 3504 Insertions: 3504 Deletions: 201844 True Positives (TP): 16296 True Negatives (TN): 2184992 False Positives (FP): 3504 False Negatives (FN): 201844 Sensitivity (TPR, Recall): 7.4704% Specificity (TNR): 99.8399% Precision (PPV): 82.3030% Negative Pred. Value (NPV): 91.5434% Miss Rate (FNR): 92.5296% False Positive Rate (FPR): 0.1601% False Discovery Rate (FDR): 17.6970% False Omission Rate (FOR): 8.4566% Accuracy: 91.4674% Misclassification Rate: 8.5326% Prevalence: 9.0641% F1 Score (F Ratio): 0.1370 Matthews (MCC): 0.2323 False Alarm Rate: 125.7962 per 24 hours LABEL: BCKG Targets: 2188496 Hits: 2184992 Misses: 3504 False Alarms: 0 Insertions: 0 Deletions: 0 True Positives (TP): 2184992 True Negatives (TN): 16296 False Positives (FP): 201844 False Negatives (FN): 3504 Sensitivity (TPR, Recall): 99.8399% Specificity (TNR): 7.4704% Precision (PPV): 91.5434% Negative Pred. Value (NPV): 82.3030% Miss Rate (FNR): 0.1601% False Positive Rate (FPR): 92.5296% False Discovery Rate (FDR): 8.4566% False Omission Rate (FOR): 17.6970% Accuracy: 91.4674% Misclassification Rate: 8.5326% Prevalence: 90.9359% F1 Score (F Ratio): 0.9551 Matthews (MCC): 0.2323 False Alarm Rate: 7246.3478 per 24 hours SUMMARY: Total: 2406636 Hits: 2201288 Misses: 205348 False Alarms: 3504 Insertions: 3504 Deletions: 201844 True Positives(TP): 2201288 False Positives (FP): 205348 Sensitivity (TPR, Recall): 91.4674% Miss Rate (FNR): 8.5326% Accuracy: 91.4674% Misclassification Rate: 8.5326% Prevalence: 50.0000% F1 Score: 0.8743 Matthews (MCC): 0.0000 Total Duration: 601659.0000 secs Total False Alarms: 205348.0000 events Total False Alarm Rate: 7372.1440 per 24 hours ============================================================================== NEDC Overlap Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 613 <** Hits: 189 <** Misses: 424 <** False Alarms: 47 <** Insertions: 47 Deletions: 424 True Positives (TP): 189 True Negatives (TN): 1577 False Positives (FP): 47 False Negatives (FN): 424 Sensitivity (TPR, Recall): 30.8320% Specificity (TNR): 97.1059% Precision (PPV): 80.0847% Negative Pred. Value (NPV): 78.8106% Miss Rate (FNR): 69.1680% False Positive Rate (FPR): 2.8941% False Discovery Rate (FDR): 19.9153% False Omission Rate (FOR): 21.1894% Accuracy: 78.9450% Misclassification Rate: 21.0550% Prevalence: 27.4028% F1 Score (F Ratio): 0.4452 Matthews (MCC): 0.4056 False Alarm Rate: 6.7493 per 24 hours LABEL: BCKG Targets: 1597 <** Hits: 1577 <** Misses: 20 <** False Alarms: 38 <** Insertions: 38 Deletions: 20 True Positives (TP): 1577 True Negatives (TN): 189 False Positives (FP): 38 False Negatives (FN): 20 Sensitivity (TPR, Recall): 98.7477% Specificity (TNR): 83.2599% Precision (PPV): 97.6471% Negative Pred. Value (NPV): 90.4306% Miss Rate (FNR): 1.2523% False Positive Rate (FPR): 16.7401% False Discovery Rate (FDR): 2.3529% False Omission Rate (FOR): 9.5694% Accuracy: 96.8202% Misclassification Rate: 3.1798% Prevalence: 87.5548% F1 Score (F Ratio): 0.9819 Matthews (MCC): 0.8499 False Alarm Rate: 5.4569 per 24 hours SUMMARY: Total: 2210 <** Hits: 1766 <** Misses: 444 <** False Alarms: 85 <** Insertions: 85 Deletions: 444 True Positives(TP): 1766 False Positives (FP): 85 Sensitivity (TPR, Recall): 79.9095% Miss Rate (FNR): 20.0905% Accuracy: 86.9737% Misclassification Rate: 13.0263% Prevalence: 54.4201% F1 Score: 0.7764 Matthews (MCC): 0.0000 Total Duration: 601659.0000 secs Total False Alarms: 85.0000 events Total False Alarm Rate: 12.2062 per 24 hours ============================================================================== NEDC TAES Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 613.00 <** Hits: 69.47 <** Misses: 543.53 <** False Alarms: 53.12 <** Insertions: 53.12 Deletions: 543.53 True Positives (TP): 69.47 True Negatives (TN): 1150.58 False Positives (FP): 53.12 False Negatives (FN): 543.53 Sensitivity (TPR, Recall): 11.3328% Specificity (TNR): 95.5873% Precision (PPV): 56.6708% Negative Pred. Value (NPV): 67.9166% Miss Rate (FNR): 88.6672% False Positive Rate (FPR): 4.4127% False Discovery Rate (FDR): 43.3292% False Omission Rate (FOR): 32.0834% Accuracy: 67.1577% Misclassification Rate: 32.8423% Prevalence: 33.7425% F1 Score (F Ratio): 0.1889 Matthews (MCC): 0.1304 False Alarm Rate: 7.6275 per 24 hours LABEL: BCKG Targets: 1597.00 <** Hits: 1150.58 <** Misses: 446.42 <** False Alarms: 277.88 <** Insertions: 277.88 Deletions: 446.42 True Positives (TP): 1150.58 True Negatives (TN): 69.47 False Positives (FP): 277.88 False Negatives (FN): 446.42 Sensitivity (TPR, Recall): 72.0466% Specificity (TNR): 20.0000% Precision (PPV): 80.5469% Negative Pred. Value (NPV): 13.4661% Miss Rate (FNR): 27.9534% False Positive Rate (FPR): 80.0000% False Discovery Rate (FDR): 19.4531% False Omission Rate (FOR): 86.5339% Accuracy: 62.7487% Misclassification Rate: 37.2513% Prevalence: 82.1354% F1 Score (F Ratio): 0.7606 Matthews (MCC): -0.0690 False Alarm Rate: 39.9044 per 24 hours SUMMARY: Total: 2210 <** Hits: 1220 <** Misses: 990 <** False Alarms: 331 <** Insertions: 331 Deletions: 990 True Positives(TP): 1220 False Positives (FP): 331 Sensitivity (TPR, Recall): 55.2061% Miss Rate (FNR): 44.7939% Accuracy: 64.8784% Misclassification Rate: 35.1216% Prevalence: 58.7602% F1 Score: 0.5692 Matthews (MCC): 0.0000 Total Duration: 601659.0000 secs Total False Alarms: 330.9953 events Total False Alarm Rate: 47.5319 per 24 hours ============================================================================== NEDC Inter-Rater Agreement Summary (v2.0.0): NEDC IRA Confusion Matrix Ref/Hyp: seiz bckg seiz: 16296.00 ( 7.47%) 201844.00 ( 92.53%) bckg: 3504.00 ( 0.16%) 2184992.00 ( 99.84%) PER LABEL RESULTS: Label: seiz Kappa: 0.1238 Label: bckg Kappa: 0.1238 SUMMARY: Multi-Class Kappa: 0.1238 ============================================================================== NEDC EEG Eval Successfully Completed on Fri Apr 10 08:08:00 2020 ==============================================================================