============================================================================== NEDC Eval EEG (v3.3.0) File: hmm_lstm_out/summary.txt Date: Fri Apr 10 08:06:39 2020 Parameter File: /data/isip/tools/haswell/nfc/util/python/nedc_eval_eeg/params.txt Data: Ref: ../lists/hmm_lstm_ref.list Hyp: ../lists/hmm_lstm_hyp.list ============================================================================== NIST ATWV SCORING SUMMARY (F4DE_3.3.1): PER LABEL RESULTS: LABEL: SEIZ Targets: 752 <** Hits: 201 <** Misses: 551 <** False Alarms: 474 <** Insertions: 474 Deletions: 551 True Positives (TP): 201 True Negatives (TN): 1052 False Positives (FP): 474 False Negatives (FN): 551 Sensitivity (TPR, Recall): 26.7287% Specificity (TNR): 68.9384% Precision (PPV): 29.7778% Negative Pred. Value (NPV): 65.6269% Miss Rate (FNR): 73.2713% False Positive Rate (FPR): 31.0616% False Discovery Rate (FDR): 70.2222% False Omission Rate (FOR): 34.3731% Accuracy: 55.0044% Misclassification Rate: 44.9956% Prevalence: 33.0114% F1 Score (F Ratio): 0.2817 Matthews (MCC): -0.0446 False Alarm Rate: 75.5982 per 24 hours TWV: -0.6088 <** LABEL: BCKG Targets: 1636 <** Hits: 1052 <** Misses: 584 <** False Alarms: 472 <** Insertions: 472 Deletions: 584 True Positives (TP): 1052 True Negatives (TN): 201 False Positives (FP): 472 False Negatives (FN): 584 Sensitivity (TPR, Recall): 64.3032% Specificity (TNR): 29.8663% Precision (PPV): 69.0289% Negative Pred. Value (NPV): 25.6051% Miss Rate (FNR): 35.6968% False Positive Rate (FPR): 70.1337% False Discovery Rate (FDR): 30.9711% False Omission Rate (FOR): 74.3949% Accuracy: 54.2659% Misclassification Rate: 45.7341% Prevalence: 70.8532% F1 Score (F Ratio): 0.6658 Matthews (MCC): -0.0559 False Alarm Rate: 75.2792 per 24 hours TWV: -0.2308 <** SUMMARY: Total: 2388 Hits: 1253 Misses: 1135 False Alarms: 946 Insertions: 946 Deletions: 1135 True Positives(TP): 1253 False Positives (FP): 946 Sensitivity (TPR, Recall): 52.4707% Miss Rate (FNR): 47.5293% Accuracy: 54.6327% Misclassification Rate: 45.3673% Prevalence: 52.0602% F1 Score: 0.5463 Matthews (MCC): 0.0000 Total Duration: 541727.0000 secs Total False Alarms: 946.0000 events Total False Alarm Rate: 150.8775 per 24 hours Average TWV: -0.4198 <** ============================================================================== NEDC DP ALIGNMENT SCORING SUMMARY (V2.0.0): NEDC DP Alignment Confusion Matrix Ref/Hyp: seiz bckg seiz: 254.00 (100.00%) 0.00 ( 0.00%) bckg: 1.00 ( 0.09%) 1135.00 ( 99.91%) PER LABEL RESULTS: LABEL: SEIZ Targets: 752 Hits: 254 Misses: 498 False Alarms: 420 Insertions: 420 <** Deletions: 498 <** True Positives (TP): 254 True Negatives (TN): 1135 False Positives (FP): 420 False Negatives (FN): 498 Sensitivity (TPR, Recall): 33.7766% Specificity (TNR): 72.9904% Precision (PPV): 37.6855% Negative Pred. Value (NPV): 69.5040% Miss Rate (FNR): 66.2234% False Positive Rate (FPR): 27.0096% False Discovery Rate (FDR): 62.3145% False Omission Rate (FOR): 30.4960% Accuracy: 60.2081% Misclassification Rate: 39.7919% Prevalence: 32.5964% F1 Score (F Ratio): 0.3562 Matthews (MCC): 0.0697 False Alarm Rate: 66.9858 per 24 hours LABEL: BCKG Targets: 1636 Hits: 1135 Misses: 501 False Alarms: 389 Insertions: 389 <** Deletions: 500 <** True Positives (TP): 1135 True Negatives (TN): 254 False Positives (FP): 389 False Negatives (FN): 501 Sensitivity (TPR, Recall): 69.3765% Specificity (TNR): 39.5023% Precision (PPV): 74.4751% Negative Pred. Value (NPV): 33.6424% Miss Rate (FNR): 30.6235% False Positive Rate (FPR): 60.4977% False Discovery Rate (FDR): 25.5249% False Omission Rate (FOR): 66.3576% Accuracy: 60.9478% Misclassification Rate: 39.0522% Prevalence: 71.7859% F1 Score (F Ratio): 0.7184 Matthews (MCC): 0.0849 False Alarm Rate: 62.0416 per 24 hours SUMMARY: Total: 2388 Hits: 1389 Misses: 999 False Alarms: 809 Insertions: 809 <** Deletions: 998 <** True Positives(TP): 1389 False Positives (FP): 809 Sensitivity (TPR, Recall): 58.1658% Miss Rate (FNR): 41.8342% Accuracy: 60.5757% Misclassification Rate: 39.4243% Prevalence: 52.0715% F1 Score: 0.5110 Matthews (MCC): 0.0000 Total Duration: 541727.0000 secs Total False Alarms: 809.0000 events Total False Alarm Rate: 129.0274 per 24 hours ============================================================================== NEDC Epoch Scoring Summary (v2.0.0): NEDC Epoch Confusion Matrix Ref/Hyp: seiz bckg seiz: 83060.00 ( 50.47%) 81520.00 ( 49.53%) bckg: 103664.00 ( 5.18%) 1898664.00 ( 94.82%) PER LABEL RESULTS: LABEL: SEIZ Targets: 164580 Hits: 83060 Misses: 81520 False Alarms: 103664 Insertions: 103664 Deletions: 81520 True Positives (TP): 83060 True Negatives (TN): 1898664 False Positives (FP): 103664 False Negatives (FN): 81520 Sensitivity (TPR, Recall): 50.4679% Specificity (TNR): 94.8228% Precision (PPV): 44.4828% Negative Pred. Value (NPV): 95.8832% Miss Rate (FNR): 49.5321% False Positive Rate (FPR): 5.1772% False Discovery Rate (FDR): 55.5172% False Omission Rate (FOR): 4.1168% Accuracy: 91.4540% Misclassification Rate: 8.5460% Prevalence: 7.5952% F1 Score (F Ratio): 0.4729 Matthews (MCC): 0.4276 False Alarm Rate: 4133.3410 per 24 hours LABEL: BCKG Targets: 2002328 Hits: 1898664 Misses: 103664 False Alarms: 0 Insertions: 0 Deletions: 0 True Positives (TP): 1898664 True Negatives (TN): 83060 False Positives (FP): 81520 False Negatives (FN): 103664 Sensitivity (TPR, Recall): 94.8228% Specificity (TNR): 50.4679% Precision (PPV): 95.8832% Negative Pred. Value (NPV): 44.4828% Miss Rate (FNR): 5.1772% False Positive Rate (FPR): 49.5321% False Discovery Rate (FDR): 4.1168% False Omission Rate (FOR): 55.5172% Accuracy: 91.4540% Misclassification Rate: 8.5460% Prevalence: 92.4048% F1 Score (F Ratio): 0.9535 Matthews (MCC): 0.4276 False Alarm Rate: 3250.4047 per 24 hours SUMMARY: Total: 2166908 Hits: 1981724 Misses: 185184 False Alarms: 103664 Insertions: 103664 Deletions: 81520 True Positives(TP): 1981724 False Positives (FP): 185184 Sensitivity (TPR, Recall): 91.4540% Miss Rate (FNR): 8.5460% Accuracy: 91.4540% Misclassification Rate: 8.5460% Prevalence: 50.0000% F1 Score: 0.8771 Matthews (MCC): 0.0000 Total Duration: 541727.0000 secs Total False Alarms: 185184.0000 events Total False Alarm Rate: 7383.7457 per 24 hours ============================================================================== NEDC Overlap Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 752 <** Hits: 226 <** Misses: 526 <** False Alarms: 382 <** Insertions: 382 Deletions: 526 True Positives (TP): 226 True Negatives (TN): 1580 False Positives (FP): 382 False Negatives (FN): 526 Sensitivity (TPR, Recall): 30.0532% Specificity (TNR): 80.5301% Precision (PPV): 37.1711% Negative Pred. Value (NPV): 75.0237% Miss Rate (FNR): 69.9468% False Positive Rate (FPR): 19.4699% False Discovery Rate (FDR): 62.8289% False Omission Rate (FOR): 24.9763% Accuracy: 66.5438% Misclassification Rate: 33.4562% Prevalence: 27.7082% F1 Score (F Ratio): 0.3324 Matthews (MCC): 0.1136 False Alarm Rate: 60.9252 per 24 hours LABEL: BCKG Targets: 1636 <** Hits: 1580 <** Misses: 56 <** False Alarms: 89 <** Insertions: 89 Deletions: 56 True Positives (TP): 1580 True Negatives (TN): 226 False Positives (FP): 89 False Negatives (FN): 56 Sensitivity (TPR, Recall): 96.5770% Specificity (TNR): 71.7460% Precision (PPV): 94.6675% Negative Pred. Value (NPV): 80.1418% Miss Rate (FNR): 3.4230% False Positive Rate (FPR): 28.2540% False Discovery Rate (FDR): 5.3325% False Omission Rate (FOR): 19.8582% Accuracy: 92.5679% Misclassification Rate: 7.4321% Prevalence: 83.8544% F1 Score (F Ratio): 0.9561 Matthews (MCC): 0.7149 False Alarm Rate: 14.1946 per 24 hours SUMMARY: Total: 2388 <** Hits: 1806 <** Misses: 582 <** False Alarms: 471 <** Insertions: 471 Deletions: 582 True Positives(TP): 1806 False Positives (FP): 471 Sensitivity (TPR, Recall): 75.6281% Miss Rate (FNR): 24.3719% Accuracy: 77.4277% Misclassification Rate: 22.5723% Prevalence: 51.1897% F1 Score: 0.6273 Matthews (MCC): 0.0000 Total Duration: 541727.0000 secs Total False Alarms: 471.0000 events Total False Alarm Rate: 75.1198 per 24 hours ============================================================================== NEDC TAES Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 752.00 <** Hits: 171.77 <** Misses: 580.23 <** False Alarms: 428.34 <** Insertions: 428.34 Deletions: 580.23 True Positives (TP): 171.77 True Negatives (TN): 1019.51 False Positives (FP): 428.34 False Negatives (FN): 580.23 Sensitivity (TPR, Recall): 22.8421% Specificity (TNR): 70.4153% Precision (PPV): 28.6233% Negative Pred. Value (NPV): 63.7297% Miss Rate (FNR): 77.1579% False Positive Rate (FPR): 29.5847% False Discovery Rate (FDR): 71.3767% False Omission Rate (FOR): 36.2703% Accuracy: 54.1528% Misclassification Rate: 45.8472% Prevalence: 34.1842% F1 Score (F Ratio): 0.2541 Matthews (MCC): -0.0718 False Alarm Rate: 68.3161 per 24 hours LABEL: BCKG Targets: 1636.00 <** Hits: 1019.51 <** Misses: 616.49 <** False Alarms: 299.59 <** Insertions: 299.59 Deletions: 616.49 True Positives (TP): 1019.51 True Negatives (TN): 171.77 False Positives (FP): 299.59 False Negatives (FN): 616.49 Sensitivity (TPR, Recall): 62.3170% Specificity (TNR): 36.4416% Precision (PPV): 77.2882% Negative Pred. Value (NPV): 21.7912% Miss Rate (FNR): 37.6830% False Positive Rate (FPR): 63.5584% False Discovery Rate (FDR): 22.7118% False Omission Rate (FOR): 78.2088% Accuracy: 56.5294% Misclassification Rate: 43.4706% Prevalence: 77.6326% F1 Score (F Ratio): 0.6900 Matthews (MCC): -0.0107 False Alarm Rate: 47.7817 per 24 hours SUMMARY: Total: 2388 <** Hits: 1191 <** Misses: 1197 <** False Alarms: 728 <** Insertions: 728 Deletions: 1197 True Positives(TP): 1191 False Positives (FP): 728 Sensitivity (TPR, Recall): 49.8860% Miss Rate (FNR): 50.1140% Accuracy: 55.3156% Misclassification Rate: 44.6844% Prevalence: 55.4419% F1 Score: 0.4436 Matthews (MCC): 0.0000 Total Duration: 541727.0000 secs Total False Alarms: 727.9314 events Total False Alarm Rate: 116.0977 per 24 hours ============================================================================== NEDC Inter-Rater Agreement Summary (v2.0.0): NEDC IRA Confusion Matrix Ref/Hyp: seiz bckg seiz: 83060.00 ( 50.47%) 81520.00 ( 49.53%) bckg: 103664.00 ( 5.18%) 1898664.00 ( 94.82%) PER LABEL RESULTS: Label: seiz Kappa: 0.4266 Label: bckg Kappa: 0.4266 SUMMARY: Multi-Class Kappa: 0.4266 ============================================================================== NEDC EEG Eval Successfully Completed on Fri Apr 10 08:06:48 2020 ==============================================================================