============================================================================== NEDC Eval EEG (v3.3.0) File: hmm_sda_out/summary.txt Date: Fri Apr 10 08:06:17 2020 Parameter File: /data/isip/tools/haswell/nfc/util/python/nedc_eval_eeg/params.txt Data: Ref: ../lists/hmm_sda_ref.list Hyp: ../lists/hmm_sda_hyp.list ============================================================================== NIST ATWV SCORING SUMMARY (F4DE_3.3.1): PER LABEL RESULTS: LABEL: SEIZ Targets: 560 <** Hits: 170 <** Misses: 390 <** False Alarms: 687 <** Insertions: 687 Deletions: 390 True Positives (TP): 170 True Negatives (TN): 1092 False Positives (FP): 687 False Negatives (FN): 390 Sensitivity (TPR, Recall): 30.3571% Specificity (TNR): 61.3828% Precision (PPV): 19.8366% Negative Pred. Value (NPV): 73.6842% Miss Rate (FNR): 69.6429% False Positive Rate (FPR): 38.6172% False Discovery Rate (FDR): 80.1634% False Omission Rate (FOR): 26.3158% Accuracy: 53.9547% Misclassification Rate: 46.0453% Prevalence: 23.9419% F1 Score (F Ratio): 0.2399 Matthews (MCC): -0.0732 False Alarm Rate: 98.6514 per 24 hours TWV: -0.8392 <** LABEL: BCKG Targets: 1541 <** Hits: 1092 <** Misses: 449 <** False Alarms: 665 <** Insertions: 665 Deletions: 449 True Positives (TP): 1092 True Negatives (TN): 170 False Positives (FP): 665 False Negatives (FN): 449 Sensitivity (TPR, Recall): 70.8631% Specificity (TNR): 20.3593% Precision (PPV): 62.1514% Negative Pred. Value (NPV): 27.4637% Miss Rate (FNR): 29.1369% False Positive Rate (FPR): 79.6407% False Discovery Rate (FDR): 37.8486% False Omission Rate (FOR): 72.5363% Accuracy: 53.1145% Misclassification Rate: 46.8855% Prevalence: 64.8569% F1 Score (F Ratio): 0.6622 Matthews (MCC): -0.0955 False Alarm Rate: 95.4923 per 24 hours TWV: -0.3993 <** SUMMARY: Total: 2101 Hits: 1262 Misses: 839 False Alarms: 1352 Insertions: 1352 Deletions: 839 True Positives(TP): 1262 False Positives (FP): 1352 Sensitivity (TPR, Recall): 60.0666% Miss Rate (FNR): 39.9334% Accuracy: 53.5313% Misclassification Rate: 46.4687% Prevalence: 44.5599% F1 Score: 0.5353 Matthews (MCC): 0.0000 Total Duration: 601682.0000 secs Total False Alarms: 1352.0000 events Total False Alarm Rate: 194.1438 per 24 hours Average TWV: -0.6192 <** ============================================================================== NEDC DP ALIGNMENT SCORING SUMMARY (V2.0.0): NEDC DP Alignment Confusion Matrix Ref/Hyp: seiz bckg seiz: 247.00 (100.00%) 0.00 ( 0.00%) bckg: 10.00 ( 0.82%) 1211.00 ( 99.18%) PER LABEL RESULTS: LABEL: SEIZ Targets: 560 Hits: 247 Misses: 313 False Alarms: 600 Insertions: 600 <** Deletions: 313 <** True Positives (TP): 247 True Negatives (TN): 1211 False Positives (FP): 600 False Negatives (FN): 313 Sensitivity (TPR, Recall): 44.1071% Specificity (TNR): 66.8691% Precision (PPV): 29.1617% Negative Pred. Value (NPV): 79.4619% Miss Rate (FNR): 55.8929% False Positive Rate (FPR): 33.1309% False Discovery Rate (FDR): 70.8383% False Omission Rate (FOR): 20.5381% Accuracy: 61.4930% Misclassification Rate: 38.5070% Prevalence: 23.6187% F1 Score (F Ratio): 0.3511 Matthews (MCC): 0.0973 False Alarm Rate: 86.1585 per 24 hours LABEL: BCKG Targets: 1541 Hits: 1211 Misses: 330 False Alarms: 546 Insertions: 546 <** Deletions: 320 <** True Positives (TP): 1211 True Negatives (TN): 247 False Positives (FP): 546 False Negatives (FN): 330 Sensitivity (TPR, Recall): 78.5853% Specificity (TNR): 31.1475% Precision (PPV): 68.9243% Negative Pred. Value (NPV): 42.8076% Miss Rate (FNR): 21.4147% False Positive Rate (FPR): 68.8525% False Discovery Rate (FDR): 31.0757% False Omission Rate (FOR): 57.1924% Accuracy: 62.4679% Misclassification Rate: 37.5321% Prevalence: 66.0240% F1 Score (F Ratio): 0.7344 Matthews (MCC): 0.1069 False Alarm Rate: 78.4042 per 24 hours SUMMARY: Total: 2101 Hits: 1458 Misses: 643 False Alarms: 1146 Insertions: 1146 <** Deletions: 633 <** True Positives(TP): 1458 False Positives (FP): 1146 Sensitivity (TPR, Recall): 69.3955% Miss Rate (FNR): 30.6045% Accuracy: 61.9766% Misclassification Rate: 38.0234% Prevalence: 44.6546% F1 Score: 0.5268 Matthews (MCC): 0.0000 Total Duration: 601682.0000 secs Total False Alarms: 1146.0000 events Total False Alarm Rate: 164.5627 per 24 hours ============================================================================== NEDC Epoch Scoring Summary (v2.0.0): NEDC Epoch Confusion Matrix Ref/Hyp: seiz bckg seiz: 37820.00 ( 20.71%) 144772.00 ( 79.29%) bckg: 39500.00 ( 1.78%) 2184636.00 ( 98.22%) PER LABEL RESULTS: LABEL: SEIZ Targets: 182592 Hits: 37820 Misses: 144772 False Alarms: 39500 Insertions: 39500 Deletions: 144772 True Positives (TP): 37820 True Negatives (TN): 2184636 False Positives (FP): 39500 False Negatives (FN): 144772 Sensitivity (TPR, Recall): 20.7128% Specificity (TNR): 98.2240% Precision (PPV): 48.9136% Negative Pred. Value (NPV): 93.7850% Miss Rate (FNR): 79.2872% False Positive Rate (FPR): 1.7760% False Discovery Rate (FDR): 51.0864% False Omission Rate (FOR): 6.2150% Accuracy: 92.3435% Misclassification Rate: 7.6565% Prevalence: 7.5867% F1 Score (F Ratio): 0.2910 Matthews (MCC): 0.2844 False Alarm Rate: 1418.0248 per 24 hours LABEL: BCKG Targets: 2224136 Hits: 2184636 Misses: 39500 False Alarms: 0 Insertions: 0 Deletions: 0 True Positives (TP): 2184636 True Negatives (TN): 37820 False Positives (FP): 144772 False Negatives (FN): 39500 Sensitivity (TPR, Recall): 98.2240% Specificity (TNR): 20.7128% Precision (PPV): 93.7850% Negative Pred. Value (NPV): 48.9136% Miss Rate (FNR): 1.7760% False Positive Rate (FPR): 79.2872% False Discovery Rate (FDR): 6.2150% False Omission Rate (FOR): 51.0864% Accuracy: 92.3435% Misclassification Rate: 7.6565% Prevalence: 92.4133% F1 Score (F Ratio): 0.9595 Matthews (MCC): 0.2844 False Alarm Rate: 5197.2225 per 24 hours SUMMARY: Total: 2406728 Hits: 2222456 Misses: 184272 False Alarms: 39500 Insertions: 39500 Deletions: 144772 True Positives(TP): 2222456 False Positives (FP): 184272 Sensitivity (TPR, Recall): 92.3435% Miss Rate (FNR): 7.6565% Accuracy: 92.3435% Misclassification Rate: 7.6565% Prevalence: 50.0000% F1 Score: 0.8882 Matthews (MCC): 0.0000 Total Duration: 601682.0000 secs Total False Alarms: 184272.0000 events Total False Alarm Rate: 6615.2473 per 24 hours ============================================================================== NEDC Overlap Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 560 <** Hits: 198 <** Misses: 362 <** False Alarms: 539 <** Insertions: 539 Deletions: 362 True Positives (TP): 198 True Negatives (TN): 1484 False Positives (FP): 539 False Negatives (FN): 362 Sensitivity (TPR, Recall): 35.3571% Specificity (TNR): 73.3564% Precision (PPV): 26.8657% Negative Pred. Value (NPV): 80.3900% Miss Rate (FNR): 64.6429% False Positive Rate (FPR): 26.6436% False Discovery Rate (FDR): 73.1343% False Omission Rate (FOR): 19.6100% Accuracy: 65.1181% Misclassification Rate: 34.8819% Prevalence: 21.6802% F1 Score (F Ratio): 0.3053 Matthews (MCC): 0.0795 False Alarm Rate: 77.3990 per 24 hours LABEL: BCKG Targets: 1541 <** Hits: 1484 <** Misses: 57 <** False Alarms: 135 <** Insertions: 135 Deletions: 57 True Positives (TP): 1484 True Negatives (TN): 198 False Positives (FP): 135 False Negatives (FN): 57 Sensitivity (TPR, Recall): 96.3011% Specificity (TNR): 59.4595% Precision (PPV): 91.6615% Negative Pred. Value (NPV): 77.6471% Miss Rate (FNR): 3.6989% False Positive Rate (FPR): 40.5405% False Discovery Rate (FDR): 8.3385% False Omission Rate (FOR): 22.3529% Accuracy: 89.7545% Misclassification Rate: 10.2455% Prevalence: 82.2305% F1 Score (F Ratio): 0.9392 Matthews (MCC): 0.6217 False Alarm Rate: 19.3857 per 24 hours SUMMARY: Total: 2101 <** Hits: 1682 <** Misses: 419 <** False Alarms: 674 <** Insertions: 674 Deletions: 419 True Positives(TP): 1682 False Positives (FP): 674 Sensitivity (TPR, Recall): 80.0571% Miss Rate (FNR): 19.9429% Accuracy: 75.4768% Misclassification Rate: 24.5232% Prevalence: 47.1393% F1 Score: 0.6081 Matthews (MCC): 0.0000 Total Duration: 601682.0000 secs Total False Alarms: 674.0000 events Total False Alarm Rate: 96.7847 per 24 hours ============================================================================== NEDC TAES Scoring Summary (v2.0.0): PER LABEL RESULTS: LABEL: SEIZ Targets: 560.00 <** Hits: 96.85 <** Misses: 463.15 <** False Alarms: 572.90 <** Insertions: 572.90 Deletions: 463.15 True Positives (TP): 96.85 True Negatives (TN): 1114.36 False Positives (FP): 572.90 False Negatives (FN): 463.15 Sensitivity (TPR, Recall): 17.2955% Specificity (TNR): 66.0457% Precision (PPV): 14.4613% Negative Pred. Value (NPV): 70.6407% Miss Rate (FNR): 82.7045% False Positive Rate (FPR): 33.9543% False Discovery Rate (FDR): 85.5387% False Omission Rate (FOR): 29.3593% Accuracy: 53.8975% Misclassification Rate: 46.1025% Prevalence: 24.9193% F1 Score (F Ratio): 0.1575 Matthews (MCC): -0.1575 False Alarm Rate: 82.2665 per 24 hours LABEL: BCKG Targets: 1541.00 <** Hits: 1114.36 <** Misses: 426.64 <** False Alarms: 356.48 <** Insertions: 356.48 Deletions: 426.64 True Positives (TP): 1114.36 True Negatives (TN): 96.85 False Positives (FP): 356.48 False Negatives (FN): 426.64 Sensitivity (TPR, Recall): 72.3142% Specificity (TNR): 21.3648% Precision (PPV): 75.7634% Negative Pred. Value (NPV): 18.5016% Miss Rate (FNR): 27.6858% False Positive Rate (FPR): 78.6352% False Discovery Rate (FDR): 24.2366% False Omission Rate (FOR): 81.4984% Accuracy: 60.7328% Misclassification Rate: 39.2672% Prevalence: 77.2688% F1 Score (F Ratio): 0.7400 Matthews (MCC): -0.0602 False Alarm Rate: 51.1900 per 24 hours SUMMARY: Total: 2101 <** Hits: 1211 <** Misses: 890 <** False Alarms: 929 <** Insertions: 929 Deletions: 890 True Positives(TP): 1211 False Positives (FP): 929 Sensitivity (TPR, Recall): 57.6495% Miss Rate (FNR): 42.3505% Accuracy: 57.1114% Misclassification Rate: 42.8886% Prevalence: 49.5332% F1 Score: 0.4406 Matthews (MCC): 0.0000 Total Duration: 601682.0000 secs Total False Alarms: 929.3793 events Total False Alarm Rate: 133.4565 per 24 hours ============================================================================== NEDC Inter-Rater Agreement Summary (v2.0.0): NEDC IRA Confusion Matrix Ref/Hyp: seiz bckg seiz: 37820.00 ( 20.71%) 144772.00 ( 79.29%) bckg: 39500.00 ( 1.78%) 2184636.00 ( 98.22%) PER LABEL RESULTS: Label: seiz Kappa: 0.2575 Label: bckg Kappa: 0.2575 SUMMARY: Multi-Class Kappa: 0.2575 ============================================================================== NEDC EEG Eval Successfully Completed on Fri Apr 10 08:06:27 2020 ==============================================================================