ECE 8527: Final Exam - Results of the Final Exam Data Challenge (Set 14)


The data set for this challenge can be found here. Note that there are five classes (background plus sets 1-4). The scoring metric consisted of:

      P = average[TPR for C1-C4] - average[FPR for C1-C4]

A summary of the results in spreadsheet form can be found here. Assuming you solve the segmentation problem, random guessing results in an accuracy of 25% (forced choice on the four non-background classes).

Participant Algorithm Train Dev Eval
2023 SPRING
Arthur, Joe (2023 Spring) TBD 00.00% 00.00% 00.00%
Arthur, Joe (2023 Spring) TBD 00.00% 00.00% 00.00%
Babaei, Mahdi (2023 Spring) RNF-LSTM 58.61% 66.10% 53.46%
Babaei, Mahdi (2023 Spring) MLP-LSTM 42.97% 42.07% 41.21%
Bannan, John (2023 Spring) RNF 00.00% 00.00% 00.00%
Bannan, John (2023 Spring) SVM 00.00% 00.00% 00.00%
Bannan, John (2023 Spring) LSTM 00.00% 00.00% 00.00%
Bose, Anyway (2023 Spring) RNF 00.00% 00.00% 00.00%
Bose, Anyway (2023 Spring) CNN 00.00% 00.00% 00.00%
Brodovsky, James (2023 Spring) Random Forest (RNF) 77.21% 76.97% 77.34%
Das, Arpita (2023 Spring) K-MEANS (KMN) 28.96% 29.03% 38.94%
Das, Arpita (2023 Spring) Autoencoder (AUT) 27.97% 27.74% 36.74%
Koma, Gavin (2023 Spring) TBD 00.00% 00.00% 00.00%
Koma, Gavin (2023 Spring) TBD 00.00% 00.00% 00.00%
Su, Shelley (2023 Spring) KNN 28.44% 27.41% 29.69%
Su, Shelley (2023 Spring) RNF 52.42% 52.07% 52.28%
2022 SPRING
Kane, Zach (2022 Spring) K-MEANS (KMN) 30.98% 30.34% 38.94%
Kane, Zach (2022 Spring) Autoencoder (AUT) 29.86% 29.47% 32.45%
Samarco, Michael (2022 Spring) ConvNet (CNN) 60.66% 60.07% 60.61%
Samarco, Michael (2022 Spring) Random Forest (RNF) 0.00% 0.00% 0.00%
Bici, Daniel (2022 Spring) N/A 0.00% 0.00% 0.00%
Bici, Daniel (2022 Spring) N/A 0.00% 0.00% 0.00%
Cassell, Joshua (2022 Spring) N/A 0.00% 0.00% 0.00%
Cassell, Joshua (2022 Spring) N/A 0.00% 0.00% 0.00%
Khantan, Mehdi (2022 Spring) N/A 0.00% 0.00% 0.00%
Khantan, Mehdi (2022 Spring) N/A 0.00% 0.00% 0.00%
Rahman, Nazia (2022 Spring) N/A 0.00% 0.00% 0.00%
Rahman, Nazia (2022 Spring) N/A 0.00% 0.00% 0.00%
Sand, Richard (2022 Spring) N/A 0.00% 0.00% 0.00%
Sand, Richard (2022 Spring) N/A 0.00% 0.00% 0.00%
Vadimsky, Dakota (2022 Spring) N/A 0.00% 0.00% 0.00%
Vadimsky, Dakota (2022 Spring) N/A 0.00% 0.00% 0.00%
Zhao, Keren (2022 Spring) N/A 0.00% 0.00% 0.00%
Zhao, Keren (2022 Spring) N/A 0.00% 0.00% 0.00%