IEDB Analysis Resource

MHC I Automated Server Benchmarks


Accumulated overall ranking scores

Overall ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-10-03 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 62 65 67 73 83 67 63 65 62 59 55 60 50 72 69 65 66 66
SMM 47 47 35 34 50 58 61 61 56 50 48 48 52 59 69 51 48 47
ANN 83 73 78 73 78 67 65 66 65 66 69 63 60 61 63 74 64 67
ARB 33 25 20 25 53 30 31 33 28 23 37 37 18 24 44 42 35 32
SMMPMBEC 69 82 65 69 75 55 57 59 54 49 45 41 49 54
IEDB Consensus 70 69 60 59 73 63 64 67 66 61 58 50 57 23
NetMHCcons 76 76 74 72 79 75 73 77 77 76 73 72 73 85
PickPocket 50 50 45 49 57 36 32 33 36 31 25 36 29 69
mhcflurry 67 80 79 73 65 56 100

Weekly ranking scores

Overall ranking scores based on data sets submitted to the IEDB within a single week.

Server 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-10-03 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 76 57 63 13 81 83 69 100 82 59 59 52 50 100 83 100 100 66
SMM 38 86 38 50 0 25 63 - 82 57 40 51 52 23 100 67 33 47
ANN 95 50 94 88 94 63 50 - 93 61 73 65 60 46 33 17 67 67
ARB - - 0 0 100 0 0 - 82 24 21 49 18 0 0 33 33 32
SMMPMBEC 52 100 50 63 81 100 31 - 82 55 40 48 49 54
IEDB Consensus 67 71 63 75 81 50 31 - 100 60 63 56 57 23
NetMHCcons 83 64 94 38 81 83 38 100 82 75 79 68 73 85
PickPocket 50 86 6 25 94 48 81 0 68 30 33 24 29 69
mhcflurry 24 93 100 100 81 13 100