IEDB Analysis Resource

MHC I Automated Server Benchmarks


Accumulated overall ranking scores

Overall ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-10-03 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 2.8 46 55 67 67 73 83 67 63 65 62 59 55 60 50 72 69 65 66 66
NetMHCpan 3.0 60 69 57 - - - - - - - - - - - - - - - -
SMM 53 47 47 35 34 50 58 61 61 56 50 48 48 52 59 69 51 48 47
NetMHC 3.4 (ANN) 91 92 84 78 73 78 67 65 66 65 66 69 63 60 61 63 74 64 67
NetMHC 4.0 (ANN) 77 77 50 - - - - - - - - - - - - - - - -
ARB 0 33 25 20 25 53 30 31 33 28 23 37 37 18 24 44 42 35 32
SMMPMBEC 67 69 82 65 69 75 55 57 59 54 49 45 41 49 54 - - - -
IEDB Consensus 69 70 69 60 59 73 63 64 67 66 61 58 50 57 23 - - - -
NetMHCcons 75 76 76 74 72 79 75 73 77 77 76 73 72 73 85 - - - -
PickPocket 38 50 50 45 49 57 36 32 33 36 31 25 36 29 69 - - - -
mhcflurry 65 67 80 79 73 65 56 100 - - - - - - - - - - -

Weekly ranking scores

Overall ranking scores based on data sets submitted to the IEDB within a single week.

Server 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-10-03 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 2.8 - - - 63 13 81 83 69 100 82 59 59 52 50 100 83 100 100 66
NetMHCpan 3.0 50 76 57 - - - - - - - - - - - - - - - -
SMM - 38 86 38 50 0 25 63 - 82 57 40 51 52 23 100 67 33 47
NetMHC 3.4 (ANN) - - - 94 88 94 63 50 - 93 61 73 65 60 46 33 17 67 67
NetMHC 4.0 (ANN) - 95 50 - - - - - - - - - - - - - - - -
ARB - - - 0 0 100 0 0 - 82 24 21 49 18 0 0 33 33 32
SMMPMBEC - 52 100 50 63 81 100 31 - 82 55 40 48 49 54 - - - -
IEDB Consensus - 67 71 63 75 81 50 31 - 100 60 63 56 57 23 - - - -
NetMHCcons 75 83 64 94 38 81 83 38 100 82 75 79 68 73 85 - - - -
PickPocket 25 50 86 6 25 94 48 81 0 68 30 33 24 29 69 - - - -
mhcflurry - 24 93 100 100 81 13 100 - - - - - - - - - - -