IEDB Analysis Resource

MHC I Automated Server Benchmarks


This is a live ranking of MHC I servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.

Accumulated overall ranking scores

Ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2023-08-10 2023-08-03 2023-06-15 2023-05-11 2023-04-20 2022-11-24 2022-10-28 2022-10-06 2022-07-22 2022-05-20 2022-04-29 2021-12-24 2021-12-10 2021-11-05 2021-10-08 2021-10-01 2021-09-03 2021-08-20 2021-08-06 2021-06-11 2021-05-21 2021-04-16 2021-03-05 2021-02-19 2021-01-29 2021-01-15 2021-01-01 2020-12-25 2020-12-18 2020-12-11 2020-11-13 2020-10-02 2020-09-11 2020-07-10 2020-04-24 2020-03-13 2019-11-01 2019-10-04 2019-08-30 2019-06-21 2019-06-07 2019-05-24 2019-03-15 2019-02-01 2018-05-11 2018-01-26 2017-12-22 2017-10-27 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 4.1 BA 74 74 65 66 67 66 72 83 76 80 75 72 64 64 63 63 70 71 76 81 85 71 70 72 65 69 74 74 74 75 81 80 83 85 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCcons 70 65 64 60 57 60 56 49 61 60 69 68 57 56 49 50 52 61 71 72 71 79 74 74 76 58 57 62 53 58 71 69 70 71 68 56 63 71 83 74 67 61 62 64 73 75 78 79 80 78 73 70 61 68 66 68 69 71 67 65 64 71 56 63 64 63
ANN 3.4 66 62 73 64 63 61 50 44 48 45 47 45 46 50 53 53 51 63 69 71 66 82 79 75 85 71 66 75 58 62 62 58 56 62 60 54 54 84 76 64 65 59 61 61 73 71 75 79 81 78 82 74 65 77 67 69 65 68 64 63 59 59 58 65 46 48
NetMHCpan 4.0 BA 66 61 48 60 60 60 68 76 76 80 80 80 71 70 62 61 66 58 69 69 81 71 68 72 68 74 79 78 78 71 74 72 71 71 71 59 66 69 80 86 77 80 66 65 60 56 69 - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 65 59 41 60 57 63 69 46 54 48 65 65 63 60 48 49 50 51 64 72 81 57 58 61 50 53 50 52 48 58 65 63 63 65 64 59 66 65 70 67 57 55 55 59 65 68 71 67 66 67 63 66 67 72 55 56 53 54 50 52 51 43 65 67 61 60
NetMHCpan 3.0 65 64 58 68 65 70 73 72 74 74 73 72 68 64 58 57 56 49 64 63 72 72 70 73 72 73 72 71 66 56 57 53 54 59 67 73 78 80 73 71 65 71 54 57 57 56 68 59 62 62 64 66 81 83 70 65 63 59 56 56 60 56 58 53 59 59
SMMPMBEC 56 73 75 57 60 61 61 73 62 50 43 46 53 53 64 61 67 67 54 49 36 60 69 63 74 59 45 58 73 78 64 61 56 50 40 - - 24 25 33 32 36 45 43 48 50 56 62 65 72 91 77 76 81 54 48 46 44 37 36 35 53 59 46 40 41
mhcflurry 1.2.0 56 51 56 58 61 56 59 42 33 49 54 60 61 59 68 70 74 72 50 57 66 53 58 59 56 68 50 57 61 49 53 49 49 52 60 80 80 81 72 67 68 63 65 69 57 65 60 55 61 70 69 80 88 88 90 92 92 92 93 93 83 55 90 88 86 85
ANN 4.0 55 60 53 64 65 67 73 76 64 57 56 51 54 52 50 53 46 54 67 60 59 66 63 62 71 70 66 71 69 66 50 45 39 36 30 23 23 74 77 80 82 86 61 63 52 55 63 61 56 71 66 65 68 76 58 55 58 59 56 58 56 55 78 72 68 69
IEDB Consensus 52 58 65 71 72 69 71 69 58 60 52 54 58 57 62 59 60 63 62 54 37 55 62 59 72 61 51 63 64 71 56 51 40 39 30 0 0 52 38 43 51 52 43 48 41 44 59 60 59 62 56 36 24 55 46 48 48 47 37 39 37 48 52 48 59 58
SMM 51 54 55 56 57 56 61 58 52 54 39 43 50 49 63 62 65 68 60 48 32 45 55 51 65 55 39 50 64 74 62 59 48 42 35 8 8 28 27 37 38 39 37 36 36 36 48 54 51 49 49 36 26 51 54 58 51 50 44 43 42 53 61 50 40 40
NetMHCpan 4.0 EL 42 37 51 46 43 46 37 25 36 34 44 42 50 47 42 44 28 40 60 46 66 60 48 43 27 25 37 53 51 36 23 15 23 32 41 61 68 65 46 46 29 23 23 27 26 31 41 - - - - - - - - - - - - - - - - - - -
PickPocket 40 46 54 57 57 68 68 55 41 40 34 38 52 54 56 55 59 49 60 39 35 34 30 31 38 29 43 53 49 53 56 52 67 56 54 46 55 21 35 29 28 33 49 44 39 43 37 41 44 57 52 47 47 53 33 36 32 33 27 24 29 25 64 62 46 42
ARB 34 48 52 48 49 53 41 37 42 34 27 24 26 27 34 37 44 28 29 43 27 62 64 56 64 40 37 65 53 41 53 49 58 56 59 69 69 21 13 21 20 19 22 26 15 18 17 12 10 30 25 25 33 55 31 34 29 30 28 29 30 18 52 52 24 21
NetMHCpan 4.1 EL 32 32 56 51 48 42 36 25 26 39 50 49 57 52 44 46 39 26 38 31 41 45 45 39 32 17 37 52 56 51 45 40 41 46 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
DeepSeqPa - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Weekly ranking scores

Ranking scores based on data sets submitted to the IEDB within a single week.

Server 2023-08-10 2023-08-03 2023-06-15 2023-05-11 2023-04-20 2022-11-24 2022-10-28 2022-10-06 2022-07-22 2022-05-20 2022-04-29 2021-12-24 2021-12-10 2021-11-05 2021-10-08 2021-10-01 2021-09-03 2021-08-20 2021-08-06 2021-06-11 2021-05-21 2021-04-16 2021-03-05 2021-02-19 2021-01-29 2021-01-15 2021-01-01 2020-12-25 2020-12-18 2020-12-11 2020-11-13 2020-10-02 2020-09-11 2020-07-10 2020-04-24 2020-03-13 2019-11-01 2019-10-04 2019-08-30 2019-06-21 2019-06-07 2019-05-24 2019-03-15 2019-02-01 2018-05-11 2018-01-26 2017-12-22 2017-10-27 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-06-20 2014-05-23 2014-03-28 2014-03-21
NetMHCpan 4.1 BA 74 77 71 - 71 55 68 79 62 88 93 74 80 69 57 42 74 66 - 50 93 86 - 82 48 75 86 66 50 100 86 61 71 57 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCcons 72 66 71 - 54 62 60 21 85 38 55 67 73 75 29 49 50 51 - 64 57 93 - 69 85 57 71 - 46 54 86 29 50 71 80 - 55 56 - 100 80 82 75 50 61 66 80 75 89 74 65 88 - 95 60 41 50 89 69 70 63 71 18 82 82 63
ANN 3.4 68 57 71 - 59 86 57 57 23 27 64 44 43 46 43 59 48 58 - 50 57 100 - 58 99 82 50 82 57 57 96 64 14 79 61 - 54 - - - 84 68 68 50 64 66 64 70 92 59 85 100 - 95 46 55 - 95 64 66 62 59 32 36 36 48
NetMHCpan 4.0 BA 70 69 46 - 59 44 65 57 62 88 80 78 88 80 71 38 80 47 - 21 93 93 - 73 59 71 100 59 79 100 93 43 75 43 83 - 55 62 - 100 57 75 89 81 77 52 69 - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 66 66 62 - 29 23 79 21 85 38 48 51 76 83 36 46 55 37 - 50 93 50 - 87 30 57 79 61 7 43 86 61 43 57 69 - 63 56 - 100 61 75 54 50 52 59 77 75 74 70 60 56 - 95 60 77 50 89 46 54 52 43 64 86 82 60
NetMHCpan 3.0 63 71 63 - 39 63 76 29 85 75 86 70 89 62 79 54 68 33 - 39 57 96 - 69 68 82 93 61 68 79 86 36 61 21 61 - 47 90 - 100 54 75 82 64 75 36 89 30 73 65 65 36 - 95 72 77 100 89 54 58 56 56 91 9 82 59
SMMPMBEC 46 69 79 - 75 69 48 93 100 75 46 44 45 38 100 51 58 81 - 79 57 25 - 33 99 86 21 57 75 14 86 100 89 100 40 - - - - - 24 7 43 42 38 60 21 30 61 49 90 82 - 95 100 32 - 89 40 36 35 53 91 55 18 41
mhcflurry 1.2.0 61 44 54 - 64 52 58 100 0 71 4 55 82 56 50 46 74 94 - 14 93 43 - 64 45 79 64 - 61 25 86 79 54 0 51 - 85 75 - - 84 50 71 62 68 - 82 5 50 89 10 59 - 95 87 86 - 89 93 92 95 55 91 95 91 85
ANN 4.0 51 64 61 - 50 44 73 79 62 75 82 42 79 50 21 71 46 42 - 57 57 86 - 50 75 68 57 73 82 43 86 71 61 71 31 - 23 - - - 74 100 61 88 88 16 71 100 35 89 40 55 - 95 100 9 - 89 52 59 57 55 100 73 36 69
IEDB Consensus 50 58 53 - 71 76 69 89 31 93 54 52 59 47 93 68 52 64 - 100 57 29 - 33 85 79 43 64 57 29 100 86 50 93 36 - 0 - - - 52 21 29 67 57 16 57 70 36 61 85 73 - 9 27 36 - 100 36 44 33 48 36 36 0 58
SMM 48 55 58 - 43 58 58 79 8 95 36 47 45 27 86 61 55 77 - 96 57 25 - 26 71 89 29 61 32 11 86 100 89 86 40 - 8 - - - 28 18 36 51 34 21 30 75 39 35 85 68 - 0 9 68 - 89 49 41 42 53 64 55 18 40
NetMHCpan 4.0 EL 46 28 56 - 36 54 46 7 62 7 34 41 50 48 7 79 35 21 - 0 93 86 - 51 59 14 14 7 82 75 93 7 0 7 21 - 49 69 - 100 18 57 11 30 4 28 41 - - - - - - - - - - - - - - - - - - -
PickPocket 30 42 74 - 4 62 67 57 100 64 21 39 27 38 64 52 64 38 - 86 57 36 - 27 40 7 36 50 4 75 86 14 68 21 63 - 100 10 - 100 0 54 21 39 20 68 0 10 27 47 85 24 - 95 34 82 0 70 27 31 24 25 0 77 82 42
ARB 23 58 44 - 25 82 42 57 - 25 39 35 27 11 0 33 44 27 - 79 0 7 - 43 100 21 0 - 100 11 86 0 68 43 56 - 69 - - - 21 0 11 30 16 - 29 30 0 26 0 0 - 100 0 0 - 89 25 20 37 18 9 36 82 21
NetMHCpan 4.1 EL 36 13 50 - 75 50 46 7 23 16 43 45 71 52 14 57 54 13 - 14 100 0 - 36 80 0 7 11 54 100 86 36 7 29 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
DeepSeqPa - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

Benchmark results get recalculated as new servers are added to the benchmarks. Numbers in light grey represent scores on datasets before the server was incorporated into the benchmarks. Previous versions of the benchmark results can be downloaded below