IEDB Analysis Resource

MHC II Automated Server Benchmarks


This is a live ranking of MHC II servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.

Accumulated overall ranking scores

Ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2021-11-05 2021-10-29 2021-07-23 2021-04-23 2021-04-16 2021-02-19 2021-01-22 2020-12-18 2020-10-30 2020-10-23 2020-08-07 2020-06-26 2020-05-01 2020-03-27 2020-03-16 2020-01-03 2019-07-02 2019-05-24 2019-03-22 2018-11-23 2017-12-29 2017-11-24 2017-08-18 2017-06-30 2017-04-28 2017-04-11 2016-12-31
NN-align 66 66 68 64 73 73 75 59 60 73 74 78 79 88 75 71 71 66 54 63 65 65 69 69 79 75 65
Consensus IEDB method 66 68 66 66 71 73 69 73 76 62 60 60 58 58 61 64 66 64 64 64 61 58 57 57 42 50 52
NetMHCIIpan-3.1 56 56 58 57 58 55 58 46 49 60 61 60 64 55 64 65 65 71 84 79 76 78 73 73 93 86 81
SMM-align 49 52 49 51 43 43 43 57 61 57 57 54 56 38 41 43 39 43 49 35 31 34 36 36 44 49 45
Tepitope (Sturniolo) 39 29 21 24 17 18 14 21 29 27 25 27 26 33 28 26 26 29 21 47 53 53 52 52 6 8 25
Comblib matrices 14 15 10 11 8 8 7 30 38 25 25 21 10 0 0 5 5 5 10 4 0 0 0 0 13 6 14


Weekly ranking scores

Ranking scores based on data sets submitted to the IEDB within a single week.

Server 2021-11-05 2021-10-29 2021-07-23 2021-04-23 2021-04-16 2021-02-19 2021-01-22 2020-12-18 2020-10-30 2020-10-23 2020-08-07 2020-06-26 2020-05-01 2020-03-27 2020-03-16 2020-01-03 2019-07-02 2019-05-24 2019-03-22 2018-11-23 2017-12-29 2017-11-24 2017-08-18 2017-06-30 2017-04-28 2017-04-11 2016-12-31
NN-align 56 78 100 44 75 54 84 50 69 - 38 60 77 88 100 - 100 83 53 60 67 40 - 69 - 75 65
Consensus IEDB method 70 71 63 61 25 85 68 50 88 - 38 90 62 25 50 - 75 64 57 90 83 50 - 60 - 38 52
NetMHCIIpan-3.1 - - 63 49 100 - 61 50 41 - 100 0 61 88 75 - 25 51 83 90 67 100 - 75 - 63 81
SMM-align 32 43 13 78 50 52 33 50 63 - 75 30 58 63 25 - 50 34 53 40 0 90 - 26 - 100 45
Tepitope (Sturniolo) 65 27 25 38 0 27 10 50 7 - 0 30 29 0 - - - 40 15 10 - 60 - 52 - - 25
Comblib matrices 0 20 0 12 - 13 10 - 0 - - 90 12 - 0 - 0 0 - 20 - 0 - 0 - 0 14


Download initial benchmark datasets

Click here to download the initial benchmark datasets.