EVA (benchmark)
EVA was a continuously running benchmark project for assessing the quality and value of protein structure prediction and secondary structure prediction methods. Methods for predicting both secondary structure and tertiary structure - including homology modeling, protein threading, and contact order prediction - were compared to results from each week's newly solved protein structures deposited in the Protein Data Bank. The project aimed to determine the prediction accuracy that would be expected for non-expert users of common, publicly available prediction webservers; this is similar to the related LiveBench project and stands in contrast to the bi-yearly benchmark CASP, which aims to identify the maximum accuracy achievable by prediction experts.
References
- Rost B, Eyrich VA. (2001). EVA: large-scale analysis of secondary structure prediction. Proteins Suppl 5:192-9. PMID 11835497
- Eyrich VA, Marti-Renom MA, Przybylski D, Madhusudhan MS, Fiser A, Pazos F, Valencia A, Sali A, Rost B. (2001). EVA: continuous automatic evaluation of protein structure prediction servers. Bioinformatics 17(12):1242-3. PMID 11751240
- Koh IY, Eyrich VA, Marti-Renom MA, Przybylski D, Madhusudhan MS, Eswar N, Grana O, Pazos F, Valencia A, Sali A, Rost B. (2003). EVA: Evaluation of protein structure prediction servers. Nucleic Acids Res 31(13):3311-5. PMID 12824315