The groundbreaking demonstration, part of the biennial Critical Assessment of Structure Prediction (CASP) competition, used UW professor David Baker's Rosetta Code and ran on more than 40.000 central processing units (CPUs) of IBM's Blue Gene Watson Supercomputer, using the experience gained on the Blue Gene Data system installed at SDSC.
When David Baker, who also serves as a principal investigator for Howard Hughes Medical Institute, originally developed the code, it had to be run in serial - broken into manageable amounts of data, with each portion calculated in series, one after another.
Through a research collaboration, SDSC's expertise and supercomputing resources helped modify the Rosetta code to run in parallel on SDSC's massive supercomputers, dramatically speeding processing, and providing a testing ground for running the code on the world's fastest non-classified computer.
During the CASP competition, the results of trillions of calculations a second were fed across the TeraGrid network - part of a national collaborative Grid computing facility - from SDSC to Professor Baker and his team, giving them far more computing power than had ever been available in previous CASP simulations.
The Strategic Applications Collaboration (SAC) staff at SDSC initiated the work with David Baker and the codes, introducing them to NSF supercomputing resources, and helped his team scale their codes to run on supercomputers.
Ross Walker, a SAC computational scientist, managed the Baker group's access to SDSC machines during the competition, helping them optimize the code for the SDSC computers. He also provided customized resource allocation at SDSC - key to running the time-sensitive calculations as quickly as possible.
"The Blue Gene system is ideal for running protein structure prediction", stated Ross Walker, "as the process involves predicting many, many structures, optimizing them, and then scoring them, with the ultimate aim that the best scoring structure - the lowest energy - is the native structure. The more predictions we can do in a given time, the better."
CASP calculations are essentially competitions among scientists to predict protein structures and are, therefore, "very time-sensitive", stated Ross Walker. "Previously, with only limited computer power, the Baker team had to skimp both on the amount of computing they did, and on the amount of analysis they did."
Access to SDSC's supercomputing facilities was vital to the Baker group, as it allowed them both to increase the complexity of their calculations and to gain time for analysis before submitting their prediction.
"The post-production data analysis is as important as generating the models themselves", stated Vatsan Raman of Baker's team. "Similarly, the experience gained on the SDSC machines was invaluable when it came to running the code on over 40.000 processors. Being able to run on the full machine at IBM was a real breakthrough for the Rosetta team, allowing us to run more complex calculations than we had attempted before, in a fraction of the time."
The team was able to generate about 120.000 structure predictions, greatly enhancing the probability of locating the lowest energy conformation, and immediately analyse those predictions, submitting the best structure as their CASP prediction.
Most noteworthy, Ross Walker stated, is that "all this was done within a day, with the calculation taking less than three hours. Run in serial, or on small clusters, as has been done heretofore, the process took many, many weeks."