EVALUATING PERFORMANCE OPTIMIZATIONS OF LARGE-SCALE GENOMIC SEQUENCE SEARCH APPLICATIONS USING SST/MACRO

Tae-Hyuk Ahn, Damian Dechev, Heshan Lin, Helgi Adalsteinsson, Curtis Janssen

2011

Abstract

The next decade will see a rapid evolution of HPC node architectures as power and cooling constraints are limiting increases in microprocessor clock speeds and constraining data movement. Future and current HPC applications will have to change and adapt as node architectures evolve. The application of advanced cycle accurate node architecture simulators will play a crucial role for the design and optimization of future data intensive applications. In this paper, we present our simulation-based framework for analyzing the scalability and performance of a number of critical optimizations of a massively parallel genomic search application, mpiBLAST, using an advanced macroscale simulator (SST/macro). In this paper we report the use of our framework for the evaluation of three potential improvements of mpiBLAST: enabling high-performance parallel output, an approach for caching database fragments in memory, and a methodology for pre-distributing database segments. In our experimental setup, we performed query sequence matching on the genome of the yellow fever mosquito, Aedes aegypti.

References

  1. Adve, V., Bagrodia, R., Deelman, E., and Sakellariou, R. (2002). Compiler-optimized simulation of large-scale applications on high performance architectures. Journal of Parallel and Distributed Computing, 62(3):393-426.
  2. Altschul, S., Gish, W., Miller, W., Myers, E., and Lipman, D. (1990). Basic local alignment search tool. Journal of Molecular Biology, 215:403-410.
  3. Altschul, S., Madden, T., Schäffer, A., Zhang, J., Zhang, Z., Miller, W., and Lipman, D. (1997). Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Research, 25(17):3389-3402.
  4. Bjornson, R., Sherman, A., Weston, S., Willard, N., and Wing, J. (2002). TurboBLAST(r): A Parallel Implementation of BLAST Built on the TurboHub. In Proc. International Parallel and Distributed Processing Symposium (IPDPS'02), pages 183-190.
  5. Braun, R., Pedretti, K., Casavant, T., Scheetz, T., Birkett, C., and Roberts, C. (2001). Parallelization of Local BLAST Service on Workstation Clusters. Future Generation Computer Systems, 17(6):745-754.
  6. Dally, W. and Towles, B. (2003). Principles and Practices of Interconnection Networks. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
  7. Darling, A., Carey, L., and Feng, W. (2003). The Design, Implementation, and Evaluation of mpiBLAST. In Proceedings of ClusterWorld 2003.
  8. Emmert-Streib, F. and Dehmer, M. (2008). Information Theory and Statistical Learning. Springer Publishing Company, Incorporated.
  9. Gardner, M., Feng, W., Archuleta, J., Lin, H., and Ma, X. (2006). Parallel Genomic Sequence-Searching on an Ad-Hoc Grid: Experiences, Lessons learned, and Implications. In IEEE/ACM International Conference for High-Performance Computing, Networking, Storage and Analysis (SC'06).
  10. Janssen, C., Adalsteinsson, H., Cranford, S., Kenny, J., Pinar, A., Evensky, D., and Mayo, J. (2010). A Simulator for Large-Scale Parallel Computer Architectures. Inter. Jour. of Distributed Systems and Technologies, 1(2):57-73.
  11. Knüpfer, A., R.B., Brunst, H., Mix, H., and Nagel, W. (2006). Introducing the Open Trace Format (OTF). In Alexandrov, V., van Albada, G., Sloot, P., and Dongarra, J., editors, Int. Conf. on Computational Science, volume 3992 of Lecture Notes in Computer Science, pages 526-533. Springer.
  12. Lin, H., Balaji, P., Poole, R., Sosa, C., Ma, X., and Feng, W. (2008). Massively Parallel Genomic Sequence Search on the Blue Gene/P Architecture. In Proc. ACM/IEEE conference on Supercomputing (SC'08), pages 33:1- 33:11, Piscataway, NJ, USA. IEEE Press.
  13. Lin, H., Ma, X., Chandramohan, P., Geist, A., and Samatova, N. (2005). Efficient Data Access for Parallel BLAST. In Proc. International Parallel and Distributed Processing Symposium (IPDPS'05), page 72.2, Washington, DC, USA. IEEE Computer Society.
  14. Lin, H., Ma, X., Feng, W., and Samatova, N. (2011). Coordinating Computation and I/O in Massively Parallel Sequence Search. IEEE Transactions on Parallel and Distributed Systems, 22(4):529-543.
  15. Mathog, D. (2003). Parallel BLAST on split databases. Bioinformatics, 19(14):1865-1866.
  16. Mintchev, S. and Getov, V. (1997). PMPI: High-Level Message Passing in Fortran 77 and C. In Proc. Inter. Conference and Exhibition on High-Performance Computing and Networking (HPCN Europe 7897), pages 603-614, London, UK. Springer-Verlag.
  17. MPI (2009). MPI (Message Passing Interface) standards documents, errata, and archives of the MPI Forum. http://www.mpi-forum.org.
  18. Prakash, S., Deelman, E., and Bagrodia, R. (2000). Asynchronous Parallel Simulation of Parallel Programs. IEEE Transactions on Software Engineering, 26(5):385-400.
  19. Riesen, R. (2006). A Hybrid MPI Simulator. In IEEE Inter. Conf. on Cluster Computing 2006, pages 1-9.
  20. Schuster, S. (2007). Next-generation sequencing transforms today's biology. Nature Methods, 5(1):16-18.
  21. Sherwood, T., Perelman, E., and Hamerly, G. (2002). Automatically Characterizing Large Scale Program Behavior. In 10th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2002), pages 45-57.
  22. SST/Macro (2011). SST: The Structural Simulation Toolkit, SST/macro the Macroscale Components, Open Source Release. http://sst.sandia.gov/about sstmacro.html.
  23. Stroustrup, B. (2000). The C++ Programming Language. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
  24. Susukita, R., Ando, H., Aoyagi, M., Honda, H., Inadomi, Y., Inoue, K., Ishizuki, S., Kimura, Y., Komatsu, H., Kurokawa, M., Murakami, K. J., Shibamura, H., Yamamura, S., and Yu, Y. (2008). Performance prediction of large-scale parallell system and application using macro-level simulation. In Proc. ACM/IEEE conference on Supercomputing SC 7808, pages 20:1-20:9, Piscataway, NJ, USA. IEEE Press.
  25. Thorsen, O., Smith, B., Sosa, C., Jiang, K., Lin, H., Peters, A., and Feng, W. (2007). Parallel genomic sequencesearch on a massively parallel system. In Proc. Int. Conf. on Computing Frontiers (CF 7807), pages 59-68, New York, NY, USA. ACM.
  26. Top500 (2011). Top 500 SuperComputers Ranking at March 2011. http://www.top500.org.
  27. Underwood, K. D., Levenhagen, M., and Rodrigues, A. (2007). Simulating Red Storm: Challenges and Successes in Building a System Simulation. In Proc. International Parallel and Distributed Processing Symposium (IPDPS'07), pages 1-10, Los Alamitos, CA, USA. IEEE Computer Society.
  28. Vectorbase (2010). NIAID Bioinformatics Resource Center for Invertebrate Vectors of Human Pathogens. http://www.vectorbase.org.
  29. Zheng, G., Wilmarth, T., Jagadishprasad, P., and Kalé, L. (2005). Simulation-based performance prediction for large parallel machines. Int. Jour. Parallel Program., 33(2):183-207.
Download


Paper Citation


in Harvard Style

Ahn T., Dechev D., Lin H., Adalsteinsson H. and Janssen C. (2011). EVALUATING PERFORMANCE OPTIMIZATIONS OF LARGE-SCALE GENOMIC SEQUENCE SEARCH APPLICATIONS USING SST/MACRO . In Proceedings of 1st International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH, ISBN 978-989-8425-78-2, pages 65-73. DOI: 10.5220/0003600200650073


in Bibtex Style

@conference{simultech11,
author={Tae-Hyuk Ahn and Damian Dechev and Heshan Lin and Helgi Adalsteinsson and Curtis Janssen},
title={EVALUATING PERFORMANCE OPTIMIZATIONS OF LARGE-SCALE GENOMIC SEQUENCE SEARCH APPLICATIONS USING SST/MACRO},
booktitle={Proceedings of 1st International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,},
year={2011},
pages={65-73},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003600200650073},
isbn={978-989-8425-78-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of 1st International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,
TI - EVALUATING PERFORMANCE OPTIMIZATIONS OF LARGE-SCALE GENOMIC SEQUENCE SEARCH APPLICATIONS USING SST/MACRO
SN - 978-989-8425-78-2
AU - Ahn T.
AU - Dechev D.
AU - Lin H.
AU - Adalsteinsson H.
AU - Janssen C.
PY - 2011
SP - 65
EP - 73
DO - 10.5220/0003600200650073