THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research

Ulrich Lampe, André Miede, Nils Richerzhagen, Dieter Schuller, Ralf Steinmetz

2012

Abstract

Using Virtual Machines from public cloud providers, researchers gain access to a large pool of experimental infrastructure at comparatively low cost. However, as it is shown in this position paper based on dedicated experiments using real-life systems, Virtual Machines often do not provide accurate time measurements. These limitations are problematic for a variety of use cases, such as the runtime comparison of algorithms in the computer science domain.

References

  1. Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010). A view of cloud computing. Communications of the ACM, 53(4):50-58.
  2. Armbrust, M., Fox, A., Griffith, R., Joseph, A., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010). A view of cloud computing. Communications of the ACM, 53(4):50-58.
  3. Briscoe, G. and Marinos, A. (2009). Digital Ecosystems in the Clouds: Towards Community Cloud Computing. In 3rd Int. Conf. on Digital Ecosystems and Technologies, pages 103-108.
  4. Briscoe, G. and Marinos, A. (2009). Digital Ecosystems in the Clouds: Towards Community Cloud Computing. In 3rd Int. Conf. on Digital Ecosystems and Technologies, pages 103-108.
  5. Buyya, R., Yeo, C., Venugopal, S., Broberg, J., and Brandic, I. (2009). Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility. Future Generation Computer Systems, 25(6):599-616.
  6. Buyya, R., Yeo, C., Venugopal, S., Broberg, J., and Brandic, I. (2009). Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility. Future Generation Computer Systems, 25(6):599-616.
  7. Chen, H., Jin, H., and Hu, K. (2010). XenHVMAcct: Accurate CPU Time Accounting for Hardware-Assisted Virtual Machine. In 11th Int. Conf. on Parallel and Distributed Computing, Applications and Technologies, pages 191-198.
  8. Chen, H., Jin, H., and Hu, K. (2010). XenHVMAcct: Accurate CPU Time Accounting for Hardware-Assisted Virtual Machine. In 11th Int. Conf. on Parallel and Distributed Computing, Applications and Technologies, pages 191-198.
  9. Domingues, P., Araujo, F., and Silva, L. (2009). Evaluating the Performance and Intrusiveness of Virtual Machines for Desktop Grid Computing. In 8th IEEE Int. Symp. on Parallel & Distributed Processing, pages 1-8.
  10. Domingues, P., Araujo, F., and Silva, L. (2009). Evaluating the Performance and Intrusiveness of Virtual Machines for Desktop Grid Computing. In 8th IEEE Int. Symp. on Parallel & Distributed Processing, pages 1-8.
  11. Jain, R. K. (1991). The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley.
  12. Jain, R. K. (1991). The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley.
  13. Kohlwey, E., Sussman, A., Trost, J., and Maurer, A. (2011). Leveraging the Cloud for Big Data Biometrics: Meeting the Performance Requirements of the Next Generation Biometric Systems. In 7th IEEE World Congress on Services, pages 597-601.
  14. Kohlwey, E., Sussman, A., Trost, J., and Maurer, A. (2011). Leveraging the Cloud for Big Data Biometrics: Meeting the Performance Requirements of the Next Generation Biometric Systems. In 7th IEEE World Congress on Services, pages 597-601.
  15. Lampe, U. (2011). Optimizing the Distribution of Software Services in Infrastructure Clouds. In 7th IEEE World Congress on Services, Ph.D. Symposium, pages 69-72.
  16. Lampe, U. (2011). Optimizing the Distribution of Software Services in Infrastructure Clouds. In 7th IEEE World Congress on Services, Ph.D. Symposium, pages 69-72.
  17. Manning, C. D., Raghavan, P., and Schütze, H. (2008). Introduction to Information Retrieval. Cambridge University Press.
  18. Manning, C. D., Raghavan, P., and Schütze, H. (2008). Introduction to Information Retrieval. Cambridge University Press.
  19. Marques de Sá, J. (2007). Applied Statistics Using SPSS, STATISTICA, MATLAB and R. Springer.
  20. Marques de Sá, J. (2007). Applied Statistics Using SPSS, STATISTICA, MATLAB and R. Springer.
  21. Sharma, S., Saran, H., and Bansal, S. (2011). An Empirical Study of Clock Skew Behavior in Modern Mobile and Hand-Held Devices. In 3rd Int. Conf. on Communication Systems and Networks, pages 1-4.
  22. Sharma, S., Saran, H., and Bansal, S. (2011). An Empirical Study of Clock Skew Behavior in Modern Mobile and Hand-Held Devices. In 3rd Int. Conf. on Communication Systems and Networks, pages 1-4.
  23. Subramanian, V., Ma, H., Wang, L., Lee, E., and Chen, P. (2011). Rapid 3D Seismic Source Inversion Using Windows Azure and Amazon EC2. In 7th IEEE World Congress on Services, pages 602-606.
  24. Subramanian, V., Ma, H., Wang, L., Lee, E., and Chen, P. (2011). Rapid 3D Seismic Source Inversion Using Windows Azure and Amazon EC2. In 7th IEEE World Congress on Services, pages 602-606.
  25. VMware, Inc. (2011). Timekeeping in VMware Virtual Machines. Available online at www.vmware.com/files/ pdf/Timekeeping-In-VirtualMachines.pdf, last access on March 22, 2012.
  26. VMware, Inc. (2011). Timekeeping in VMware Virtual Machines. Available online at www.vmware.com/files/ pdf/Timekeeping-In-VirtualMachines.pdf, last access on March 22, 2012.
Download


Paper Citation


in Harvard Style

Lampe U., Miede A., Richerzhagen N., Schuller D. and Steinmetz R. (2012). THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research . In Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8565-05-1, pages 64-69. DOI: 10.5220/0003895500640069


in Harvard Style

Lampe U., Miede A., Richerzhagen N., Schuller D. and Steinmetz R. (2012). THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research . In Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8565-05-1, pages 64-69. DOI: 10.5220/0003895500640069


in Bibtex Style

@conference{closer12,
author={Ulrich Lampe and André Miede and Nils Richerzhagen and Dieter Schuller and Ralf Steinmetz},
title={THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research},
booktitle={Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2012},
pages={64-69},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003895500640069},
isbn={978-989-8565-05-1},
}


in Bibtex Style

@conference{closer12,
author={Ulrich Lampe and André Miede and Nils Richerzhagen and Dieter Schuller and Ralf Steinmetz},
title={THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research},
booktitle={Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2012},
pages={64-69},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003895500640069},
isbn={978-989-8565-05-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research
SN - 978-989-8565-05-1
AU - Lampe U.
AU - Miede A.
AU - Richerzhagen N.
AU - Schuller D.
AU - Steinmetz R.
PY - 2012
SP - 64
EP - 69
DO - 10.5220/0003895500640069


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - THE VIRTUAL MARGIN OF ERROR - On the Limits of Virtual Machines in Scientific Research
SN - 978-989-8565-05-1
AU - Lampe U.
AU - Miede A.
AU - Richerzhagen N.
AU - Schuller D.
AU - Steinmetz R.
PY - 2012
SP - 64
EP - 69
DO - 10.5220/0003895500640069