POLICY BASED QOS MONITORING - Automated Learning Strategies for Policy Enhancement

Pedro A. Aranda Gutierrez, David Wagner, Ilka Miloucheva, Christof Brandauer, Ulrich Hofmann



A challenge of today’s measurement architectures for QoS/SLA monitoring in heterogeneous network environment is enhanced intelligence in order to minimise measurements and derive automatically optimised measurement strategies for the network operators. Such optimisations can be done with different goals – avoid redundant measurements, sharing of measurements for different QoS monitoring goals and enhancement of measurement strategies considering QoS/SLA measurement requests. For automated optimisation of measurement strategies, QoS measurement policies are proposed whose parameters are adapted dynamically based on specified learning algorithms and rules. For the policy adaptation different kinds of learning can be used, as for instance reinforcement and supervised learning. The integration of the proposed policy based strategies into policy management architecture is discussed. A learning component collecting rules and algorithms for measurement policy adaptation is proposed which can be used by different tools of a policy management system. A graphical user interface (GUI) for a realistic policy based measurement scenario is discussed which aims to optimise the measurement strategies of the network operator.


  1. I. Miloucheva, D. Hetzer, O. Bonnesz, U. Hofmann: "The CM Toolset for Remote Test and Performance Analysis", International Conference for Multimedia Protocols and Systems, Santjago, Chile, Nov. 1997.
  2. U. Hofmann, I. Miloucheva, Distributed Measurement and Monitoring in IP Networks (CMToolset for AQUILA DiffServ), IEEE Networking Conference, Orlando, June 2001
  3. I. Miloucheva, P.A.Aranda.Gutierrez, D. Hetzer, A. Nassri, M. Beoni, INTERMON architecture for complex QoS analysis in inter-domain environment based on discovery of topology and traffic impact, 2nd workshop on Inter-domain performance and simulation, Budapest, March, 2004.
  4. I. Miloucheva, D. Hetzer, P.A. Guitierres, Performance Management for Efficient QoS Provision and Resource Utilisation in Broadband Internet Infrastructure, Broadband Society Workshop , 24-25 August, Setubal, Portugal, 2004.
  5. I. Miloucheva, D. Hetzer, A. Nassri, Data mining approach to study Quality of Voice over IP Applications, Data Mining Conference, Malaga, Spain, September, 2004.
  6. C. Brandauer, T. Fichtel, P. Dorfinger, "On the Monitoring- and Measurement subsystem in NETQOS", In Proceedings of Interworking, Santiago Chile, January 2007.
  7. P. A. Aranda Gutierrez, I.Miloucheva, Integrating Interdomain routing analysis in management strategies for large scale IP networks, Next Generation Teletraffics and Wired/Wireless Advanced Networking, Febr. 2004.
  8. I. Miloucheva, A. Anzaloni, E. Müller, A practical approach to forecast Quality of Service parameters considering outlier, First international workshop on Inter-domain performance and simulation (IPS), Salzburg 20-21 February, 2003.
  9. D. Hetzer, I. Miloucheva, “Adaptable bandwidth planning for enhanced QoS support in user-centric broadband architectures, World Telecommunications Congress (WTC ), Budapest, 30 April - 3 Mai, 2006.
  10. D. Hetzer, I. Miloucheva, K. Jonas, "Resource reservation in Advance for Content On-demand Services", Networks Conference, Nov. 6 - 9, New Delhi, India, 2006.
  11. CAIDA's Skitter project web page, http://www.caida.org/tools/measurement/skitter/ S. Kalidindi, M.J. Zekausus, “Surveyor: An Infrastructure For Internet Performance Measurements”, June, 1999.
  12. S. Seshan, M. Stemm, R. H. Katz, “SPAND: Shared Passive Network Performance Discovery”, USENIX Symposium on Internet Technologies and Systems, 1997.
  13. J. Gray, “The Revolution on Database Architecture”, Paris, France, SIGMOD, 2004.
  14. Westerinen, J. Schnizlein, J. Strassner, M. Scherling, R. Quinn, S. Herzog, A. Huynh, M. Carlson, J. Perry, J. and M. Waldbusser, "Terminology for Policy-based Management", RFC 3198, November 2001.
  15. B. Moore, E. Elleson, J. Strassner, A. Westerinen, “Policy Core Information Model-Version 1 Specification”, RFC 3060, February 2001.
  16. B. Moore, “Policy Core Information Model (PCIM) Extensions”, RFC 3460, January 2003.
  17. R. Sahita, S. Hahn, K. Chan, K. McCloghrie, „Framework Policy Information Base”, RFC 3318, March 2003.
  18. Y. Snir, Y. Ramberg, J. Strassner, R. Cohen, B. Moore, “Policy Quality of Service (QoS) Information Model”, RFC 3644, November 2003.
  19. B. Moore, D. Durham, J. Strassner, A. Westerinen, W. Weiss, “Information Model for Describing Network Device QoS Datapath Mechanisms",RFC 3670, January 2004.
  20. R. S. Sutton, A. G. Barto. ”Reinforcement Learning: An Introduction”, The MIT Press, Cambridge, MA, 1998.
  21. D. P. Bertsekas, J. N. Tsitsiklis, “Neural Dynamic Programming”, Athena Scientific, Belmont, MA, 1996.
  22. C. J. C. H. Watkins, P. Dayan, ” Q-learning”, in Machine Learning, no. 8, page 279-292, 1992.
  23. T. Croonenborghs, J. Ramon, M. Bruynooghe, “Towards Informed Reinforcement Learning”, in Proceedings of the ICML'04 workshop on Relational Reinforcement Learning, Banff, Canada, 2004.
  24. K. Driessens, S. Dzeroski, “Integrating experimentation and guidance in relational reinforcement learning”, in Proceedings of the Nineteenth International Conference on Machine Learning, page 115-122, Morgan Kaufmann Publishers Inc., 2002.
  25. T. Urbancic, I. Bratko, C. Mammut, “Learning models of control skills: Phenomena, results and problems”, in Proceedings of the 13th Triennial World Congress of the International Federation of Automatic Control, IFAC, 1996.

Paper Citation

in Harvard Style

A. Aranda Gutierrez P., Wagner D., Miloucheva I., Brandauer C. and Hofmann U. (2007). POLICY BASED QOS MONITORING - Automated Learning Strategies for Policy Enhancement . In Proceedings of the Second International Conference on Wireless Information Networks and Systems - Volume 1: WINSYS, (ICETE 2007) ISBN 978-989-8111-14-2, pages 275-281. DOI: 10.5220/0002151402750281

in Bibtex Style

author={Pedro A. Aranda Gutierrez and David Wagner and Ilka Miloucheva and Christof Brandauer and Ulrich Hofmann},
title={POLICY BASED QOS MONITORING - Automated Learning Strategies for Policy Enhancement},
booktitle={Proceedings of the Second International Conference on Wireless Information Networks and Systems - Volume 1: WINSYS, (ICETE 2007)},

in EndNote Style

JO - Proceedings of the Second International Conference on Wireless Information Networks and Systems - Volume 1: WINSYS, (ICETE 2007)
TI - POLICY BASED QOS MONITORING - Automated Learning Strategies for Policy Enhancement
SN - 978-989-8111-14-2
AU - A. Aranda Gutierrez P.
AU - Wagner D.
AU - Miloucheva I.
AU - Brandauer C.
AU - Hofmann U.
PY - 2007
SP - 275
EP - 281
DO - 10.5220/0002151402750281