Machine Learning based Number Plate Detection and Recognition

Zuhaib Ahmed Shaikh, Umair Ali Khan, Muhammad Awais Rajput, Abdul Wahid Memon

Abstract

Automatic Number Plate Detection and Recognition (ANPDR) has become of significant interest with the substantial increase in the number of vehicles all over the world. ANPDR is particularly important for automatic toll collection, traffic law enforcement, parking lot access control, and gate entry control, etc. Due to the known efficacy of image processing in this context, a number of ANPDR solutions have been proposed. However, these solutions are either limited in operations or work only under specific conditions and environments. In this paper, we propose a robust and computationally-efficient ANPDR system which uses Deformable Part Models (DPM) for extracting number plate features from training images, Structural Support Vector Machine (SSVM) for training a number plate detector with the extracted DPM features, several image enhancement operations on the extracted number plate, and Optical Character Recognition (OCR) for extracting the numbers from the plate. The results presented in this paper, obtained by long-term experiments performed under different conditions, demonstrate the efficiency of our system. They also show that our proposed system outperforms other ANPDR techniques not only in accuracy, but also in execution time.

References

  1. Baggio, D. L. (2012). Mastering OpenCV with practical computer vision projects. Packt Publishing Ltd.
  2. Caltech Cars Dataset. http://www.vision.caltech.edu/Image Datasets/cars markus/cars markus.tar. [Accessed: 30 December, 2015].
  3. Cortes, C. and Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3):273-297.
  4. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 1, pages 886-893.
  5. Felzenszwalb, P., McAllester, D., and Ramanan, D. (2008).
  6. A discriminatively trained, multiscale, deformable part model. In IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8.
  7. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and Ramanan, D. (2010). Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(9):1627-1645.
  8. Hongliang, B. and Changping, L. (2004). A hybrid license plate extraction method based on edge statistics and morphology. In Proceedings of the 17th International Conference on Pattern Recognition, volume 2, pages 831-834.
  9. Joachims, T., Finley, T., and Yu, C.-N. J. (2009a). Cuttingplane training of structural svms. Machine Learning, 77(1):27-59.
  10. Joachims, T., Hofmann, T., Yue, Y., and Yu, C.-N. (2009b). Predicting structured objects with support vector machines. Communications of the ACM, 52(11):97-104.
  11. Le, W. and Li, S. (2006). A hybrid license plate extraction method for complex scenes. In 18th International Conference on Pattern Recognition, volume 2, pages 324-327.
  12. Nowozin, S. and Lampert, C. H. (2011). Structured learning and prediction in computer vision. Foundations and Trends in Computer Graphics and Vision, 6(3- 4):185-365.
  13. Prates, R., Cámara-Chávez, G., Schwartz, W. R., and Menotti, D. (2013). Brazilian license plate detection using histogram of oriented gradients and sliding windows. International Journal of Computer Science and Information Technology, 5(6):39-52.
  14. Qiu, Y., Sun, M., and Zhou, W. (2009). License plate extraction based on vertical edge detection and mathematical morphology. In International Conference on Computational Intelligence and Software Engineering, pages 1-5.
  15. Tesseract-OCR. https://code.google.com/p/tesseract-ocr/. [Accessed: 30 December, 2015].
  16. Wendel, A., Sternig, S., and Godec, M. (2011). Structured learning and prediction in computer vision. In 16th Computer Vision Winter Workshop, pages 1-7.
  17. Zhou, W., Li, H., Lu, Y., and Tian, Q. (2012). Principal visual word discovery for automatic license plate detection. IEEE Transactions on Image Processing, 21(9):4269-4279.
Download


Paper Citation


in Harvard Style

Shaikh Z., Khan U., Rajput M. and Memon A. (2016). Machine Learning based Number Plate Detection and Recognition . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 327-333. DOI: 10.5220/0005750203270333


in Bibtex Style

@conference{icpram16,
author={Zuhaib Ahmed Shaikh and Umair Ali Khan and Muhammad Awais Rajput and Abdul Wahid Memon},
title={Machine Learning based Number Plate Detection and Recognition},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={327-333},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005750203270333},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Machine Learning based Number Plate Detection and Recognition
SN - 978-989-758-173-1
AU - Shaikh Z.
AU - Khan U.
AU - Rajput M.
AU - Memon A.
PY - 2016
SP - 327
EP - 333
DO - 10.5220/0005750203270333