Authors:
Alice Nannini
;
Federico A. Galatolo
;
Mario G. C. A. Cimino
and
Gigliola Vaglini
Affiliation:
Department of Information Engineering, University of Pisa, Largo L. Lazzarino 1, Pisa, Italy
Keyword(s):
Deep Learning, Computer Vision, Object Detection, Region Proposal, Document Layout Analysis, Information Extraction, Transfer Learning.
Abstract:
The computer vision and object detection techniques developed in recent years are dominating the state of the art and are increasingly applied to document layout analysis. In this research work, an automatic method to extract meaningful information from scanned documents is proposed. The method is based on the most recent object detection techniques. Specifically, the state-of-the-art deep learning techniques that are designed to work on images, are adapted to the domain of digital documents. This research focuses on play scripts, a document type that has not been considered in the literature. For this reason, a novel dataset has been annotated, selecting the most common and useful formats from hundreds of available scripts. The main contribution of this paper is to provide a general understanding and a performance study of different implementations of object detectors applied to this domain. A fine-tuning of deep neural networks, such as Faster R-CNN and YOLO, has been made to ident
ify text sections of interest via bounding boxes, and to classify them into a specific pre-defined category. Several experiments have been carried out, applying different combinations of data augmentation techniques.
(More)