Keyword(s):Linear Discriminant Function (LDF), Logistic Regression, SVM, Minimum Number of Misclassifications (MNM), Revised IP-OLDF based on MNM Criterion, Linear Separable Data, K-Fold Cross-validation.

Related
Ontology
Subjects/Areas/Topics:Artificial Intelligence
;
Knowledge Discovery and Information Retrieval
;
Knowledge-Based Systems
;
Mathematical Modeling
;
Mathematical Programming
;
Methodologies and Technologies
;
Operational Research
;
Optimization
;
Symbolic Systems

Abstract: Fisher proposed a linear discriminant function (LDF) based on the maximization of the variance ratio. If data satisfies Fisher’s assumption, the same LDF is easily derived from a variance-covariance matrix. When the variance-covariance matrices of two classes are not the same, a quadratic discriminant function (QDF) can be used. These discriminant functions have three problems. First, none of them can correctly discriminate between xi on the discriminant hyperplane (the unresolved problem of discriminant analysis). Second, LDF and QDF cannot always recognize linear separable data, and the number of misclassifications (NM) made by these functions is usually higher than that of logistic regression. Third, these functions are not obtained if the value of some independent variable is constant, because the inverse matrix cannot be calculated. These facts mean that LDF and QDF should not be used for important discriminations. On the contrary, a revised Optimal Linear Discriminant Function by Integer Programming (Revised IP-OLDF) based on the Minimum NM (MNM) criterion resolves these problems completely. In addition, the mean error rate of Revised IP-OLDF is often less than those of LDF, logistic regression, and Support Vector Machines (SVM) under 100-fold cross-validation.(More)

Fisher proposed a linear discriminant function (LDF) based on the maximization of the variance ratio. If data satisfies Fisher’s assumption, the same LDF is easily derived from a variance-covariance matrix. When the variance-covariance matrices of two classes are not the same, a quadratic discriminant function (QDF) can be used. These discriminant functions have three problems. First, none of them can correctly discriminate between xi on the discriminant hyperplane (the unresolved problem of discriminant analysis). Second, LDF and QDF cannot always recognize linear separable data, and the number of misclassifications (NM) made by these functions is usually higher than that of logistic regression. Third, these functions are not obtained if the value of some independent variable is constant, because the inverse matrix cannot be calculated. These facts mean that LDF and QDF should not be used for important discriminations. On the contrary, a revised Optimal Linear Discriminant Function by Integer Programming (Revised IP-OLDF) based on the Minimum NM (MNM) criterion resolves these problems completely. In addition, the mean error rate of Revised IP-OLDF is often less than those of LDF, logistic regression, and Support Vector Machines (SVM) under 100-fold cross-validation.

Guests can use SciTePress Digital Library without having a SciTePress account. However, guests have limited access to downloading full text versions of papers and no access to special options.

Guests can use SciTePress Digital Library without having a SciTePress account. However, guests have limited access to downloading full text versions of papers and no access to special options.

Shinmura, S. (2014). End of Discriminant Functions based on Variance-covariance Matrices.In Proceedings of the 3rd International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES, ISBN 978-989-758-017-8, pages 5-16. DOI: 10.5220/0004699000050016

@conference{icores14, author={Shuichi Shinmura.}, title={End of Discriminant Functions based on Variance-covariance Matrices}, booktitle={Proceedings of the 3rd International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES,}, year={2014}, pages={5-16}, publisher={SciTePress}, organization={INSTICC}, doi={10.5220/0004699000050016}, isbn={978-989-758-017-8}, }

TY - CONF

JO - Proceedings of the 3rd International Conference on Operations Research and Enterprise Systems - Volume 1: ICORES, TI - End of Discriminant Functions based on Variance-covariance Matrices SN - 978-989-758-017-8 AU - Shinmura, S. PY - 2014 SP - 5 EP - 16 DO - 10.5220/0004699000050016