The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines


YAMAN A., CENGİZ M. A.

Journal of New Theory, cilt.2021, sa.34, ss.64-71, 2021 (Hakemli Dergi) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 2021 Sayı: 34
  • Basım Tarihi: 2021
  • Dergi Adı: Journal of New Theory
  • Derginin Tarandığı İndeksler: TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.64-71
  • Ondokuz Mayıs Üniversitesi Adresli: Evet

Özet

Support Vector Machine (SVM) is a supervised machine learning method used for classification and regression. It is based on the Vapnik-Chervonenkis (VC) theory and Structural Risk Minimization (SRM) principle. Thanks to its strong theoretical background, SVM exhibits a high performance compared to many other machine learning methods. The selection of hyperparameters and the kernel functions is an important task in the presence of SVM problems. In this study, the effect of tuning hyperparameters and sample size for the kernel functions on SVM classification accuracy was investigated. For this, UCI datasets of different sizes and with different correlations were simulated. Grid search and 10-fold Cross-Validation methods were used to tune the hyperparameters. Then, SVM classification process was performed using three kernel functions, and classification accuracy values were examined.