Copyright © 2006 The Institute of Electronics, Information and Communication Engineers
Regular Section -- Papers -- Pattern Recognition |
Constructing Kernel Functions for Binary Regression
1 The author is with the Department of Computer Science, Tokyo Institute of Technology, Tokyo, 1528552 Japan. E-mail: sugi{at}cs.titech.ac.jp, 2 The author is with Toray Engineering Co., Ltd., Otsu-shi, 5202141 Japan. E-mail: hidemitsu-ogawa{at}kuramae.ne.jp
Kernel-based learning algorithms have been successfully applied in various problem domains, given appropriate kernel functions. In this paper, we discuss the problem of designing kernel functions for binary regression and show that using a bell-shaped cosine function as a kernel function is optimal in some sense. The rationale of this result is based on the Karhunen-Loève expansion, i.e., the optimal approximation to a set of functions is given by the principal component of the correlation operator of the functions.
Key Words: supervised learning, regression, kernel methods, kernel functions, Karhunen-Loève expansion, principal component analysis, binary regression, Gaussian kernel
Manuscript received August 4, 2005. Manuscript revised January 10, 2006.