This paper puts forward kernel ridge regression as an approach for forecasting with many predictors that are related nonlinearly to the target variable. In kernel ridge regression, the observed predictor variables are mapped nonlinearly into a high-dimensional space, where estimation of the...

Kernel ridge regression is gaining popularity as a data-rich nonlinear forecasting tool, which is applicable in many different contexts. This paper investigates the influence of the choice of kernel and the setting of tuning parameters on forecast accuracy. We review several popular kernels,...

Motivated by the problem of setting prediction intervals in time series analysis, we suggest two new methods for conditional distribution estimation. The first method is based on locally fitting a logistic model and is in the spirit of recent work on locally parametric techniques in density...

In regression, the desired estimate of y|x is not always given by a conditional mean, althoughthis is most common. Sometimes one wants to obtain a good estimate that satisfies the propertythat a proportion, t, of y|x, will be below the estimate. For t = 0.5 this is an estimate of themedian. What...

Design of a classifier consists of two stages: feature extraction and classifier learning. For a better performance, the nature, characteristics, or underlying structure of data should be taken into account in either of the stages when we design a classifier. In this thesis, we present kernel...

Standard approaches to constructing nonparametric confidence bands for functions are frustrated by the impact of bias, which generally is not estimated consistently when using the bootstrap and conventionally smoothed function estimators. To overcome this problem it is common practice to either...

Suppose that a target function f0 : Rd - R is monotonic, namely weakly increasing, and an original estimate f of this target function is available, which is not weakly increasing. Many common estimation methods used in statistics produce such estimates f. We show that these estimates can always...

In this work, we propose to define Gaussian Processes indexed by multidimensional distributions. In the framework where the distributions can be modeled as i.i.d realizations of a measure on the set of distributions, we prove that the kernel defined as the quadratic distance between the...

IV regression in the context of a re-sampling is considered in the work. Comparatively, the contribution in the development is a structural identication in the IV model. The work also contains a multiplier-bootstrap justication.

Standard approaches to constructing nonparametric confidence bands for functions are frustrated by the impact of bias, which generally is not estimated consistently when using the bootstrap and conventionally smoothed function estimators. To overcome this problem it is common practice to either...