Research Repository

Penalized Regression Methods with Application to Generalized Linear Models, Generalized Additive Models, and Smoothing

Utami Zuliana, Sri (2017) Penalized Regression Methods with Application to Generalized Linear Models, Generalized Additive Models, and Smoothing. PhD thesis, University of Essex.

[img]
Preview
Text
thesis20171211-revision (1).pdf

Download (3MB) | Preview

Abstract

Recently, penalized regression has been used for dealing problems which found in maximum likelihood estimation such as correlated parameters and a large number of predictors. The main issues in this regression is how to select the optimal model. In this thesis, Schall’s algorithm is proposed as an automatic selection of weight of penalty. The algorithm has two steps. First, the coefficient estimates are obtained with an arbitrary penalty weight. Second, an estimate of penalty weight λ can be calculated by the ratio of the variance of error and the variance of coefficient. The iteration is continued from step one until an estimate of penalty weight converge. The computational cost is minimized because the optimal weight of penalty could be obtained within a small number of iterations. In this thesis, Schall’s algorithm is investigated for ridge regression, lasso regression and two-dimensional histogram smoothing. The proposed algorithm are applied to real data sets and simulation data sets. In addition, a new algorithm for lasso regression is proposed. The performance of results of the algorithm was almost comparable in all applications. Schall’s algorithm can be an efficient algorithm for selection of weight of penalty.

Item Type: Thesis (PhD)
Subjects: Q Science > QA Mathematics
Q Science > QA Mathematics > QA76 Computer software
Divisions: Faculty of Science and Health > Mathematical Sciences, Department of
Depositing User: Sri Utami Zuliana
Date Deposited: 22 Dec 2017 12:12
Last Modified: 22 Dec 2017 12:12
URI: http://repository.essex.ac.uk/id/eprint/20908

Actions (login required)

View Item View Item