Artemiou, Andreas ORCID: https://orcid.org/0000-0002-7501-4090 and Li, Bing 2013. Predictive power of principal components for single-index model and sufficient dimension reduction. Journal of Multivariate Analysis 119 , pp. 176-184. 10.1016/j.jmva.2013.04.015 |
Abstract
In this paper we demonstrate that a higher-ranking principal component of the predictor tends to have a stronger correlation with the response in single index models and sufficient dimension reduction. This tendency holds even though the orientation of the predictor is not designed in any way to be related to the response. This provides a probabilistic explanation of why it is often beneficial to perform regression on principal components—a practice commonly known as principal component regression but whose validity has long been debated. This result is a generalization of earlier results by Li (2007) [19], Artemiou and Li (2009) [2], and Ni (2011) [24], where the same phenomenon was conjectured and rigorously demonstrated for linear regression.
Item Type: | Article |
---|---|
Date Type: | Publication |
Status: | Published |
Schools: | Mathematics |
Subjects: | Q Science > QA Mathematics |
Uncontrolled Keywords: | Permutation invariance; Principal component analysis; Rotation invariance; Single-index model; Sufficient dimension reduction |
Publisher: | Elsevier |
Last Modified: | 28 Oct 2022 09:54 |
URI: | https://orca.cardiff.ac.uk/id/eprint/76048 |
Citation Data
Cited 12 times in Scopus. View in Scopus. Powered By Scopus® Data
Actions (repository staff only)
Edit Item |