EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments

Raza, Haider, Prasad, Girijesh and Li, Yuhua ORCID: https://orcid.org/0000-0003-2913-4478 2015. EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments. Pattern Recognition 48 (3) , pp. 659-669. 10.1016/j.patcog.2014.07.028

Full text not available from this repository.

Abstract

Dataset shift is a very common issue wherein the input data distribution shifts over time in non-stationary environments. A broad range of real-world systems face the challenge of dataset shift. In such systems, continuous monitoring of the process behavior and tracking the state of shift are required in order to decide about initiating adaptive corrections in a timely manner. This paper presents novel methods for covariate shift-detection tests based on a two-stage structure for both univariate and multivariate time-series. The first stage works in an online mode and it uses an exponentially weighted moving average (EWMA) model based control chart to detect the covariate shift-point in non-stationary time-series. The second stage validates the shift-detected by first stage using the Kolmogorov–Smirnov statistical hypothesis test (K–S test) in the case of univariate time-series and the Hotelling T-Squared multivariate statistical hypothesis test in the case of multivariate time-series. Additionally, several orthogonal transformations and blind source separation algorithms are investigated to counteract the adverse effect of cross-correlation in multivariate time-series on shift-detection performance. The proposed methods are suitable to be run in real-time. Their performance is evaluated through experiments using several synthetic and real-world datasets. Results show that all the covariate shifts are detected with much reduced false-alarms compared to other methods.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics Data Innovation Research Institute (DIURI)
Publisher:	Elsevier
ISSN:	0031-3203
Date of Acceptance:	26 July 2014
Last Modified:	23 Oct 2022 13:10
URI:	https://orca.cardiff.ac.uk/id/eprint/109845

Citation Data

Cited 58 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item