A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data
Fuente:
Wiley Open Access
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Artículo Open Access |
| Publicado: |
Wiley
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1867016689461231617 |
|---|---|
| author | Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai |
| author_facet | Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai |
| collection | Wiley Open Access |
| contents | A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai Statistics in Medicine ABSTRACT In streaming longitudinal data, status prediction becomes challenging when input variables are block‐sparse, autocorrelated, and irregular in both dimension and distribution. General methods cannot model such data directly, especially when the classes are extremely imbalanced. This research proposes a K‐Nearest Neighbor (KNN) algorithm where distance is measured by Kullback–Leibler (KL) divergence. The algorithm uses features extracted from metric conditional density, both with and without first‐order lag. The developed streaming KNN algorithm is further applied to simulation data. Results show that when differences originate from the location hyperparameters of the Gaussian distribution or both the shape and scale hyperparameters of the inverse gamma distribution, the method performs quite well, as expected, with an AUC close to 1. Additionally, a numerical method is proposed for general distributions that lack an analytical expression in real data. This method is applied to a big medical streaming dataset with similar properties. Results indicate that the AUC value gradually increases to 0.913, with a sensitivity of 0.851 and a specificity of 0.816. 10.1002/sim.70332 http://onlinelibrary.wiley.com/termsAndConditions#vor |
| doi_str_mv | 10.1002/sim.70332 |
| format | Artículo Open Access |
| id | wiley_oa_10_1002_sim_70332 |
| institution | Wiley Open Access |
| license_str_mv | http://onlinelibrary.wiley.com/termsAndConditions#vor |
| publishDate | 2025 |
| publisher | Wiley |
| record_format | wiley_oa |
| spellingShingle | A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai Statistics in Medicine A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data Xin Zhao Xiaokai Nie Yu Zhao Kaida Cai Statistics in Medicine ABSTRACT In streaming longitudinal data, status prediction becomes challenging when input variables are block‐sparse, autocorrelated, and irregular in both dimension and distribution. General methods cannot model such data directly, especially when the classes are extremely imbalanced. This research proposes a K‐Nearest Neighbor (KNN) algorithm where distance is measured by Kullback–Leibler (KL) divergence. The algorithm uses features extracted from metric conditional density, both with and without first‐order lag. The developed streaming KNN algorithm is further applied to simulation data. Results show that when differences originate from the location hyperparameters of the Gaussian distribution or both the shape and scale hyperparameters of the inverse gamma distribution, the method performs quite well, as expected, with an AUC close to 1. Additionally, a numerical method is proposed for general distributions that lack an analytical expression in real data. This method is applied to a big medical streaming dataset with similar properties. Results indicate that the AUC value gradually increases to 0.913, with a sensitivity of 0.851 and a specificity of 0.816. 10.1002/sim.70332 http://onlinelibrary.wiley.com/termsAndConditions#vor |
| title | A New Streaming K‐Nearest Neighbor Algorithm for Status Prediction in Block‐Sparse, Autocorrelated, Irregular Longitudinal Data |
| topic | Statistics in Medicine |
| url | https://onlinelibrary.wiley.com/doi/10.1002/sim.70332 |