DATA FILTERING TECHNIQUES IN DECISION SUPPORT SYSTEMS
DOI:
https://doi.org/10.20535/kpisn.2021.1.231205Keywords:
data analysis, nonlinear nonstationary processes, methods of optimal and probabilistic filtering, simulationAbstract
Background. The majority of modern dynamic processes in economy, finances, ecology, technologies and many other areas of studies exhibit short- and long-term nonlinear and nonstationary behavior. That is why it is required to create for their thorough analysis modern highly developed specialized instrumentation providing for appropriate preliminary statistical data processing, simulation state and parameter estimation and quality forecasting their evolution in time to be used in decision support systems (DSS).
Objective. The purpose of the paper is to perform introductory analysis of some modern methods for filtering statistical and experimental data; to consider modern filtering techniques on the basis of probabilistic Bayesian approach, that provide a possibility for preparing the data to adequate simulation, computing high quality state and forecast estimates for dynamic systems in stochastic environment and availability of measurement errors.
Methods. To implement modern data filtering techniques appropriate simulation and optimization procedures, probabilistic Bayesian methods of data analysis are utilized; simulation algorithms for parameter estimation, and criteria bases for analyzing quality of intermediate and final results in the frames of DSS are used.
Results. A set of data filtering techniques is presented to be used together with the models describing formally selected processes dynamics. The methodology is considered for implementation of probabilistic Bayesian filter based upon modern statistical data analysis techniques including application of appropriate simulation procedures.
Conclusions. Development of effective means for simulation, state estimation and forecasting dynamics of nonlinear nonstationary processes in various areas of human activities provides a possibility for high quality state and parameter estimation and compute short and middle term forecasts for their future evolution. The methods of optimal Kalman and probabilistic Bayesian filtering considered in the review provide a possibility for performing appropriate analysis of nonlinear nonstationary processes, compute forecasts and provide for managerial decision support on the basis of the forecast estimates.
References
B.D.O. Anderson and J.B. Moore, Optimal Filtering. Englewood Cliffs: Prentice-Hall, 1979, 357 p.
P.І. Bidyuk et al., Time Series Analysis. Kyiv, Ukraine: Polytechnika, 2013.
S.M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Upper Saddle River: Prentice Hall PTR, 1993, 595 p.
C.K. Chui and G. Chen, Kalman Filtering with Real-Time Applications. Berlin: Springer-Verlag, 2009, 229 p. doi: 10.1007/978-3-540-87849-0
S. Haykin, Adaptive Filtering Theory, 4th ed. Upper Saddle River: Prentice-Hall, 2002, 936 p.
M.Z. Zgurovskii and V.N. Podladchikov, Analytical Methods of Kalman Filtering. Kyiv, Ukraine: Naukova Dumka, 1995, 285 p.
S.J. Press, Subjective and Objective Bayesian Statistics. Hoboken: John Wiley & Sons, 2003. doi: 10.1002/9780470317105
A. Pole et al., Applied Bayesian Forecasting and Time Series Analysis. Boca Raton: Chapman & Hall/CRC, 2000.
B.P. Gibbs, Advanced Kalman Filtering, Least-Squares and Modeling. Hoboken: John Wiley & Sons, 2011, 627 p. doi: 10.1002/9780470890042
J.L. Anderson, “An ensemble adjustment Kalman filter for data assimilation for data assimilation,” Monthly Weather Rev., vol. 129, pp. 2284–2903, 2001.
U. Lerner et al., “Bayesian fault detection and diagnosis in dynamic systems,” in Proc. Seventeenth National Conf. Artificial Intelligence, Austin, Texas, 2000, pp. 531–537.
S.J. Julier and J.K. Uhlmann, “Unscented filtering and nonlinear estimation,” Proc. IEEE, vol. 92, no. 3, pp. 401–422, 2004. doi: 10.1109/JPROC.2003.823141
X. Luo and I.M. Moroz, “Ensemble Kalman filters with the unscented transform,” Physica D: Nonlinear Phenomena, vol. 238, no. 5, pp. 549–562. doi: 10.1016/j.physd.2008.12.003
I.R. Petersen and A.V. Savkin, Robust Kalman Filtering for Signals and Systems with Large Uncertainties. Basel: Birkhäuser, 1999, 207 p. doi: 10.1007/978-1-4612-1594-3
H.M.T. Menegaz et al., “A systematization of the unscented Kalman filter theory,” IEEE Trans. Autom. Control, vol. 60, no.10, pp. 2583–2598, 2015. doi: 10.1109/TAC.2015.2404511
A.J. Haug, “A Tutorial on Bayesian Estimation and Tracking Techniques Applicable to Nonlinear and Non-Gaussian Processes,” MITRE Corp., McLean, Virginia, MTR 05W0000004, Jan 2005.
F. Gustafsson, “Particle filter theory and practice with positioning applications,” IEEE Aerosp. Electron. Syst. Mag., vol. 25, no. 7, pp. 53–82, 2010. doi: 10.1109/MAES.2010.5546308
K. Ito and K. Xiong, “Gaussian filters for nonlinear filtering problems,” IEEE Trans. Automatic Control, vol. 45, no. 5, pp. 910–927, 2000. doi: 10.1109/9.855552
M.S. Arulampalam et. al., “A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking,” IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174–188, 2002.
D. Fox et al., “Monte Carlo localization: Efficient position estimation for mobile robots,” in Proc. Sixteenth Nat. Conf. on Artificial Intelligence and Eleventh Conference on Innovative Applications of Artificial Intelligence, Orlando, Florida, 1999, pp. 343–349.
J. Röwekämper et al., “On the position accuracy of mobile robot localization based on particle filters combined with scan matching,” in IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal, 2012, pp. 3158–3164. doi: 10.1109/IROS.2012.6385988
B.W. Silverman, Density estimation for statistics and data analysis. London: Chapman & Hall, 1986, 175 p.
Particle_filter_demo [Online]. Available: https://github.com/mjl/particle_filter_demo
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Roman L. Pantyeyev, Oksana L. Timoshchuk, Vira H. Huskova, Petro I. Bidyuk
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under CC BY 4.0 that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
