Skip to main content

Survey on Estimation

  • Living reference work entry
  • Latest version View entry history
  • First Online:
Encyclopedia of Systems and Control
  • 588 Accesses

Estimation is the process of inferring the value of an unknown given quantity of interest from noisy, direct or indirect, observations of such a quantity. Due to its great practical relevance, estimation has a long history and an enormous variety of applications in all fields of engineering and science. A certainly incomplete list of possible application domains of estimation includes the following: statistics (Lehmann and Casella 1998; Bard 1974; Wertz 1978; Ghosh et al. 1997; Koch 1999; Tsybakov 2009), telecommunication systems (Snyder 1968; Van Trees 1971; Sage and Melsa 1971; Schonhoff and Giordano 2006), signal and image processing (Kay 1993; Itakura 1971; Wakita 1973; Poor 1994; Elliott et al. 2008; Barkat 2005; Levy 2008; Najim 2008; Tuncer and Friedlander 2009; Woods and Radewan 1977; Biemond et al. 1983; Kim and Woods 1998), aerospace engineering (McGee and Schmidt 1985), tracking (Farina and Studer 19851986; Blackman and Popoli 1999; Bar-Shalom et al. 20012013; Bar-Shalom...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Bibliography

  • Abur A, Gómez Espósito A (2004) Power system state estimation – theory and implementation. Marcel Dekker, New York

    Google Scholar 

  • Aidala VJ, Hammel SE (1983) Utilization of modified polar coordinates for bearings-only tracking. IEEE Trans Autom Control 28(3):283–294

    MATH  Google Scholar 

  • Alamo T, Bravo JM, Camacho EF (2005) Guaranteed state estimation by zonotopes. Automatica 41(6):1035–1043

    MathSciNet  MATH  Google Scholar 

  • Alessandri A, Baglietto M, Battistelli G (2005) Receding-horizon estimation for switching discrete-time linear systems. IEEE Trans Autom Control 50(11):1736–1748

    MathSciNet  Google Scholar 

  • Alessandri A, Baglietto M, Battistelli G (2008) Moving-horizon state estimation for nonlinear discrete-time systems: new stability results and approximation schemes. Automatica 44(7):1753–1765

    MathSciNet  MATH  Google Scholar 

  • Alriksson P, Rantzer A (2006) Distributed Kalman filtering using weighted averaging. In: Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems, Kyoto

    Google Scholar 

  • Alspach DL, Sorenson HW (1972) Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Trans Autom Control 17(4):439–448

    MATH  Google Scholar 

  • Anderson BDO, Chirarattananon S (1972) New linear smoothing formulas. IEEE Trans Autom Control 17(1):160–161

    MathSciNet  Google Scholar 

  • Anderson BDO, Moore JB (1979) Optimal filtering. Prentice Hall, Englewood Cliffs

    MATH  Google Scholar 

  • Andrews A (1968) A square root formulation of the Kalman covariance equations. AIAA J 6(6):1165–1166

    MATH  Google Scholar 

  • Andrews HC (1972) Introduction to mathematical techniques in pattern recognition. Wiley, New York

    MATH  Google Scholar 

  • Aoki M (1987) State space modeling of time-series. Springer, Berlin

    MATH  Google Scholar 

  • Athans M (1971) An optimal allocation and guidance laws for linear interception and rendezvous problems. IEEE Trans Aerosp Electron Syst 7(5):843–853

    Google Scholar 

  • Balakrishnan AV, Lions JL (1967) State estimation for infinite-dimensional systems. J Comput Syst Sci 1(4):391–403

    MathSciNet  MATH  Google Scholar 

  • Barbarisi O, Vasca F, Glielmo L (2006) State of charge Kalman filter estimator for automotive batteries. Control Eng Pract 14(3):267–275

    Google Scholar 

  • Bard Y (1974) Nonlinear parameter estimation. Academic, New York

    MATH  Google Scholar 

  • Barkat M (2005) Signal detection and estimation. Artech House, Boston

    Google Scholar 

  • Bar-Shalom Y, Fortmann TE (1988) Tracking and data association. Academic, Boston

    MATH  Google Scholar 

  • Bar-Shalom Y, Li X, Kirubarajan T (2001) Estimation with applications to tracking and navigation. Wiley, New York

    Google Scholar 

  • Bar-Shalom Y, Willett P, Tian X (2013) Tracking and data fusion: a handbook of algorithms. YBS Publishing Storrs, CT

    Google Scholar 

  • Battistelli G, Chisci L, Morrocchi S, Papi F (2011) An information-theoretic approach to distributed state estimation. In: Proceedings of the 18th IFAC World Congress, Milan, pp 12477–12482

    Google Scholar 

  • Battistelli G, Chisci L, Mugnai G, Farina A, Graziano A (2012) Consensus-based algorithms for distributed filtering. In: Proceedings of the 51st IEEE Control and Decision Conference, Maui, pp 794–799

    Google Scholar 

  • Battistelli G, Chisci L (2014) Kullback-Leibler average, consensus on probability densities, and distributed state estimation with guaranteed stability. Automatica 50:707–718

    MathSciNet  MATH  Google Scholar 

  • Battistelli G, Chisci L, Fantacci C, Farina A, Graziano A (2013) Consensus CPHD filter for distributed multitarget tracking. IEEE J Sel Topics Signal Process 7(3):508–520

    Google Scholar 

  • Bayes T (1763) Essay towards solving a problem in the doctrine of chances. Philos Trans R Soc Lond 53:370–418. doi:10.1098/rstl.1763.0053

    Google Scholar 

  • Bayless JW, Brigham EO (1970) Application of the Kalman filter. Geophysics 35(1):2–23

    Google Scholar 

  • Bekey GA (1973) Parameter estimation in biological systems: a survey. In: Proceedings of the 3rd IFAC Symposium Identification and System Parameter Estimation, Delft, pp 1123–1130

    Google Scholar 

  • Benedict TR, Bordner GW (1962) Synthesis of an optimal set of radar track-while-scan smoothing equations. IRE Trans Autom Control 7(4):27–32

    Google Scholar 

  • Benes VE (1981) Exact finite-dimensional filters for certain diffusions with non linear drift. Stochastics 5(1):65–92

    MathSciNet  MATH  Google Scholar 

  • Bertsekas DP, Rhodes IB (1971) Recursive state estimation for a set-membership description of uncertainty. IEEE Trans Autom Control 16(2):117–128

    MathSciNet  Google Scholar 

  • Biemond J, Rieske J, Gerbrands JJ (1983) A fast Kalman filter for images degraded by both blur and noise. IEEE Trans Acoust Speech Signal Process 31(5):1248–1256

    Google Scholar 

  • Bierman GJ (1974) Sequential square root filtering and smoothing of discrete linear systems. Automatica 10(2):147–158

    MathSciNet  MATH  Google Scholar 

  • Bierman GJ (1977) Factorization methods for discrete sequential estimation. Academic, New York

    MATH  Google Scholar 

  • Blackman S, Popoli R (1999) Design and analysis of modern tracking systems. Artech House, Norwood

    MATH  Google Scholar 

  • Blasch EP, Lambert DA, Valin P, Kokar MM, Llinas J, Das S, Chong C, Shahbazian E (2012) High level information fusion (HLIF): survey of models, issues, and grand challenges. IEEE Aerosp Electron Syst Mag 27(9):4–20

    Google Scholar 

  • Bryson AE, Frazier M (1963) Smoothing for linear and nonlinear systems, TDR 63-119, Aero System Division. Wright-Patterson Air Force Base, Ohio

    Google Scholar 

  • Calafiore GC, Abrate F (2009) Distributed linear estimation over sensor networks. Int J Control 82(5):868–882

    MathSciNet  MATH  Google Scholar 

  • Carravetta F, Germani A, Raimondi M (1996) Polynomial filtering for linear discrete-time non-Gaussian systems. SIAM J Control Optim 34(5):1666–1690

    MathSciNet  MATH  Google Scholar 

  • Chen J, Patton RJ (1999) Robust model-based fault diagnosis for dynamic systems. Kluwer, Boston

    MATH  Google Scholar 

  • Chisci L, Zappa G (1992) Square-root Kalman filtering of descriptor systems. Syst Control Lett 19(4):325–334

    MathSciNet  MATH  Google Scholar 

  • Chisci L, Garulli A, Zappa G (1996) Recursive state bounding by parallelotopes. Automatica 32(7):1049–1055

    MathSciNet  Google Scholar 

  • Chou KC, Willsky AS, Benveniste A (1994) Multiscale recursive estimation, data fusion, and regularization. IEEE Trans Autom Control 39(3):464–478

    MathSciNet  MATH  Google Scholar 

  • Combettes P (1993) The foundations of set-theoretic estimation. Proc IEEE 81(2):182–208

    Google Scholar 

  • Cramér H (1946) Mathematical methods of statistics. University Press, Princeton

    MATH  Google Scholar 

  • Crisan D, Rozovskii B (eds) (2011) The Oxford handbook of nonlinear filtering. Oxford University Press, Oxford

    MATH  Google Scholar 

  • Dai L (1987) State estimation schemes in singular systems. In: Preprints 10th IFAC World Congress, Munich, vol 9, pp 211–215

    Google Scholar 

  • Dai L (1989) Filtering and LQG problems for discrete-time stochastic singular systems. IEEE Trans Autom Control 34(10):1105–1108

    MATH  Google Scholar 

  • Darragh J, Looze D (1984) Noncausal minimax linear state estimation for systems with uncertain second-order statistics. IEEE Trans Autom Control 29(6):555–557

    MATH  Google Scholar 

  • Daum FE (1986) Exact finite dimensional nonlinear filters. IEEE Trans Autom Control 31(7):616–622

    MathSciNet  MATH  Google Scholar 

  • Daum F (2005) Nonlinear filters: beyond the Kalman filter. IEEE Aerosp Electron Syst Mag 20(8):57–69

    Google Scholar 

  • Debs AS, Larson RE (1970) A dynamic estimator for tracking the state of a power system. IEEE Trans Power Appar Syst 89(7):1670–1678

    Google Scholar 

  • Devlin K (2008) The unfinished game: Pascal, Fermat and the seventeenth-century letter that made the world modern. Basic Books, New York. Copyright (C) Keith Devlin

    Google Scholar 

  • Dissanayake G, Newman P, Clark S, Durrant-Whyte H, Csorba M (2001) A solution to the simultaneous localization and map building (SLAM) problem. IEEE Trans Robot Autom 17(3):229–241

    Google Scholar 

  • Dochain D, Vanrolleghem P (2001) Dynamical modelling and estimation of wastewater treatment processes. IWA Publishing, London

    Google Scholar 

  • Doucet A, de Freitas N, Gordon N (eds) (2001) Sequential Monte Carlo methods in practice. Springer, New York

    MATH  Google Scholar 

  • Duncan TE (1970) On the calculation of mutual information. SIAM J Appl Math 19(1):215–220

    MathSciNet  MATH  Google Scholar 

  • Durrant-Whyte H, Bailey T (2006a) Simultaneous localization and mapping: Part I. IEEE Robot Autom Mag 13(2):99–108

    Google Scholar 

  • Durrant-Whyte H, Bailey T (2006b) Simultaneous localization and mapping: Part II. IEEE Robot Autom Mag 13(3):110–117

    Google Scholar 

  • Elliott RJ, Aggoun L, Moore JB (2008) Hidden Markov models: estimation and control. Springer, New York. (first edition in 1995)

    Google Scholar 

  • Evensen G (1994a) Inverse methods and data assimilation in nonlinear ocean models. Physica D 77:108–129

    Google Scholar 

  • Evensen G (1994b) Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J Geophys Res 99(10):143–162

    Google Scholar 

  • Evensen G (2007) Data assimilation – the ensemble Kalman filter. Springer, Berlin

    MATH  Google Scholar 

  • Falb PL (1967) Infinite-dimensional filtering; the Kalman-Bucy filter in Hilbert space. Inf Control 11(1):102–137

    MathSciNet  MATH  Google Scholar 

  • Farina A (1999) Target tracking with bearings-only measurements. Signal Process 78(1):61–78

    MathSciNet  MATH  Google Scholar 

  • Farina A, Studer FA (1985) Radar data processing. Volume 1 – introduction and tracking, Editor P. Bowron. Research Studies Press, Letchworth/Wiley, New York (Translated in Russian (Radio I Sviaz, Moscow 1993) and in Chinese. China Defense Publishing House, 1988)

    Google Scholar 

  • Farina A, Studer FA (1986) Radar data processing. Volume 2 – advanced topics and applications, Editor P. Bowron. Research Studies Press, Letchworth/Wiley, New York (In Chinese, China Defense Publishing House, 1992)

    Google Scholar 

  • Farrell JA, Barth M (1999) The global positioning system and inertial navigation. McGraw-Hill, New York

    Google Scholar 

  • Fisher RA (1912) On an absolute criterion for fitting frequency curves. Messenger Math 41(5):155–160

    Google Scholar 

  • Fisher RA (1922) On the mathematical foundations of theoretical statistics. Philos Trans R Soc Lond Ser A 222:309–368

    MATH  Google Scholar 

  • Fisher RA (1925) Theory of statistical estimation. Math Proc Camb Philos Soc 22(5):700–725

    MATH  Google Scholar 

  • Flinn EA, Robinson EA, Treitel S (1967) Special issue on the MIT geophysical analysis group reports. Geophysics 32:411–525

    Google Scholar 

  • Frost PA, Kailath T (1971) An innovations approach to least-squares estimation, Part III: nonlinear estimation in white Gaussian noise. IEEE Trans Autom Control 16(3):217–226

    Google Scholar 

  • Galilei G (1632) Dialogue concerning the two chief world systems (Translated in English by S. Drake (Foreword of A. Einstein), University of California Press, Berkeley, 1953)

    Google Scholar 

  • Gauss CF (1806) Theoria motus corporum coelestium in sectionibus conicis solem ambientum (Translated in English by C.H. Davis, Reprinted as Theory of motion of the heavenly bodies, Dover, New York, 1963)

    Google Scholar 

  • Gauss CF (1995) Theoria combinationis observationum erroribus minimis obnoxiae (Translated by G.W. Stewart, Classics in Applied Mathematics), vol 11. SIAM, Philadelphia

    Google Scholar 

  • Germani A, Manes C, Palumbo P (2005) Polynomial extended Kalman filter. IEEE Trans Autom Control 50(12):2059–2064

    MathSciNet  Google Scholar 

  • Ghil M, Malanotte-Rizzoli P (1991) Data assimilation in meteorology and oceanography. Adv Geophys 33:141–265

    Google Scholar 

  • Ghosh M, Mukhopadhyay N, Sen PK (1997) Sequential estimation. Wiley, New York

    MATH  Google Scholar 

  • Golub GH (1965) Numerical methods for solving linear least squares problems. Numerische Mathematik 7(3):206–216

    MathSciNet  MATH  Google Scholar 

  • Goodwin GC, Seron MM, De Doná JA (2005) Constrained control and estimation. Springer, London

    MATH  Google Scholar 

  • Gordon NJ, Salmond DJ, Smith AFM (1993) Novel approach to nonlinear/non Gaussian Bayesian state estimation. IEE Proc F 140(2):107–113

    Google Scholar 

  • Grewal MS, Weill LR, Andrews AP (2001) Global positioning systems, inertial navigation and integration. Wiley, New York

    Google Scholar 

  • Grimble MJ (1988) H design of optimal linear filters. In: Byrnes C, Martin C, Saeks R (eds) Linear circuits, systems and signal processing: theory and applications. North Holland, Amsterdam, pp 535–540

    Google Scholar 

  • Guo D, Shamai S, Verdú S (2005) Mutual information and minimum mean-square error in Gaussian channels. IEEE Trans Inf Theory 51(4):1261–1282

    MATH  Google Scholar 

  • Hall DL, Llinas J (1997) An introduction to multisensor data fusion. Proc IEEE 85(1):6–23

    Google Scholar 

  • Hassibi B, Sayed AH, Kailath T (1999) Indefinite-quadratic estimation and control. SIAM, Philadelphia

    MATH  Google Scholar 

  • Heemink AW, Segers AJ (2002) Modeling and prediction of environmental data in space and time using Kalman filtering. Stoch Environ Res Risk Assess 16:225–240

    MATH  Google Scholar 

  • Helstrom CW (1969) Quantum detection and estimation theory. J Stat Phys 1(2):231–252

    MathSciNet  Google Scholar 

  • Helstrom CW (1976) Quantum detection and estimation theory. Academic, New York

    MATH  Google Scholar 

  • Hernandez M, Farina A, Ristic B (2006) PCRLB for tracking in cluttered environments: measurement sequence conditioning approach. IEEE Trans Aerosp Electron Syst 42(2):680–704

    Google Scholar 

  • Ho YC, Agrawala AK (1968) On pattern classification algorithms – introduction and survey. Proc IEEE 56(12):2101–2113

    Google Scholar 

  • Ho YC, Lee RCK (1964) A Bayesian approach to problems in stochastic estimation and control. IEEE Trans Autom Control 9(4):333–339

    MathSciNet  Google Scholar 

  • Iida S, Ohki F, Yamamoto N (2010) Robust quantum Kalman filtering under the phase uncertainty of the probe-laser. In: IEEE international symposium on computer-aided control system design, Yokohama, pp 749–754

    Google Scholar 

  • Itakura F (1971) Extraction of feature parameters of speech by statistical methods. In: Proceedings of the 8th Symposium Speech Information Processing, Sendai, pp II-5.1–II-5.12

    Google Scholar 

  • Jazwinski AH (1966) Filtering for nonlinear dynamical systems. IEEE Trans Autom Control 11(4):765–766

    Google Scholar 

  • Jazwinski AH (1968) Limited memory optimal filtering. IEEE Trans Autom Control 13(5): 558–563

    Google Scholar 

  • Jazwinski AH (1970) Stochastic processes and filtering theory. Academic, New York

    MATH  Google Scholar 

  • Joseph DP, Tou TJ (1961) On linear control theory. Trans Am Inst Electr Eng 80(18):193–196

    Google Scholar 

  • Julier SJ, Uhlmann JK (1997) A non-divergent estimation algorithm in the presence of unknown correlations. In: Proceedings of the 1997 American Control Conference, Albuquerque, vol 4, pp 2369–2373

    Google Scholar 

  • Julier SJ, Uhlmann JK (2004) Unscented Filtering and Nonlinear Estimation. Proc IEEE 92(3): 401–422

    Google Scholar 

  • Julier SJ, Uhlmann JK, Durrant-Whyte H (1995) A new approach for filtering nonlinear systems. In: Proceedings of the 1995 American control conference, Seattle, vol 3, pp 1628–1632

    Google Scholar 

  • Kailath T (1968) An innovations approach to least-squares estimation, Part I: linear filtering in additive white noise. IEEE Trans Autom Control 13(6):646–655

    MathSciNet  Google Scholar 

  • Kailath T (1970) The innovations approach to detection and estimation theory. Proc IEEE 58(5):680–695

    MathSciNet  Google Scholar 

  • Kailath T (1973) Some new algorithms for recursive estimation in constant linear systems. IEEE Trans Inf Theory 19(6):750–760

    MathSciNet  MATH  Google Scholar 

  • Kailath T, Frost PA (1968) An innovations approach to least-squares estimation, Part II: linear smoothing in additive white noise. IEEE Trans Autom Control 13(6):655–660

    MathSciNet  Google Scholar 

  • Kailath T, Sayed AH, Hassibi B (2000) Linear estimation. Prentice Hall, Upper Saddle River

    Google Scholar 

  • Kalman RE (1960a) On the general theory of control systems. In: Proceedings of the 1st International Congress of IFAC, Moscow, USSR, vol 1, pp 481–492

    Google Scholar 

  • Kalman RE (1960b) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng Ser D 82(1):35–45

    Google Scholar 

  • Kalman RE, Bucy RS (1961) New results in linear filtering and prediction theory. Trans ASME J Basic Eng Ser D 83(3):95–108

    MathSciNet  Google Scholar 

  • Kamgarpour M, Tomlin C (2007) Convergence properties of a decentralized Kalman filter. In: Proceedings of the 47th IEEE Conference on Decision and Control, New Orleans, pp 5492–5498

    Google Scholar 

  • Kaminski PG, Bryson AE (1972) Discrete square-root smoothing. In: Proceedings of the AIAA Guidance and Control Conference, paper no. 72–877, Stanford

    Google Scholar 

  • Kay SM (1993) Fundamentals of statistical signal processing, volume 1: estimation theory. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Kim K, Shevlyakov G (2008) Why Gaussianity? IEEE Signal Process Mag 25(2):102–113

    MathSciNet  Google Scholar 

  • Kim J, Woods JW (1998) 3-D Kalman filter for image motion estimation. IEEE Trans Image Process 7(1):42–52

    Google Scholar 

  • Koch KR (1999) Parameter estimation and hypothesis testing in linear models. Springer, Berlin

    MATH  Google Scholar 

  • Kolmogorov AN (1933) Grundbegriffe der Wahrscheinlichkeitsrechnung (in German) (English translation edited by Nathan Morrison: Foundations of the theory of probability, Chelsea, New York, 1956). Springer, Berlin

    Google Scholar 

  • Kolmogorov AN (1941) Interpolation and extrapolation of stationary random sequences. Izv Akad Nauk SSSR Ser Mat 5:3–14 (in Russian) (English translation by G. Lindqvist, published in Selected works of A.N. Kolmogorov - Volume II: Probability theory and mathematical statistics, A.N. Shyryaev (Ed.), pp. 272–280, Kluwer, Dordrecht, Netherlands, 1992)

    Google Scholar 

  • Kushner HJ (1962) On the differential equations satisfied by conditional probability densities of Markov processes with applications. SIAM J Control Ser A 2(1):106–199

    MathSciNet  Google Scholar 

  • Kushner HJ (1967) Dynamical equations for optimal nonlinear filtering. J Differ Equ 3(2):179–190

    MathSciNet  MATH  Google Scholar 

  • Kushner HJ (1970) Filtering for linear distributed parameter systems. SIAM J Control 8(3): 346–359

    MathSciNet  MATH  Google Scholar 

  • Kwakernaak H (1967) Optimal filtering in linear systems with time delays. IEEE Trans Autom Control 12(2):169–173

    MathSciNet  Google Scholar 

  • Lainiotis DG (1972) Adaptive pattern recognition: a state-variable approach. In: Watanabe S (ed) Frontiers of pattern recognition. Academic, New York

    Google Scholar 

  • Lainiotis DG (1974) Estimation: a brief survey. Inf Sci 7:191–202

    MathSciNet  MATH  Google Scholar 

  • Laplace PS (1814) Essai philosophique sur le probabilités (Translated in English by F.W. Truscott, F.L. Emory, Wiley, New York, 1902)

    Google Scholar 

  • Legendre AM (1810) Méthode des moindres quarrés, pour trouver le milieu le plus probable entre les résultats de diffèrentes observations. In: Mémoires de la Classe des Sciences Mathématiques et Physiques de l’Institut Impérial de France, pp 149–154. Originally appeared as appendix to the book Nouvelle méthodes pour la détermination des orbites des comètes, 1805

    Google Scholar 

  • Lehmann EL, Casella G (1998) Theory of point estimation. Springer, New York

    MATH  Google Scholar 

  • Leibungudt BG, Rault A, Gendreau F (1983) Application of Kalman filtering to demographic models. IEEE Trans Autom Control 28(3):427–434

    Google Scholar 

  • Levy BC (2008) Principles of signal detection and parameter estimation. Springer, New York

    Google Scholar 

  • Ljung L (1999) System identification: theory for the user. Prentice Hall, Upper Saddle River

    Google Scholar 

  • Los Alamos Scientific Laboratory (1966) Fermi invention rediscovered at LASL. The Atom, pp 7–11

    Google Scholar 

  • Luenberger DG (1964) Observing the state of a linear system. IEEE Trans Mil Electron 8(2):74–80

    Google Scholar 

  • Mahler RPS (1996) A unified foundation for data fusion. In: Sadjadi FA (ed) Selected papers on sensor and data fusion. SPIE MS-124. SPIE Optical Engineering Press, Bellingham, pp 325–345. Reprinted from 7th Joint Service Data Fusion Symposium, pp 154–174, Laurel (1994)

    Google Scholar 

  • Mahler RPS (2003) Multitarget Bayes filtering via first-order multitarget moments. IEEE Trans Aerosp Electron Syst 39(4):1152–1178

    Google Scholar 

  • Mahler RPS (2007a) Statistical multisource multitarget information fusion. Artech House, Boston

    MATH  Google Scholar 

  • Mahler RPS (2007b) PHD filters of higher order in target number. IEEE Trans Aerosp Electron Syst 43(4):1523–1543

    Google Scholar 

  • Mangoubi ES (1998) Robust estimation and failure detection: a concise treatment. Springer, New York

    Google Scholar 

  • Maybeck PS (1979 and 1982) Stochastic models, estimation and control, vols I, II and III. Academic, New York. 1979 (volume I) and 1982 (volumes II and III)

    Google Scholar 

  • Mayer-Wolf E, Zakai M (1983) On a formula relating the Shannon information to the Fisher information for the filtering problem. In: Korezlioglu H, Mazziotto G and Szpirglas J (eds) Lecture notes in control and information sciences, vol 61. Springer, New York, pp 164–171

    Google Scholar 

  • Mayne DQ (1966) A solution of the smoothing problem for linear dynamic systems. Automatica 4(2):73–92

    MATH  Google Scholar 

  • McGarty TP (1971) The estimation of the constituent densities of the upper atmosphere. IEEE Trans Autom Control 16(6):817–823

    Google Scholar 

  • McGee LA, Schmidt SF (1985) Discovery of the Kalman filter as a practical tool for aerospace and industry, NASA-TM-86847

    Google Scholar 

  • McGeoch CC, Wang C (2013) Experimental evaluation of an adiabatic quantum system for combinatorial optimization. In: Computing Frontiers 2013 Conference, Ischia, article no. 23. doi:10.1145/2482767.2482797

    Google Scholar 

  • McGrayne SB (2011) The theory that would not die. How Bayes’ rule cracked the enigma code, hunted down Russian submarines, and emerged triumphant from two centuries of controversies. Yale University Press, New Haven/London

    Google Scholar 

  • Meditch JS (1967) Orthogonal projection and discrete optimal linear smoothing. SIAM J Control 5(1):74–89

    MathSciNet  MATH  Google Scholar 

  • Meditch JS (1971) Least-squares filtering and smoothing for linear distributed parameter systems. Automatica 7(3):315–322

    MathSciNet  MATH  Google Scholar 

  • Mendel JM (1977) White noise estimators for seismic data processing in oil exploration. IEEE Trans Autom Control 22(5):694–706

    MathSciNet  MATH  Google Scholar 

  • Mendel JM (1983) Optimal seismic deconvolution: an estimation-based approach. Academic, New York

    Google Scholar 

  • Mendel JM (1990) Maximum likelihood deconvolution – a journey into model-based signal processing. Springer, New York

    Google Scholar 

  • Metropolis N, Ulam S (1949) The Monte Carlo method. J Am Stat Assoc 44(247):335–341

    MathSciNet  MATH  Google Scholar 

  • Milanese M, Belforte G (1982) Estimation theory and uncertainty intervals evaluation in presence of unknown but bounded errors: linear families of models and estimators. IEEE Trans Autom Control 27(2):408–414

    MathSciNet  MATH  Google Scholar 

  • Milanese M, Vicino A (1993) Optimal estimation theory for dynamic systems with set-membership uncertainty. Automatica 27(6):427–446

    Google Scholar 

  • Miller WL, Lewis JB (1971) Dynamic state estimation in power systems. IEEE Trans Autom Control 16(6):841–846

    Google Scholar 

  • Mlodinow L (2009) The drunkard’s walk: how randomness rules our lives. Pantheon Books, New York. Copyright (C) Leonard Mlodinow

    Google Scholar 

  • Monticelli A (1999) State estimation in electric power systems: a generalized approach. Kluwer, Dordrecht

    Google Scholar 

  • Morf M, Kailath T (1975) Square-root algorithms for least-squares estimation. IEEE Trans Autom Control 20(4):487–497

    MathSciNet  MATH  Google Scholar 

  • Morf M, Sidhu GS, Kailath T (1974) Some new algorithms for recursive estimation in constant, linear, discrete-time systems. IEEE Trans Autom Control 19(4):315–323

    MATH  Google Scholar 

  • Mullane J, Vo B-N, Adams M, Vo B-T (2011) Random finite sets for robotic mapping and SLAM. Springer, Berlin

    MATH  Google Scholar 

  • Nachazel K (1993) Estimation theory in hydrology and water systems. Elsevier, Amsterdam

    Google Scholar 

  • Najim M (2008) Modeling, estimation and optimal filtering in signal processing. Wiley, Hoboken. First published in France by Hermes Science/Lavoisier as Modélisation, estimation et filtrage optimal en traitement du signal (2006)

    Google Scholar 

  • Neal SR (1967) Discussion of parametric relations for the filter predictor. IEEE Trans Autom Control 12(3):315–317

    MathSciNet  Google Scholar 

  • Netz R, Noel W (2011) The Archimedes codex. Phoenix, Philadelphia, PA

    Google Scholar 

  • Nikoukhah R, Willsky AS, Levy BC (1992) Kalman filtering and Riccati equations for descriptor systems. IEEE Trans Autom Control 37(9):1325–1342

    MathSciNet  MATH  Google Scholar 

  • Olfati-Saber R (2007) Distributed Kalman filtering for sensor networks. In: Proceedings of the 46th IEEE Conference on Decision and Control, New Orleans, pp 5492–5498

    Google Scholar 

  • Olfati-Saber R, Fax JA, Murray R (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233

    Google Scholar 

  • Painter JH, Kerstetter D, Jowers S (1990) Reconciling steady-state Kalman and αβ filter design. IEEE Trans Aerosp Electron Syst 26(6):986–991

    Google Scholar 

  • Park S, Serpedin E, Qarage K (2013) Gaussian assumption: the least favorable but the most useful. IEEE Signal Process Mag 30(3):183–186

    Google Scholar 

  • Personick SD (1971) Application of quantum estimation theory to analog communication over quantum channels. IEEE Trans Inf Theory 17(3):240–246

    MathSciNet  MATH  Google Scholar 

  • Pindyck RS, Roberts SM (1974) Optimal policies for monetary control. Ann Econ Soc Meas 3(1):207–238

    Google Scholar 

  • Poor HV (1994) An introduction to signal detection and estimation, 2nd edn. Springer, New York. (first edition in 1988)

    Google Scholar 

  • Poor HV, Looze D (1981) Minimax state estimation for linear stochastic systems with noise uncertainty. IEEE Trans Autom Control 26(4):902–906

    MathSciNet  MATH  Google Scholar 

  • Potter JE, Stern RG (1963) Statistical filtering of space navigation measurements. In: Proceedings of the 1963 AIAA Guidance and Control Conference, paper no. 63–333, Cambridge

    Google Scholar 

  • Ramm AG (2005) Random fields estimation. World Scientific, Hackensack

    MATH  Google Scholar 

  • Rao C (1945) Information and the accuracy attainable in the estimation of statistical parameters. Bull Calcutta Math Soc 37:81–89

    MathSciNet  MATH  Google Scholar 

  • Rao CV, Rawlings JB, Lee JH (2001) Constrained linear state estimation – a moving horizon approach. Automatica 37(10):1619–1628

    MATH  Google Scholar 

  • Rao CV, Rawlings JB, Mayne DQ (2003) Constrained state estimation for nonlinear discrete-time systems: stability and moving horizon approximations. IEEE Trans Autom Control 48(2): 246–257

    MathSciNet  Google Scholar 

  • Rauch HE (1963) Solutions to the linear smoothing problem. IEEE Trans Autom Control 8(4): 371–372

    Google Scholar 

  • Rauch HE, Tung F, Striebel CT (1965) Maximum likelihood estimates of linear dynamic systems. AIAA J 3(8):1445–1450

    MathSciNet  Google Scholar 

  • Reid D (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Control 24(6):843–854

    Google Scholar 

  • Riccati JF (1722) Animadversiones in aequationes differentiales secundi gradi. Actorum Eruditorum Lipsiae, Supplementa 8:66–73. Observations regarding differential equations of second order, translation of the original Latin into English, by I. Bruce, 2007

    Google Scholar 

  • Riccati JF (1723) Appendix in animadversiones in aequationes differentiales secundi gradi. Acta Eruditorum Lipsiae

    Google Scholar 

  • Ristic B (2013) Particle filters for random set models. Springer, New York

    MATH  Google Scholar 

  • Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter: particle filters for tracking applications. Artech House, Boston

    Google Scholar 

  • Ristic B, Vo B-T, Vo B-N, Farina A (2013) A tutorial on Bernoulli filters: theory, implementation and applications. IEEE Trans Signal Process 61(13):3406–3430

    MathSciNet  Google Scholar 

  • Robinson EA (1963) Mathematical development of discrete filters for detection of nuclear explosions. J Geophys Res 68(19):5559–5567

    MATH  Google Scholar 

  • Roman WS, Hsu C, Habegger LT (1971) Parameter identification in a nonlinear reactor system. IEEE Trans Nucl Sci 18(1):426–429

    Google Scholar 

  • Sage AP, Masters GW (1967) Identification and modeling of states and parameters of nuclear reactor systems. IEEE Trans Nucl Sci 14(1):279–285

    Google Scholar 

  • Sage AP, Melsa JL (1971) Estimation theory with applications to communications and control. McGraw-Hill, New York

    MATH  Google Scholar 

  • Schmidt SF (1966) Application of state-space methods to navigation problems. Adv Control Syst 3:293–340

    Google Scholar 

  • Schmidt SF (1970) Computational techniques in Kalman filtering, NATO-AGARD-139

    Google Scholar 

  • Schonhoff TA, Giordano AA (2006) Detection and estimation theory and its applications. Pearson Prentice Hall, Upper Saddle River

    Google Scholar 

  • Schweppe FC (1968) Recursive state estimation with unknown but bounded errors and system inputs. IEEE Trans Autom Control 13(1):22–28

    Google Scholar 

  • Segall A (1976) Recursive estimation from discrete-time point processes. IEEE Trans Inf Theory 22(4):422–431

    MathSciNet  MATH  Google Scholar 

  • Servi L, Ho Y (1981) Recursive estimation in the presence of uniformly distributed measurement noise. IEEE Trans Autom Control 26(2):563–565

    MathSciNet  MATH  Google Scholar 

  • Simon D (2006) Optimal state estimation – Kalman, H and nonlinear approaches. Wiley, New York

    Google Scholar 

  • Simpson HR (1963) Performance measures and optimization condition for a third-order tracker. IRE Trans Autom Control 8(2):182–183

    Google Scholar 

  • Sklansky J (1957) Optimizing the dynamic parameters of a track-while-scan system. RCA Rev 18:163–185

    Google Scholar 

  • Smeth P, Ristic B (2004) Kalman filter and joint tracking and classification in TBM framework. In: Proceedings of the 7th international conference on information fusion, Stockholm, pp 46–53

    Google Scholar 

  • Smith R, Self M, Cheeseman P (1986) Estimating uncertain spatial relationships in robotics. In: Proceedings of the 2nd conference on uncertainty in artificial intelligence, Philadelphia, pp 435–461

    Google Scholar 

  • Snijders TAB, Koskinen J, Schweinberger M (2012) Maximum likelihood estimation for social network dynamics. Ann Appl Stat 4(2):567–588

    MathSciNet  Google Scholar 

  • Snyder DL (1968) The state-variable approach to continuous estimation with applications to analog communications. MIT, Cambridge

    Google Scholar 

  • Snyder DL (1970) Estimation of stochastic intensity functions of conditional Poisson processes. Monograph no. 128, Biomedical Computer Laboratory, Washington University, St. Louis

    Google Scholar 

  • Söderström T (1994) Discrete-time stochastic system – estimation & control. Prentice Hall, New York

    Google Scholar 

  • Söderström T, Stoica P (1989) System identification. Prentice Hall, New York

    MATH  Google Scholar 

  • Sorenson HW, Alspach DL (1970) Gaussian sum approximations for nonlinear filtering. In: Proceedings of the 1970 IEEE Symposium on Adaptive Processes, Austin, TX pp 19.3.1–19.3.9

    Google Scholar 

  • Sorenson HW, Alspach DL (1971) Recursive Bayesian estimation using Gaussian sums. Automatica 7(4):465–479

    MathSciNet  MATH  Google Scholar 

  • Stankovic SS, Stankovic MS, Stipanovic DM (2009) Consensus based overlapping decentralized estimation with missing observations and communication faults. Automatica 45(6):1397–1406

    MathSciNet  MATH  Google Scholar 

  • Stark L (1968) Neurological control systems studies in bioengineering. Plenum Press, New York

    Google Scholar 

  • Stengel PF (1994) Optimal control and estimation. Dover, New York. Originally published as Stochastic optimal control. Wiley, New York, 1986

    Google Scholar 

  • Stephant J, Charara A, Meizel D (2004) Virtual sensor: application to vehicle sideslip angle and transversal forces. IEEE Trans Ind Electron 51(2):278–289

    Google Scholar 

  • Stratonovich RL (1959) On the theory of optimal nonlinear filtering of random functions. Theory Probab Appl 4:223–225

    Google Scholar 

  • Stratonovich RL (1960) Conditional Markov processes. Theory Probab Appl 5(2):156–178

    Google Scholar 

  • Taylor JH (1979) The Cramér-Rao estimation error lower bound computation for deterministic nonlinear systems. IEEE Trans Autom Control 24(2):343–344

    MATH  Google Scholar 

  • Thrun S, Burgard W, Fox D (2006) Probabilistic robotics. MIT, Cambridge

    Google Scholar 

  • Tichavsky P, Muravchik CH, Nehorai A (1998) Posterior Cramér-Rao bounds for discrete-time nonlinear filtering. IEEE Trans Signal Process 6(5):1386–1396

    Google Scholar 

  • Toyoda J, Chen MS, Inoue Y (1970) An application of state estimation to short-term load forecasting, Part I: forecasting model and Part II: implementation. IEEE Trans Power Appar Syst 89(7):1678–1682 (Part I) and 1683–1688 (Part II)

    Google Scholar 

  • Tsybakov AB (2009) Introduction to nonparametric estimation. Springer, New York

    MATH  Google Scholar 

  • Tuncer TE, Friedlander B (2009) Classical and modern direction-of-arrival estimation. Academic, Burlington

    Google Scholar 

  • Tzafestas SG, Nightingale JM (1968) Optimal filtering, smoothing and prediction in linear distributed-parameter systems. Proc Inst Electr Eng 115(8):1207–1212

    MathSciNet  Google Scholar 

  • Ulam S (1952) Random processes and transformations. In: Proceedings of the International Congress of Mathematicians, Cambridge, vol 2, pp 264–275

    MathSciNet  Google Scholar 

  • Ulam S, Richtmeyer RD, von Neumann J (1947) Statistical methods in neutron diffusion, Los Alamos Scientific Laboratory report LAMS-551

    Google Scholar 

  • Van Trees H (1971) Detection, estimation and modulation theory – Parts I, II and III. Wiley, New York. Republished in 2013

    Google Scholar 

  • van Trees HL, Bell KL (2007) Bayesian bounds for parameter estimation and nonlinear filtering/tracking. Wiley, Hoboken/IEEE, Piscataway

    MATH  Google Scholar 

  • Venerus JC, Bullock TE (1970) Estimation of the dynamic reactivity using digital Kalman filtering. Nucl Sci Eng 40:199–205

    Google Scholar 

  • Verdú S, Poor HV (1984) Minimax linear observers and regulators for stochastic systems with uncertain second-order statistics. IEEE Trans Autom Control 29(6):499–511

    MATH  Google Scholar 

  • Vicino A, Zappa G (1996) Sequential approximation of feasible parameter sets for identification with set membership uncertainty. IEEE Trans Autom Control 41(6):774–785

    MathSciNet  MATH  Google Scholar 

  • Vo B-N, Ma WK (1996) The Gaussian mixture probability hypothesis density filter. IEEE Trans Signal Process 54(11):4091–4101

    Google Scholar 

  • Vo B-T, Vo B-N, Cantoni A (2007) Analytic implementations of the cardinalized probability hypothesis density filter. IEEE Trans Signal Process 55(7):3553–3567

    MathSciNet  Google Scholar 

  • Wakita H (1973) Estimation of the vocal tract shape by inverse optimal filtering. IEEE Trans Audio Electroacoust 21(5):417–427

    Google Scholar 

  • Wertz W (1978) Statistical density estimation – a survey. Vandenhoeck and Ruprecht, Göttingen

    MATH  Google Scholar 

  • Wiener N (1949) Extrapolation, interpolation and smoothing of stationary time-series. MIT, Cambridge

    MATH  Google Scholar 

  • Willsky AS (1976) A survey of design methods for failure detection in dynamic systems. Automatica 12(6):601–611

    MathSciNet  MATH  Google Scholar 

  • Wonham WM (1965) Some applications of stochastic differential equations to optimal nonlinear filtering. SIAM J Control 2(3):347–369

    MathSciNet  MATH  Google Scholar 

  • Woods JW, Radewan C (1977) Kalman filtering in two dimensions. IEEE Trans Inf Theory 23(4):473–482

    MathSciNet  MATH  Google Scholar 

  • Xiao L, Boyd S, Lall S (2005) A scheme for robust distributed sensor fusion based on average consensus. In: Proceedings of the 4th International Symposium on Information Processing in Sensor Networks, Los Angeles, pp 63–70

    Google Scholar 

  • Zachrisson LE (1969) On optimal smoothing of continuous-time Kalman processes. Inf Sci 1(2):143–172

    MathSciNet  Google Scholar 

  • Zellner A (1971) An introduction to Bayesian inference in econometrics. Wiley, New York

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luigi Chisci .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer-Verlag London

About this entry

Cite this entry

Chisci, L., Farina, A. (2015). Survey on Estimation. In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, London. https://doi.org/10.1007/978-1-4471-5102-9_60-2

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-5102-9_60-2

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, London

  • Online ISBN: 978-1-4471-5102-9

  • eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Chapter history

  1. Latest

    Survey on Estimation
    Published:
    19 February 2015

    DOI: https://doi.org/10.1007/978-1-4471-5102-9_60-2

  2. Original

    Survey on Estimation
    Published:
    04 April 2014

    DOI: https://doi.org/10.1007/978-1-4471-5102-9_60-1