Yule Walker Estimation and simulation in Matlab

If a time series data is assumed to be following an Auto-Regressive (AR(N)) model of given form, the natural tendency is to estimate the model parameters a1,a2,…,aN. Least squares method can be applied here to estimate the model parameters but the computations become cumbersome as the order N increases. Fortunately, the AR model co-efficients can … Read more

Solving ARMA model – minimization of squared error

Linear-Time-Invariant-System-LTI-system-model

Key focus: Can a unique solution exists when solving ARMA (Auto Regressive Moving Average) model ? Apply minimization of squared error to find out. As discussed in the previous post, the ARMA model is a generalized model that is a mix of both AR and MA model. Given a signal x[n], AR model is easiest … Read more

Understand AR, MA and ARMA models

Key focus: AR, MA & ARMA models express the nature of transfer function of LTI system. Understand the basic idea behind those models & know their frequency responses. Introduction Signal models are used to analyze stationary univariate time series. The goal of signal modeling is to estimate the process from which the desired signal is … Read more

Cramér-Rao Lower Bound (CRLB)-Vector Parameter Estimation

Key focus: Applying Cramér-Rao Lower Bound (CRLB) for vector parameter estimation. Know about covariance matrix, Fisher information matrix & CRLB matrix. CRLB for Vector Parameter Estimation CRLB for scalar parameter estimation was discussed in previous posts. The same concept is extended to vector parameter estimation. Consider a set of deterministic parameters that we wish to … Read more