Parseval’s Theorem
Sources:
- B. P. Lathi & Roger Green. (2021). Chapter 3: Signal Representation by Fourier Series. Signal Processing and Linear Systems (2nd ed., pp. 297-300). Oxford University Press.
Sources:
Sources:
Sources:
In this section I will illustrate that, for a system specified by the differential equation \[ \begin{equation} \label{eq_2_2} Q(D) y(t)=P(D) x(t) , \end{equation} \]
its transfer function is \(H(s)\), the bilateral Laplace transform of \(h(t)\), which is the unit impulse response of the system, and that \(H(s)\) also satisfies: \[ \color{teal} {H(s)=\frac{P(s)}{Q(s)}} . \]
Sources:
Sources:
Sources:
This section is devoted to the determination of the zero-state response(see past post) of an LTIC system. We shall assume that the systems discussed in this section are in the zero state unless mentioned otherwise.
Sources:
Stability is an important system property. Two types of system stability are generally considered: external (BIBO) stability and internal (asymptotic) stability. Let us consider both stability types in turn.
Sources:
Sources:
Stochastic Gradient Descent (SGD) algorithm: minimize \(J(w)=\mathbb{E}[f(w, X)]\) using \(\left\{\nabla_w f\left(w_k, x_k\right)\right\}\) \[ w_{k+1}=w_k-\alpha_k \nabla_w f\left(w_k, x_k\right) \]
Sources:
Robbins-Monro (RM) algorithm: solve \(g(w)=0\) using \(\left\{\tilde{g}\left(w_k, \eta_k\right)\right\}\) \[ w_{k+1}=w_k-a_k \tilde{g}\left(w_k, \eta_k\right) \]