We can write a periodic signal $x$ as a linear combination of terms:
\begin{align*}
x &= X_0\Psi_0 + X_1\Psi_1 + \cdots + X_{p-1}\Psi_{p-1} 
\end{align*}

Since we are familiar with the linear algebraic language, we can write this in a much more compact form. First we can write $X$ as a $p \times 1$ matrix:
\begin{align*}
X = \left[ \begin{array}{c} X_0 \\ X_1 \\ \vdots \\ X_{p-1} \\ \end{array} \right] 
\end{align*}


We know that $\Psi_k(n) = e^{ik\omega_0 n}$, where $\omega_0 = 2\pi/p$. We can then write $\Psi_k$ as:

\begin{align*}
\Psi_k = \left[ \begin{array}{c} \Psi_k(0) \\ \Psi_k(1) \\ \vdots \\ \Psi_k(p-1) \\ \end{array} \right] = \left[ \begin{array}{c} 1 \\ e^{ik\omega_0} \\ \vdots \\ e^{ik\omega_0(p-1)} \\ \end{array} \right] \\
\end{align*}


Remember that the $k^{th}$ function, or basis signal is denoted by $e^{ik\omega}$, not $e^{i\omega n}$. We don't use $p$ as a value because $e^{ik\omega_0 p}=e^{ik2\pi}$, so we don't need any more terms. We have already shown that these basis signals are orthogonal, hence we can write:

\begin{align*}
\Psi_k^T\Psi_\ell^* &= p\delta(k-\ell) = \left[ \begin{array}{rr} 0 & k\neq\ell \\ p & k=l \\ \end{array} \right] \\
\lr{\Psi_k^T}^*\Psi_\ell &= p\delta(k-\ell) = \left[ \begin{array}{rr} 0 & k\neq\ell \\ p & k=l \\ \end{array} \right] \quad \mbox{take the conjugate of both sides}\\
\Psi_k^H\Psi_\ell &= p\delta(k-\ell) = \left[ \begin{array}{rr} 0 & k\neq\ell \\ p & k=l \\ \end{array} \right] \\
\end{align*}


Here we can define the \emph{Hermitian Transpose} as the conjugate of the transpose:

\begin{nicebox}
$$ \lr{\Psi_k^T}^* = \Psi_k^H $$
\end{nicebox}

Now we can continue with our signal $x$. So now let's go back to initial equation, $x = X_0\Psi_0 + X_1\Psi_1 + \cdots + X_{p-1}\Psi_{p-1}$. Lets write this in a slightly different form by creating a matrix with columns that are made up of the basis vectors multiplied by a coefficient matrix:

\begin{align*}
x &= 
\left[
\begin{array}{cccc}
\Psi_0(0) & \Psi_1(0) & \cdots & \Psi_{p-1}(0) \\
\Psi_0(1) & \Psi_1(1) & \cdots & \Psi_{p-1}(1) \\
\vdots & \vdots & \ddots & \vdots \\
\Psi_0(p-1) & \Psi_1(p-1) & \cdots & \Psi_{p-1}(p-1) \\
\end{array}
\right]
\left[ \begin{array}{c} X_0 \\ X_1 \\ \vdots \\ X_{p-1} \\ \end{array} \right]
\\
x &= \left[ \begin{array}{rrrr} \Psi_0 & \Psi_1 & \cdots & \Psi_{p-1} \\ \end{array} \right] \left[ \begin{array}{c} X_0 \\ X_1 \\ \vdots \\ X_{p-1} \\ \end{array} \right] \\
x &= \Psi X
\end{align*}

This is the synthesis equation. This is exactly what tells us how to obtain $x$ by the linear combination of coefficients in $X$ and exponential vectors in the matrix $\Psi$. How do we solve for $X$? What we are after is the coefficients. These coefficients are what  determine the linear combination of the complex exponential basis vectors that would in turn produce the signal in the period $p$. To do this, we use some more linear algebra:

\begin{align*}
x &= \Psi X \\
\Psi^{-1}x &= \Psi^{-1}\Psi X \\
\Psi^{-1}x &= X \\
X &= \Psi^{-1}x
\end{align*}

But in our case, we don't need to invert $\Psi$ explicity. Taking inverses is numerically expensive, so any opportunity to work around it should be taken. We can multiply by the Hermitian Transpose of $\Psi$:
$$
\Psi^H =  \left[ \begin{array}{c} \Psi_0^H \\ \Psi_1^H \\ \vdots \\ \Psi_{p-1}^H \\ \end{array} \right] 
$$
where each $\Psi_k^H$ is a $1 \times p$ row:

$$
\Psi_k^H = \left[ \begin{array}{rrrr} \Psi_k(0)^H & \Psi_k(1)^H & \cdots & \Psi_k(p-1)^H \\ \end{array} \right]
$$

Hence we have the matrix:

$$
\Psi^H = 
\left[
\begin{array}{cccc}
\Psi_0^H(0) & \Psi_0^H(1) & \cdots & \Psi_0^H(p-1) \\
\Psi_1^H(0) & \Psi_1^H(1) & \cdots & \Psi_1^H(p-1) \\
\vdots & \vdots & \ddots & \vdots \\
\Psi_{p-1}^H(0) & \Psi_{p-1}^H(1) & \cdots & \Psi_{p-1}^H(p-1) \\
\end{array}
\right]
$$

So when we multiply $\Psi^H\Psi$, we get:

$$
\Psi^H\Psi =
\left[
\begin{array}{cccc}
\Psi_0^H(0) & \Psi_0^H(1) & \cdots & \Psi_0^H(p-1) \\
\Psi_1^H(0) & \Psi_1^H(1) & \cdots & \Psi_1^H(p-1) \\
\vdots & \vdots & \ddots & \vdots \\
\Psi_{p-1}^H(0) & \Psi_{p-1}^H(1) & \cdots & \Psi_{p-1}^H(p-1) \\
\end{array}
\right]
\left[
\begin{array}{cccc}
\Psi_0(0) & \Psi_1(0) & \cdots & \Psi_{p-1}(0) \\
\Psi_0(1) & \Psi_1(1) & \cdots & \Psi_{p-1}(1) \\
\vdots & \vdots & \ddots & \vdots \\
\Psi_0(p-1) & \Psi_1(p-1) & \cdots & \Psi_{p-1}(p-1) \\
\end{array}
\right]
$$

Lets just simplify things a bit and keep a compact form by using row vectors and column vectors in our matrices:

\begin{align*}
\Psi^H\Psi &=   \left[ \begin{array}{c} \Psi_0^H \\ \Psi_1^H \\ \vdots \\ \Psi_{p-1}^H \\ \end{array} \right] \left[ \begin{array}{rrrr} \Psi_0 & \Psi_1 & \cdots & \Psi_{p-1} \\ \end{array} \right] \\
\Psi^H\Psi &= \left[
\begin{array}{cccc}
\Psi_0^H\Psi_0 & \Psi_0^H\Psi_1 & \cdots & \Psi_0^H\Psi_{p-1} \\
\Psi_1^H\Psi_0 & \Psi_1^H\Psi_1 & \cdots & \Psi_1^H\Psi_{p-1} \\
\vdots & \vdots & \ddots & \vdots \\
\Psi_{p-1}^H\Psi_0 & \Psi_{p-1}^H\Psi_1 & \cdots & \Psi_{p-1}^H\Psi_{p-1} \\
\end{array}
\right] \\
\Psi^H\Psi &= \left[
\begin{array}{cccc}
p & 0 & \cdots & 0 \\
0 & p & \cdots & 0 \\
\vdots & \vdots & \ddots & \vdots \\
0 & 0 & \cdots & p \\
\end{array}
\right] \\
\Psi^H\Psi &= pI \\
\end{align*}


We know that we get $p$ down the diagonal because of orthogonality as shown earlier:


$$
\Psi_k^H\Psi_\ell = p\delta(k-\ell) = \left[ \begin{array}{rr} 0 & k\neq\ell \\ p & k=l \\ \end{array} \right] 
$$

Now lets find our analysis equation:

\begin{align*}
x &= \Psi X \\
\Psi^H x &= \Psi^H\Psi X \\
\Psi^H x &= pIX \\
\Psi^H x &= pX \\
\frac{1}{p}\Psi^H x &= X \\
X &= \frac{1}{p}\Psi^H x  \\
\end{align*}


Now we have our analysis equation in linear algebra form. To conclude, as long as the basis vectors are mutually orthogonal, and we assume that any inner product of a basis vector with itself is $p$, then this equation holds.

\begin{nicebox}
\begin{align*}
X &= \frac{1}{p}\Psi^H x \quad \quad & \mbox{(analysis equation)} \\
x &= \Psi X \quad \quad & \mbox{(synthesis equation)}
\end{align*}
\end{nicebox}

Discrete Fourier Series