Here is an interactive tool to visualize all outputs of a 2d input $x∈ℝ²$ case. We denote with $k$ the layer index $$\ca{ x^{(0)}:=x\\ x^{(k)}:=A^{(k-1)}x^{(k-1)} + b^{(k-1)} & ∀k>0\\ }$$
$σ(x^{(1)})$
$x^{(2)}$
$σ(x^{(2)})$
$x^{(3)}$
$σ(x^{(3)})$
$1$
$2$
zoom
$α$
$β$
$γ$
$δ$
$A^{(0)}=[$
$]$
$b^{(0)}=[$
$]$
$σ(x)=$
$A^{(1)}=[$
$]$
$b^{(1)}=[$
$]$
$σ(x)=$
$A^{(2)}=[$
$]$
$b^{(2)}=[$
$]$
$σ(x)=$