Theorem 1
QK9WWhen N=1, \bm{A}=-1, \bm{B}=1, s_\Delta=\mathsf{Linear}(x), and \tau_\Delta=\mathsf{softplus}, then the selective SSM recurrence (?) takes the form
\begin{aligned}
g_t &= \sigma(\mathsf{Linear}(x_t)) \\
h_{t} &= (1-g_t) h_{t-1} + g_t x_t
.
\end{aligned}
Proof (Proof of Theorem 1) of Theorem 1
Consider a selective SSM (?) with N=1, \bm{A}=-1, \bm{B}=1, s_\Delta=\mathsf{Linear}(x), \tau_\Delta=\mathsf{softplus}. The corresponding continuous-time SSM (?) is
\begin{aligned}
h(t) = -h(t) + x(t)
\end{aligned}
which is also called a leaky integrator.
The discretization step size is
\begin{aligned}
\Delta_t &= \tau_\Delta(\mathsf{Parameter} + s_\Delta(x_t)) \\
&= \mathsf{softplus}(\mathsf{Parameter} + \mathsf{Linear}(x_t)) \\
&= \mathsf{softplus}(\mathsf{Linear}(x_t))
\end{aligned}
where we observe that the parameter can be viewed as a learnable bias and folded into the linear projection.
Now applying the zero-order hold (ZOH) discretization formulas:
\begin{aligned}
\overline{\bm{A}}_t &= \exp(\Delta \bm{A}) = \frac{1}{1 + \exp(\mathsf{Linear}(x_t))} = \sigma(-\mathsf{Linear}(x_t))
\\&= 1 - \sigma(\mathsf{Linear}(x_t))
\\
\overline{\bm{B}}_t &= (\Delta \bm{A})^{-1} (\exp(\Delta \bm{A}) - \bm{I}) \cdot \Delta \bm{B} = -(\exp(\Delta \bm{A}) - \bm{I}) = 1 - \overline{\bm{A}}
\\&= \sigma(\mathsf{Linear}(x_t))
.
\end{aligned}
Thus the final discrete recurrence (?) is
\begin{aligned}
g_t &= \sigma(\mathsf{Linear}(x_t)) \\
h_{t} &= (1-g_t) h_{t-1} + g_t x_t
\end{aligned}
as desired.