State Space Models
[ml
machinelearning
]
So, you want to learn about state space models like Mamba as an alternative to Transformers? A few resources:
- Structured State Spaces: Combining Continuous-Time, Recurrent, and Convolutional Models – explanation and math
- The Annotated S4 — Build your own SSM in Jax