LESSWRONG
LW

294

Chakshu Mira — LessWrong

Chakshu Mira

0040

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by

No posts to display.

No wikitag contributions to display.

Ophiology (or, how the Mamba architecture works)

Chakshu Mira2y10

## Discretize B ## # [B,N] [E->N] [B,E] B = layer.W_B(x[b,l]) # no bias

Shouldn't this be x[:,l] instead of x[b,l]?

Ophiology (or, how the Mamba architecture works)

Chakshu Mira2y10

y_t=[N]C[E,N]h_t+[E] <this one> E [E]xt

Shouldn't this be 'D'?

Ophiology (or, how the Mamba architecture works)

Chakshu Mira2y10

E

Did you mean 'D' here? (2nd equation of the structured SSM)

Ophiology (or, how the Mamba architecture works)

Chakshu Mira2y10

Is this a typo? (Δtvt+1)xt−1