Menu

(Solved) : Lsmt Cell Computed Using Following Formulae Intuitively Functions Forget Gate F T Input Ga Q32680743 . . .

In an LSMT cell, h^{(t)}is computed from h^{(t-1)} and x^{(t-1)}using the following formulae:

f_t = sigma(W_fx^{(t)}+U_fh^{(t-1)}+b_f)

i_t = sigma(W_ix^{(t)}+U_ih^{(t-1)}+b_i)

o_t = sigma(W_qx^{(t)}+U_qh^{(t-1)}+b_q)

c_t = f_t otimes c_{(t-1)} + i_t otimes tanh(Ux^{(t)}+Wh^{(t-1)}+b)

h^{(t)}=o_t otimes tanh(c_t)

(a) Intuitively, what are the functions of the forget gate f(t)and the input gate i(t) do? Answer briely

(b) Why do we use the sigmoid function for f(t) and i(t), buttanh for the memory cell c(t) and the output h(t)? Answerbriely.

Show transcribed image text

Expert Answer


Answer to Lsmt Cell Computed Using Following Formulae Intuitively Functions Forget Gate F T Input Ga Q32680743 . . .

OR