Fix Adam formula

kventinel · web-flow · commit 47347b39e843 · 2020-02-27T23:39:46.000+03:00
diff --git a/homework01/homework_modules.ipynb b/homework01/homework_modules.ipynb
@@ -928,7 +928,7 @@
     "Current step learning rate: $$\\text{lr}_t = \\text{learning_rate} * \\frac{\\sqrt{1-\\beta_2^t}} {1-\\beta_1^t}$$\n",
     "First moment of var: $$\\mu_t = \\beta_1 * \\mu_{t-1} + (1 - \\beta_1)*g$$ \n",
     "Second moment of var: $$v_t = \\beta_2 * v_{t-1} + (1 - \\beta_2)*g*g$$\n",
-    "New values of var: $$\\text{variable} = \\text{variable} - \\text{lr}_t * \\frac{m_t}{\\sqrt{v_t} + \\epsilon}$$"
+    "New values of var: $$\\text{variable} = \\text{variable} - \\text{lr}_t * \\frac{\\mu_t}{\\sqrt{v_t} + \\epsilon}$$"
    ]
   },
   {

Original file line number	Diff line number	Diff line change
`@@ -928,7 +928,7 @@`
`928`	`928`	`"Current step learning rate: $$\\text{lr}_t = \\text{learning_rate} * \\frac{\\sqrt{1-\\beta_2^t}} {1-\\beta_1^t}$$\n",`
`929`	`929`	`"First moment of var: $$\\mu_t = \\beta_1 * \\mu_{t-1} + (1 - \\beta_1)*g$$ \n",`
`930`	`930`	`"Second moment of var: $$v_t = \\beta_2 * v_{t-1} + (1 - \\beta_2)gg$$\n",`
`931`		`- "New values of var: $$\\text{variable} = \\text{variable} - \\text{lr}_t * \\frac{m_t}{\\sqrt{v_t} + \\epsilon}$$"`
	`931`	`+ "New values of var: $$\\text{variable} = \\text{variable} - \\text{lr}_t * \\frac{\\mu_t}{\\sqrt{v_t} + \\epsilon}$$"`
`932`	`932`	`]`
`933`	`933`	`},`
`934`	`934`	`{`