Skip to content

Commit

Permalink
doc fix
Browse files Browse the repository at this point in the history
  • Loading branch information
denizyuret committed Oct 15, 2020
1 parent a5bb7c1 commit 87b009e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/src/nce.md
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ Here is the backward pass for MLE (with subscripts dropped for brevity):

$$\begin{aligned}
&p(y) = \frac{\exp s(y)}{\sum_{y'\in\mathcal{Y}}\exp s(y')} \\
&L = \log p(y) = s(y) - \log\sum_{y'\in\mathcal{Y}}\exp s(y') \\\
&L = \log p(y) = s(y) - \log\sum_{y'\in\mathcal{Y}}\exp s(y') \\
&{\partial L}/{\partial s(y)} = 1 - p(y) \\
&{\partial L}/{\partial s(y')} = -p(y') \\
\end{aligned}$$
Expand Down

0 comments on commit 87b009e

Please sign in to comment.