diff options
| author | Yong He <yonghe@outlook.com> | 2023-11-27 13:46:26 -0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-27 13:46:26 -0800 |
| commit | a2083d64fec7732195e533b6a2ed7d05cc9beedc (patch) | |
| tree | 76d54ade017324fad6bf9dae639922196e3b3e95 /docs/user-guide | |
| parent | b58452651ae70896cde2faf4fb86d8b4b8c8f20e (diff) | |
Update 07-autodiff.md
Diffstat (limited to 'docs/user-guide')
| -rw-r--r-- | docs/user-guide/07-autodiff.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/user-guide/07-autodiff.md b/docs/user-guide/07-autodiff.md index 0751d4296..a2a06b64b 100644 --- a/docs/user-guide/07-autodiff.md +++ b/docs/user-guide/07-autodiff.md @@ -127,7 +127,7 @@ Where $$\omega' \in \mathbf{w}'$$ represents the partial derivative of $$\omega_ Given this definition, $$\mathbb{F}[f]$$ can be used as a forward propagation function that is able to compute $$\frac{\partial f_i}{\partial \omega_0}$$ from $$\frac{\partial \omega_{i-1}}{\partial \omega_0}$$. ### Backward Propagation of Derivatives -When the backpropagation algorithm to train a neural network, we are more interested in figuring out the partial derivative of the final system output with regard to a parameter $$\omega_i$$ in $$f_i$$. To do so, we generally utilize the backward derivative propagation function +When using the backpropagation algorithm to train a neural network, we are more interested in figuring out the partial derivative of the final system output with regard to a parameter $$\omega_i$$ in $$f_i$$. To do so, we generally utilize the backward derivative propagation function $$\mathbb{B}[f_i] = f_i^{-1}(\frac{\partial Y}{\partial f_i}) = \frac{\partial Y}{\partial \mathbf{w}_i}$$ |
