diff options
| author | Yong He <yonghe@outlook.com> | 2023-02-11 13:30:18 -0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-02-11 13:30:18 -0800 |
| commit | 77706b7e77b206a9f73fdf5f0fd69149931b8bf9 (patch) | |
| tree | e35cf650dcc3875499844a0fc9cc295c36fa30e3 /docs/user-guide | |
| parent | 5bab4ead221b9e7637b541e9a35687aa990e8599 (diff) | |
Update 07-autodiff.md
Diffstat (limited to 'docs/user-guide')
| -rw-r--r-- | docs/user-guide/07-autodiff.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/docs/user-guide/07-autodiff.md b/docs/user-guide/07-autodiff.md index ad031bc07..5ca073983 100644 --- a/docs/user-guide/07-autodiff.md +++ b/docs/user-guide/07-autodiff.md @@ -387,7 +387,7 @@ DifferentialPair<R> derivative(DifferentialPair<T0> p0, inout DifferentialPair<T A backward derivative propagation function propagates the derivative of the function output to all the input parameters simultaneously. -Given an orignal function `f`, the general rule for determining the signature of its backward propagation function is that a differentiable output `o` becomes an input parameter holding the partial derivative of a downstream output with regard to the this differentiable output, i.e. $$\partial y/\partial o\$$); an input differentiable parameter `i` in the original function will become an output in the backward propagation function, holding the propagated partial derivative $$\partial y/\partial i$$; and any non-differentiable outputs are dropped from the backward propagation function. This means that the backward propagation function never returns any values computed in the original function. +Given an orignal function `f`, the general rule for determining the signature of its backward propagation function is that a differentiable output `o` becomes an input parameter holding the partial derivative of a downstream output with regard to the this differentiable output, i.e. $$\partial y/\partial o$$); an input differentiable parameter `i` in the original function will become an output in the backward propagation function, holding the propagated partial derivative $$\partial y/\partial i$$; and any non-differentiable outputs are dropped from the backward propagation function. This means that the backward propagation function never returns any values computed in the original function. More specifically, the signature of its backward propagation function is determined using the following rules: - A backward propagation function always returns `void`. |