梯度下降让参数沿梯度反方向小步移动,反复重算当前位置的方向,逐步减小损失。这是“模型怎样学”的第一幅完整动态图。Gradient descent moves parameters a small distance opposite the gradient, recomputes
direction, and gradually lowers loss. This is the first complete moving picture of how a
model learns.
01 · 大雾里下山01 · Descend through fog
看不见整条下山路线,只能每走一步重新摸脚下坡度,还能到谷底吗?If fog hides the full route and you can only recheck the slope after each step, can you
still reach the valley?
θ↓
02点“走一步”,让小球沿曲面下山Press “One Step” and Move Downhill
唯一变量:更新步数One variable: update steps
更新步Updates
0
steps
当前损失Current loss
—
L(θ)
梯度长度Gradient norm
—
‖∇L‖
正在加载曲面;若提示持续显示,则需要 WebGL /
three.js。Loading surface; if this remains visible, WebGL or three.js is unavailable.
梯度下降在每个新位置重算方向,并沿负梯度小步更新参数,让损失逐步降低。Gradient descent recomputes direction at every new position and takes small
negative-gradient parameter steps to lower loss.