Lower Bounds for Stepsize-Based Acceleration of Gradient Descent
Recorded as partial: the bound is Omega(T^-1.9319) against an achievable O(T^-1.2716), so it rules out reaching the optimal rate without pinning down the true one.
algorithms-optimization / Convex optimization
Carefully designed stepsize schedules alone accelerate plain gradient descent beyond its textbook O(1/T) rate, without momentum. Whether they can reach the optimal O(T^-2) was open. A lower bound of Omega(T^-1.9319) for last-iterate convergence under predetermined nonnegative stepsize schedules says they cannot.
Temporal state
No reconciled state yet.
Append-only history
Recorded as partial: the bound is Omega(T^-1.9319) against an achievable O(T^-1.2716), so it rules out reaching the optimal rate without pinning down the true one.
Research memory
Carefully designed stepsize schedules alone accelerate plain gradient descent beyond its textbook O(1/T) rate, without momentum. Whether they can reach the optimal O(T^-2) was open. A lower bound of Omega(T^-1.9319) for last-iterate convergence under predetermined nonnegative stepsize schedules says they cannot.
Recorded as partial: the bound is Omega(T^-1.9319) against an achievable O(T^-1.2716), so it rules out reaching the optimal rate without pinning down the true one.
Evidence graph
No public relationships recorded yet.