Bounded Oracle Error in Nonconvex Stochastic Optimization
Arjevani et al. asked whether almost-surely bounded oracle error permits a better rate than bounded variance for smooth nonconvex stochastic optimization. It does not: every randomized adaptive algorithm still needs Omega(dL/eps^2 + dL sigma^2/eps^4) queries, matching the standard upper bound.