second-order-optimization 33 optimization-algorithms 9 deep-learning 9 pytorch 6 optimization 5 optimizer 4 hessian-free 4 newton-method 4 low-rank-approximation 3 hessian-vector-product 3 stochastic-gradient-descent 3 federated-learning 3 stochastic-optimization 3 hessian 3 gradient-descent 3 newtons-method 2 tensorflow 2 pytorch-implementation 2 preconditioner 2 big-data 2 stochastic-optimizers 2 lie-groups 2 affine-group 2 adahessian 2 jax 2 fedl 2 kfac 2 sampling-methods 1 riemannian-optimization 1 riemannian-manifold 1 riemannian-geometry 1 large-scale-optimizations 1 sub-sampling 1 gradient-descent-algorithm 1 julia 1 federated-edge-learning 1 done 1 triangle-mesh 1 siggraph2022 1 siggraph 1 parameterization 1 intrinsic-triangulation 1 inter-surface-mapping 1 geometry-processing 1 cross-parameterization 1 computer-graphics 1 compatible-triangulation 1 bijective-maps 1 bijection 1 optimization-methods 1 natural-gradients 1 fisher 1 non-convex-optimization 1 mnist 1 machine-le 1 cross-validation-selection 1 bayesian-model-selection 1 training-algorithm 1 second-order-stationary-points 1 plateaus 1 negative-curvature-directions 1 multilayer-neural-networks 1 proximal-algorithms 1 nonconvex 1 matrix-factorization 1 matrix-completion 1 low-rank-matrix-recovery 1 low-rank-factorization 1 global-optimization 1 alternating-optimization 1 alternating-minimization 1 quasi-newton-method 1 quasi-newton 1 regression 1 python 1 classification 1 trust-region 1 subsample 1 dane 1 pytorch-optimizers 1 high-order-methods 1 damped-netwon 1 optimization-problem 1 mathematical-programming 1 cutting-plane 1 semidefinite-programming 1 matrix-estimation 1 matrix-approximation 1 financial-risk-management 1 active-set-methods 1 matrix-free 1 ggn 1 deep-neural-networks 1 conjugate-gradient 1 neural-networks 1 backpropagation-algorithm 1 reinforcement-learning 1 machine-learning 1 awesome 1 second-order 1