random-guest/Hessian-Free-Gradient-Flow-Algorithm

An optimization algorithm for deep neural networks.

Language: MATLAB - Size: 33.2 KB - Last synced: 7 days ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

amirgholami/PyHessian

PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks

Language: Jupyter Notebook - Size: 2.05 MB - Last synced: 10 days ago - Pushed: about 1 month ago - Stars: 629 - Forks: 111

rharish101/CS771-Project 📦

Course project for CS771A: Introduction to Machine Learning

Language: Python - Size: 850 KB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 1 - Forks: 1

shizheng-rlfresh/llm-opt

Fine-tuning LLMs with LoRA and Hessian-free optimizers

Language: Python - Size: 166 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0

ltatzel/PyTorchHessianFree

PyTorch implementation of the Hessian-free optimizer

Language: Python - Size: 141 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 26 - Forks: 3

amirgholami/adahessian

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Language: Python - Size: 1.95 MB - Last synced: 7 months ago - Pushed: about 1 year ago - Stars: 225 - Forks: 47

ozzzp/MLHF

Tensorflow implement of Meta Learning with Hessian Free Approach in Deep Neural Nets Training

Language: Python - Size: 101 KB - Last synced: 7 months ago - Pushed: over 5 years ago - Stars: 1 - Forks: 1

yorkerlin/StructuredNGD-DL

Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning

Language: Python - Size: 40 KB - Last synced: 9 months ago - Pushed: 10 months ago - Stars: 1 - Forks: 0

fmeirinhos/pytorch-hessianfree

PyTorch implementation of Hessian Free optimisation

Language: Python - Size: 54.7 KB - Last synced: over 1 year ago - Pushed: over 4 years ago - Stars: 34 - Forks: 9

Tismoney/HessianFree

On the New method of Hessian-free second-order optimization

Language: Jupyter Notebook - Size: 4.66 MB - Last synced: 10 months ago - Pushed: almost 4 years ago - Stars: 9 - Forks: 0

onopkosonja/OptimizationMethods

Implementation of numerical optimization algorithms for logistic regression problem.

Language: Python - Size: 37.1 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 2 - Forks: 0

mtkwT/adaptive-hessian-free-optimization

Implementation of Adaptive Hessian-free optimization.

Language: Python - Size: 465 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

adelekuzmiakova/large-scale-numerical-optimization

Language: TeX - Size: 1.59 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 0 - Forks: 1