GitHub topics: gradient-descent

Repositories

clay-arras/lamp

💡 fast and lightweight machine learning framework in cpp, supporting tensors and autograd. includes implementations of basic neural networks

Language: C++ - Size: 877 KB - Last synced at: about 2 hours ago - Pushed at: about 3 hours ago - Stars: 2 - Forks: 0

LuisFelipePoma/Machine_Learning

Learning about the algorithms used in machine learning, along with techniques for training and testing models.

Language: Jupyter Notebook - Size: 17.3 MB - Last synced at: about 4 hours ago - Pushed at: about 5 hours ago - Stars: 2 - Forks: 0

cosmoimd/feature-selection-gates

Feature Selection Gates with Gradient Routing

Language: Python - Size: 25.5 MB - Last synced at: about 9 hours ago - Pushed at: about 9 hours ago - Stars: 4 - Forks: 0

DmitriBogdanov/mathematica-optimization-methods

Reference implementations of 22 optimization methods from 8 different families in Wolfram Mathematica

Language: Mathematica - Size: 2.96 MB - Last synced at: about 11 hours ago - Pushed at: about 11 hours ago - Stars: 0 - Forks: 0

ameritusweb/ParallelReverseAutoDiff

Parallel Reverse Mode Automatic Differentiation in C# for Custom Neural Network Development

Language: C# - Size: 114 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 8 - Forks: 1

ViktorAJStein/Accelerated_Stein_Variational_Gradient_Flows

Accelerated Stein Variational Gradient Descent for sampling for densities

Language: Python - Size: 3.25 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

inikishev/torchzero

Modular optimization library for PyTorch.

Language: Python - Size: 1.4 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 0

aangelopoulos/gradient-equilibrium

Gradient Equilibrium in Online Learning: Theory and Applications

Language: Jupyter Notebook - Size: 91.3 MB - Last synced at: 1 day ago - Pushed at: 3 days ago - Stars: 8 - Forks: 2

ostad-ai/Machine-Learning

This repository contains topics and codes related to Machine Learning and Data Science, especially in Python

Language: Jupyter Notebook - Size: 2.16 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 3 - Forks: 0

cvanaret/Uno

A next-gen Lagrange-Newton (SQP + barrier) solver for nonconvex constrained optimization

Language: C++ - Size: 44.6 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 328 - Forks: 26

stdlib-js/ml-incr-sgd-regression

Online regression via stochastic gradient descent (SGD).

Language: JavaScript - Size: 2.45 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 6 - Forks: 0

haroontrailblazer/Machine_Learning

About This Repository A curated resource hub for learning machine learning, featuring tutorials, code examples, datasets, and hands-on projects to build foundational skills and explore real-world applications.

Language: Python - Size: 19.5 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

Jedrzej-Wydra/nonlinear-problem-linear-solution

Approximating a sine function with sliding-window linear models — sometimes, straight lines really are enough.

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

Ryota-Kawamura/Mathematics-for-Machine-Learning-and-Data-Science-Specialization

Master the Toolkit of AI and Machine Learning. Mathematics for Machine Learning and Data Science is a beginner-friendly Specialization where you’ll learn the fundamental mathematics toolkit of machine learning: calculus, linear algebra, statistics, and probability.

Language: Jupyter Notebook - Size: 82.9 MB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 511 - Forks: 231

Hemanthsp999/c-net

Language: C - Size: 7.81 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

ranja-sarkar/GD

Gradient descent algorithm to optimize a linear regression model.

Language: Jupyter Notebook - Size: 2.28 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 1 - Forks: 0

DanielMPMatCom/Detecting-Interactions.-JCE-MatCom

Research on the interactions of a chorus of Eleutherodactylus eileenae. Modeling the biological system using the Ising Model to infer interaction parameters with Gradient Descent.

Language: TeX - Size: 6.99 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

mbeps/custom-neural-network-classifier

The project implements a neural network classifier with advanced techniques like batch normalisation, dropout, and gradient clipping to control Pacman's movements based on the game state. This is a coursework for the Machine Learning (6CCS3ML1) module for King's College London.

Language: Python - Size: 294 KB - Last synced at: 4 days ago - Pushed at: 12 days ago - Stars: 1 - Forks: 0

stdlib-js/ml-incr-binary-classification

Incrementally perform binary classification using stochastic gradient descent (SGD).

Language: JavaScript - Size: 2.72 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 6 - Forks: 0

IEEE-FCIH-SB/Machine-Learning-Content-2025

Here is the content of ML committe in season 2025

Language: Jupyter Notebook - Size: 36.5 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 6 - Forks: 0

D0gmaDev/ias-2024

IAS 2024 est un projet de génération de planning de garde en service hospitalier.

Language: Python - Size: 1.58 MB - Last synced at: 6 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

baohuyvanba/Machine-Learning

Implementations of various machine learning algorithms, covering both library-based and from-scratch approaches.

Language: Jupyter Notebook - Size: 24.8 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

gligli/VinylScan

Play audio from a vinyl record scanned using a flatbed scanner (>= 2400 DPI)

Language: C++ - Size: 176 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 3 - Forks: 0

KBavis/scrape-and-score

Linear regression & neural network based models to predict fantasy football points for NFL players based on various metrics for a given NFL season.

Language: Python - Size: 7.1 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

arsenyturin/SGD-From-Scratch

Stochastic gradient descent from scratch for linear regression

Language: Jupyter Notebook - Size: 23 MB - Last synced at: 11 days ago - Pushed at: almost 2 years ago - Stars: 40 - Forks: 17

hahnec/torchimize

numerical optimization in pytorch

Language: Python - Size: 20.4 MB - Last synced at: 1 day ago - Pushed at: 12 months ago - Stars: 136 - Forks: 6

Ameobea/neural-network-from-scratch

A neural network library written from scratch in Rust along with a web-based application for building + training neural networks + visualizing their outputs

Language: Rust - Size: 1.73 MB - Last synced at: 13 days ago - Pushed at: 7 months ago - Stars: 133 - Forks: 12

MahdiKh03/House-prices-linear-regression-scratch

A machine learning project to implement linear regression from scratch, including a basic implementation of gradient descent, on the house prices dataset.

Language: Jupyter Notebook - Size: 144 KB - Last synced at: 2 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 0

google/neural-tangents

Fast and Easy Infinite Neural Networks in Python

Language: Jupyter Notebook - Size: 10.4 MB - Last synced at: 21 days ago - Pushed at: about 1 year ago - Stars: 2,332 - Forks: 229

Tszon/BSc_Astrophysics_Projects

These are all the astrophysics projects in my final year. My final-year project focuses on orbital transfer optimisation using gradient descent and the Markov Chain Monte Carlo method for uncertainty evaluation.

Language: Jupyter Notebook - Size: 14.1 MB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0

999ashu/Advanced-Optimization-Methods

Advanced algorithms laboratory work of ITMO CT optimization course.

Language: Jupyter Notebook - Size: 28.6 MB - Last synced at: 16 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

leonardocrociani/Neural-Network

A neural network implemented from scratch. Fully parametrizable, validation methods included.

Language: Python - Size: 11.9 MB - Last synced at: 23 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0

doccstat/fastcpd

Fast Change Point Detection in R

Language: C++ - Size: 96.2 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 21 - Forks: 1

sethubolt7/ML_SUPERVISED_LEARNING_PROJECTS

Mathematical implementation of supervised learning and gradient descent from scratch using Python and NumPy.

Language: Jupyter Notebook - Size: 300 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

m-clark/models-by-example

By-hand code for models and algorithms. An update to the 'Miscellaneous-R-Code' repo.

Language: R - Size: 26.2 MB - Last synced at: 11 days ago - Pushed at: over 4 years ago - Stars: 68 - Forks: 18

verse-chorus/NumericalMethodsSPbU

Реализация на Python, Java, C++ всех лабораторных работ к курсу численных методов ПМ-ПУ СПбГУ, 2-3 курсы.

Language: Jupyter Notebook - Size: 16.7 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 3 - Forks: 1

mehmoodulhaq570/Machine-Learning-Models

A repository consisting of machine learning models for predicting the future instance. More specifically this repository is a Machine Learning course for those who are interested in learning the basics of machine learning algorithms.

Language: Jupyter Notebook - Size: 29.9 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 5 - Forks: 0

gorgonia/gorgonia

Gorgonia is a library that helps facilitate machine learning in Go.

Language: Go - Size: 88.7 MB - Last synced at: 27 days ago - Pushed at: 9 months ago - Stars: 5,731 - Forks: 442

dillikadariya/ML-Experimentation-with-Gradient-Descent-Algorithm

Machine Learning project that implement Gradient Descent Algorithm in a linear regression model

Language: Python - Size: 270 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

MatthiasNickles/Diff-ASP-Propagators

Proof of concept approach to Differentiable Answer Set Programming and Differentiable Satisfiability, for sampling and multimodel optimization. For Clingo (https://potassco.org/) + Python

Language: Answer Set Programming - Size: 24.4 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 3 - Forks: 0

NekkittAY/MAMGD_Optimizer

Gradient optimization method using exponential damping and second-order discrete derivative for neural networks and multidimensional real functions

Language: Jupyter Notebook - Size: 2.02 MB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

18520339/nn-auto-differentiation-engine

Pure C++17 end-to-end Neural Network framework to facilitate the construction, training, and evaluation of custom model architectures with a collection of preprocessing utilities and built-in autograd components

Language: C++ - Size: 197 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

YousefAlaaAli/Gradient-descent

A practical comparison of gradient descent algorithms to predict student performance using study and lifestyle data, with visual analysis.

Language: Jupyter Notebook - Size: 556 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0

kryvokhyzha/gradient-descent 📦

Implementation of gradient descent in python

Language: Jupyter Notebook - Size: 7.56 MB - Last synced at: 20 days ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

palle-k/DL4S

Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux

Language: Swift - Size: 19.5 MB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 107 - Forks: 13

DrSolidDevil/mlr-gd

Multiple linear regression by gradient descent.

Language: Python - Size: 229 KB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0

SimpleArt/spsa

A simple implementation of SPSA with automatic learning rate tuning

Language: Python - Size: 220 KB - Last synced at: 26 days ago - Pushed at: almost 3 years ago - Stars: 33 - Forks: 0

VuBacktracking/Coursera-Machine-Learning-Specialization

Contains Optional Labs and Solutions of Programming Assignment for the Machine Learning Specialization By Stanford University and Deeplearning.ai - Coursera (2023) by Prof. Andrew NG

Language: Jupyter Notebook - Size: 35.4 MB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 18

ikostrikov/pytorch-meta-optimizer

A PyTorch implementation of Learning to learn by gradient descent by gradient descent

Language: Python - Size: 17.6 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 313 - Forks: 53

Samarth4023/Calculus

📚 Calculus - Welcome to the Calculus repository! This collection is designed to help you understand and apply various calculus concepts that are essential for machine learning, data science, and beyond. Whether you are a student, a researcher, or just curious about calculus, you'll find valuable resources here.

Language: Jupyter Notebook - Size: 4.58 MB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 0

kthohr/optim

OptimLib: a lightweight C++ library of numerical optimization methods for nonlinear functions

Language: C++ - Size: 11.7 MB - Last synced at: 28 days ago - Pushed at: about 1 year ago - Stars: 847 - Forks: 139

mstksg/backprop

Heterogeneous automatic differentiation ("backpropagation") in Haskell

Language: Haskell - Size: 11.1 MB - Last synced at: 17 days ago - Pushed at: 10 months ago - Stars: 187 - Forks: 22

perseus784/Multi-Robot_Exploration

This project shows the area division process in Multi-Agent exploration using Cyclic Gradient Descent and also how Cooperative Perceptional Messages are used in V2V communication to share information among agents in about the environment.

Language: Python - Size: 2.9 MB - Last synced at: 5 days ago - Pushed at: over 4 years ago - Stars: 41 - Forks: 11

foolnotion/lbfgs

Modern C++ port of the Limited-memory BFGS (L-BFGS) optimization algorithm

Language: C++ - Size: 41 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

voletiv/myPythonNeuralNetwork

A neural network class in Python built from scratch

Language: Jupyter Notebook - Size: 1.71 MB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 9 - Forks: 9

avik-pal/RayTracer.jl

Differentiable RayTracing in Julia

Language: Julia - Size: 34.9 MB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 152 - Forks: 12

Sergio0694/NeuralNetwork.NET

A TensorFlow-inspired neural network library built from scratch in C# 7.3 for .NET Standard 2.0, with GPU support through cuDNN

Language: C# - Size: 13.1 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 556 - Forks: 88

omdxp/Quasi-Newton

A matlab function for steepest descent optimization using Quasi Newton's method : BGFS & DFP

Language: MATLAB - Size: 9.77 KB - Last synced at: 17 days ago - Pushed at: about 6 years ago - Stars: 8 - Forks: 2

Suji04/ML_from_Scratch

Implementation of basic ML algorithms from scratch in python...

Language: Jupyter Notebook - Size: 540 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 293 - Forks: 229

arthurdjn/nets

Recreating PyTorch from scratch, using Numpy. Supports FCN, CNN, RNN layers.

Language: Python - Size: 10.7 MB - Last synced at: 23 days ago - Pushed at: about 4 years ago - Stars: 34 - Forks: 4

cookepm/elo-grad

Extended Elo rating system implementation based on the equivalence with logistic regression.

Language: Python - Size: 2.99 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Lucifier129/simple-machine-learning-demo

simple machine learning demo

Language: JavaScript - Size: 25.4 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 65 - Forks: 3

rajaddr/simpliml

SimpliML is a versatile machine learning library designed to be a one-stop solution for the entire data lifecycle. Whether you're preparing raw data or deploying advanced predictive models, SimpliML simplifies every step of the machine learning process

Language: Python - Size: 92.8 KB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

SnPreethi/NeuralNets_From_Scratch

A simple NN built from scratch using NumPy to recognize handwritten digits from the MNIST dataset, implementing forward and backward propagation, gradient descent, and activation functions (ReLU & Softmax).

Language: Jupyter Notebook - Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

insdout/ML-Algorithms-From-Scratch

Implementations of main Machine Learning Agorithms from scratch: Gaussian Mixture Model, Gradient Boosting, Adam, RMSProp, PCA, QR, Eigendecomposition, Decision Trees etc.

Language: Jupyter Notebook - Size: 70 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

KMORaza/Antenna_Optimization_using_Gradient-Descent

Antennenoptimierung mittels Gradientenabstieg (Antenna Optimization using Gradient Descent)

Language: Scilab - Size: 115 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

NeuralAditya/Linear_Regression_C

Linear regression implementation in pure C

Language: C - Size: 169 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

42-Course/ft_linear_regression

An implementation of a Linear gradient descent in rust

Language: Rust - Size: 560 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

ivotints/ft_linear_regression

A Python implementation of linear regression from scratch that predicts car prices based on mileage. Features gradient descent optimization, interactive visualizations, data normalization, and comprehensive model evaluation metrics.

Language: Python - Size: 1.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

999ashu/Zero-First-Order-Optimization-Methods

Algorithms of zero and first order laboratory work of ITMO CT optimization course.

Language: Jupyter Notebook - Size: 25.1 MB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

djdhairya/Diabetes-Prediction

Language: Jupyter Notebook - Size: 2.52 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Mathmode/Optimizing-VPINNs-Using-LS

Pieces of code for the experiments described in the manuscript "Optimizing Variational Physics-Informed Neural Networks Using Least Squares", available at https://arxiv.org/pdf/2407.20417.

Language: Python - Size: 173 MB - Last synced at: 28 days ago - Pushed at: 6 months ago - Stars: 3 - Forks: 0

s-marton/GRANDE

(ICLR 2024) GRANDE: Gradient-Based Decision Tree Ensembles

Language: Jupyter Notebook - Size: 9.74 MB - Last synced at: 22 days ago - Pushed at: about 2 months ago - Stars: 89 - Forks: 9

emilwallner/Deep-Learning-From-Scratch

Six snippets of code that made deep learning what it is today.

Language: Jupyter Notebook - Size: 10.9 MB - Last synced at: 3 days ago - Pushed at: over 5 years ago - Stars: 261 - Forks: 57

jnclink/Custom-NN

Custom implementation of a neural network from scratch using Python

Language: Python - Size: 3.74 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

krishnakumarsekar/awesome-machine-learning-deep-learning-mathematics

A curated list of mathematics documents ,Concepts, Study Materials , Algorithms and Codes available across the internet for machine learning and deep learning

Size: 6.84 KB - Last synced at: 10 days ago - Pushed at: over 7 years ago - Stars: 215 - Forks: 62

azimonti/MNIST-classification

Neural network training for MNIST digit classification using SGD and GA

Language: C++ - Size: 37.1 KB - Last synced at: 10 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

derinworks/penr-oz-neural-network

Neural Network Microservice for understanding training process

Language: Python - Size: 89.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

derinworks/penr-oz-neural-network-auto-gradients

Implementation of Neural Network service with automatic gradient calculations

Language: Python - Size: 75.2 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

breandan/kotlingrad

🧩 Shape-Safe Symbolic Differentiation with Algebraic Data Types

Language: Kotlin - Size: 288 MB - Last synced at: 26 days ago - Pushed at: 5 months ago - Stars: 534 - Forks: 21

nickbrazeau/discent

Gradient descent for estimating inbreeding spatial coefficients from pairwise-IBD estimates

Language: C++ - Size: 21.9 MB - Last synced at: 21 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

ndeybach/gaussian-gradient-descent-3DGRT

Repo for the article: "Complete explanations on the gradient descent for a 3D gaussian ray traced, 3D reconstruction algorithm."

Language: HTML - Size: 15.4 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

kunalPisolkar24/gradientDescent

A Python implementation of gradient descent for linear regression, visualized with cost function history, parameter trajectory, and a 3D cost surface.

Language: Jupyter Notebook - Size: 239 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

gy910210/neural-network-from-scratch

Implementing Multiple Layer Neural Network from Scratch

Language: Python - Size: 244 KB - Last synced at: 9 days ago - Pushed at: about 9 years ago - Stars: 319 - Forks: 91

oliverharboe/NeuralNetwork_From_Scratch

NeuralNetwork build from scrath using python and numpy

Language: Python - Size: 9.43 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

bharathsudharsan/ML-MCU

Code for IoT Journal paper 'ML-MCU: A Framework to Train ML Classifiers on MCU-based IoT Edge Devices'

Language: C - Size: 886 KB - Last synced at: 17 days ago - Pushed at: over 2 years ago - Stars: 46 - Forks: 8

fr3fou/gone

neural network library in go from scratch

Language: Go - Size: 185 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 38 - Forks: 2

josephcheel/42-ft_linear_regression

This project implements linear regression using a dataset to predict a dependent variable based on an independent variable. It involves data preprocessing, making predictions, and visualizing results using matplotlib. The final output is a scatter plot with a fitted regression line, showcasing the model’s accuracy.

Language: Python - Size: 5 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0