GitHub topics: scaling-laws
huggingface/datablations
Scaling Data-Constrained Language Models
Language: Jupyter Notebook - Size: 43.4 MB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 335 - Forks: 18
RylanSchaeffer/KoyejoLab-Large-How-Do-Language-Monkey-Power-Get-Their-Power
Code for ICML 2025 How Do Large Language Monkeys Get Their Power (Laws)?
Language: Python - Size: 328 MB - Last synced at: 10 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0
LAION-AI/scaling-laws-openclip
Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
Language: Jupyter Notebook - Size: 1.44 MB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 166 - Forks: 12
benjaminnNgo/ScalingTGNs
Language: Python - Size: 267 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 0
I-Halder/scaling-law-of-large-language-models
We study scaling law of large languge models observing there is an optimal model size given a computational budget
Language: Python - Size: 410 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0
Qingrenn/TSFM-ScalingLaws
[ICLR 2025] Official implementation of "Towards Neural Scaling Laws for Time Series Foundation Models"
Language: Jupyter Notebook - Size: 546 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 7 - Forks: 1
whucs21Mzy/Model-Hemorrhage
Model Hemorrhage and the Robustness Limits of Large Language Models: A Perspective
Size: 775 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0
kyo-takano/chinchilla
A toolkit for scaling law research ⚖
Language: Python - Size: 6.68 MB - Last synced at: 8 days ago - Pushed at: 5 months ago - Stars: 49 - Forks: 4
machinelearningnuremberg/DPL
[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
Language: Python - Size: 13.7 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 3
KomeijiForce/Cuckoo
Cuckoo: A Series of IE Free Riders Using LLM's Resources to Scale up Themselves.
Language: Python - Size: 248 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 7 - Forks: 0
linhaowei1/Fine-tuning-Scaling-Law
🌹[ICML 2024] Selecting Large Language Model to Fine-tune via Rectified Scaling Law
Language: Python - Size: 5.04 MB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0
supersimple33/Scaling-Laws
A method for calculating scaling laws for LLMs from publicly available models
Language: Python - Size: 469 KB - Last synced at: about 17 hours ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 0
PV-Bhat/RSRC
RSRC Calculator is a practical tool designed to evaluate the efficiency of AI models in the post-scaling era: Recursive Self-Referential Compression (RSRC), this tool computes training efficiency metrics by analyzing factors such as training FLOPs, energy consumption, and model architecture details.
Language: Python - Size: 75.2 KB - Last synced at: 19 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
VITA-Group/Data-Efficient-Scaling
[ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
Language: Python - Size: 188 KB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 0
jennynzhuang/LLM_Scaling_Laws
Presentation on Scaling Laws for Neural Language Models
Language: Jupyter Notebook - Size: 1.51 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
wiifly/GhostCities
This is a repository containing the code, data, and visulizations that I made as a part of my senior capstone project
Language: Jupyter Notebook - Size: 37.3 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
CJReinforce/JOWA
Official code for the paper, "Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining"
Language: Python - Size: 97 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 0
SLAMPAI/large-scale-pretraining-transfer
Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)
Language: Jupyter Notebook - Size: 401 KB - Last synced at: about 1 month ago - Pushed at: about 3 years ago - Stars: 18 - Forks: 4
ArlindKadra/DPL
[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.
Language: Python - Size: 13.7 MB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0
tanaydesai/scaling-laws
Scaling laws web calculator to get a model's training compute flops, costs and energy utilization.
Language: JavaScript - Size: 355 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
christinakim/scaling-laws-for-language-transfer
code for Scaling Laws for Language Transfer Learning
Language: Python - Size: 19.7 MB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 1
upunaprosk/small-language-models
Code for CoNLL BabyLM workshop Mini Minds: Exploring Bebeshka and Zlata Baby Models
Language: Jupyter Notebook - Size: 72.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
xiaoyuxie-vico/PyDimension
Dimensionless learning codes for our paper called "Data-driven discovery of dimensionless numbers and governing laws from scarce measurements".
Language: Jupyter Notebook - Size: 5.72 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 4
