scaling-laws | Topic | Ecosyste.ms: Repos

Topic: "scaling-laws"

huggingface/datablations

Scaling Data-Constrained Language Models

Language: Jupyter Notebook - Size: 43.4 MB - Last synced at: 2 days ago - Pushed at: 7 months ago - Stars: 334 - Forks: 19

LAION-AI/scaling-laws-openclip

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Language: Jupyter Notebook - Size: 1.44 MB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 135 - Forks: 11

kyo-takano/chinchilla

A toolkit for scaling law research ⚖

Language: Python - Size: 6.68 MB - Last synced at: 15 days ago - Pushed at: 3 months ago - Stars: 49 - Forks: 4

xiaoyuxie-vico/PyDimension

Dimensionless learning codes for our paper called "Data-driven discovery of dimensionless numbers and governing laws from scarce measurements".

Language: Jupyter Notebook - Size: 5.72 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 4

SLAMPAI/large-scale-pretraining-transfer

Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training on full and few-shot transfer learning for natural and medical images" (https://arxiv.org/abs/2106.00116)

Language: Jupyter Notebook - Size: 401 KB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 18 - Forks: 4

machinelearningnuremberg/DPL

[NeurIPS 2023] Multi-fidelity hyperparameter optimization with deep power laws that achieves state-of-the-art results across diverse benchmarks.

Language: Python - Size: 13.7 MB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 3

VITA-Group/Data-Efficient-Scaling

[ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang

Language: Python - Size: 188 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 0

CJReinforce/JOWA

Official code for the paper, "Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining"

Language: Python - Size: 97 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 10 - Forks: 0

supersimple33/Scaling-Laws

A method for calculating scaling laws for LLMs from publicly available models

Language: Python - Size: 469 KB - Last synced at: 3 days ago - Pushed at: 12 months ago - Stars: 9 - Forks: 0

Qingrenn/TSFM-ScalingLaws

[ICLR 2025] Official implementation of "Towards Neural Scaling Laws for Time Series Foundation Models"

Language: Jupyter Notebook - Size: 546 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 7 - Forks: 1

benjaminnNgo/ScalingTGNs

Language: Python - Size: 265 MB - Last synced at: 22 days ago - Pushed at: 23 days ago - Stars: 7 - Forks: 0

KomeijiForce/Cuckoo

Cuckoo: A Series of IE Free Riders Using LLM's Resources to Scale up Themselves.

Language: Python - Size: 248 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 7 - Forks: 0

christinakim/scaling-laws-for-language-transfer

code for Scaling Laws for Language Transfer Learning

Language: Python - Size: 19.7 MB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 1

linhaowei1/Fine-tuning-Scaling-Law

🌹[ICML 2024] Selecting Large Language Model to Fine-tune via Rectified Scaling Law

Language: Python - Size: 5.04 MB - Last synced at: 17 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

whucs21Mzy/Model-Hemorrhage

Model Hemorrhage and the Robustness Limits of Large Language Models: A Perspective

Size: 775 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 1 - Forks: 0

PV-Bhat/RSRC

RSRC Calculator is a practical tool designed to evaluate the efficiency of AI models in the post-scaling era: Recursive Self-Referential Compression (RSRC), this tool computes training efficiency metrics by analyzing factors such as training FLOPs, energy consumption, and model architecture details.

Language: Python - Size: 75.2 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0