Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: decoder-only

microsoft/encoder-decoder-slm

Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and vision-language capabilities

Language: Python - Size: 966 KB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 23 - Forks: 1

cisnlp/MEXA

🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment

Language: Python - Size: 26.4 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 10 - Forks: 0

liaoyanqing666/Decoder-only-transformer_Time_Series_Prediction

使用Decoder-only的Transformer进行时序预测，包含SwiGLU和RoPE(Rotary Positional Embedding)，Time series prediction using Decoder-only Transformer, Including SwiGLU and RoPE(Rotary Positional Embedding)

Language: Python - Size: 31.3 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

egesualp/growth-vs-forgetting

This repository contains the implementation and experiments for comparing gradual growth methods, specifically the G_stack approach, with naive models trained from scratch. The project focuses on addressing catastrophic forgetting and improving model performance in continuous learning scenarios.

Language: Shell - Size: 21 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Related Keywords
decoder-only 4 llm 2 stacking-llm 1 model-growth 1 inference 1 catastrophic-forgetting 1 transformer 1 time-series-prediction 1 time-series 1 swiglu 1 rotary-positional-embedding 1 rope 1 pytorch 1 multilingual-nlp 1 multilingual 1 large-language-models 1 evaluation-metrics 1 evaluation 1 embeddings 1 cross-lingual 1 vision-and-language 1 encoder-decoder 1