The checkpoint for [Self-Adjust Softmax](https://arxiv.org/abs/2502.18277)
Gausson Tschen
Gausson
AI & ML interests
LLM Architecture, Pre-training, Deep Neural Network Optimization, Sparsity
Organizations
models
9
Gausson/sep_cache
8B
•
Updated
•
7
•
1
Gausson/pythia-160m-deduped-n64-SepLLM
0.2B
•
Updated
•
9
Gausson/pythia-160m-deduped-n64h-SepLLM
0.2B
•
Updated
•
6
Gausson/pythia-160m-deduped-n64-StreamingLLM
0.2B
•
Updated
•
10
Gausson/pythia-160m-deduped-n64-RoBiPE-SepLLM
0.2B
•
Updated
•
9
Gausson/pythia-160m-deduped-n128-SepLLM
0.2B
•
Updated
•
5
Gausson/pythia-160m-deduped-SepLLM
0.2B
•
Updated
•
9
Gausson/pythia-160m-deduped-n64ht-SepLLM
0.2B
•
Updated
•
7
Gausson/gpt-neox-125m-deduped-SA
0.2B
•
Updated
•
12
datasets
0
None public yet