Pretraining Playground

university

https://github.com/rdiehlmartinez/pretraining-playground

AI & ML interests

None defined yet.

Recent Activity

rdiehlmartinez updated a dataset 4 days ago

pretraining-playground/pythia-training-metrics

rdiehlmartinez authored a paper 9 months ago

CLIMB: Curriculum Learning for Infant-inspired Model Building

rdiehlmartinez authored a paper 9 months ago

Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing

View all activity

pretraining-playground 's models

None public yet