Pretraining Playground

AI & ML interests

None defined yet.

Recent Activity

rdiehlmartinez  updated a dataset 3 days ago

pretraining-playground/pythia-training-metrics

rdiehlmartinez  authored a paper 9 months ago

CLIMB: Curriculum Learning for Infant-inspired Model Building

rdiehlmartinez  authored a paper 9 months ago

Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing

View all activity

Team members 1