---
license: apache-2.0
language:
- en
tags:
- logic
---
# TinyGPT (Minimal) — Colab A100 Run

- Tokens: TinyStories 10%
- Context: 512
- Dim: 512
- Layers: 6
- Heads: 8
- Files: `model.safetensors`, `pytorch_model.bin`, `tokenizer.json`, `config.json`


A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior.