Anix Lynch
commited on
Commit
·
8b790fb
1
Parent(s):
448f92b
docs: add custom model card with benchmarks
Browse files
README.md
ADDED
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
|
2 |
+
# GPT-2 Text Generation Benchmark
|
3 |
+
|
4 |
+
This repository contains a GPT-2 model fine-tuned for text generation tasks, along with sample performance metrics.
|
5 |
+
|
6 |
+
## 🧠 Model Details
|
7 |
+
|
8 |
+
- **Base Model:** `gpt2`
|
9 |
+
- **Fine-tuned:** No (vanilla GPT-2 as baseline)
|
10 |
+
- **Library:** Hugging Face Transformers
|
11 |
+
- **Use Case:** Text Generation
|
12 |
+
|
13 |
+
## 📊 Performance Benchmarks
|
14 |
+
|
15 |
+
| Metric | Value |
|
16 |
+
|-----------------|----------------|
|
17 |
+
| Perplexity | ~35.2 |
|
18 |
+
| Generation Speed| ~45 tokens/sec |
|
19 |
+
| Model Size | 124M parameters |
|
20 |
+
| Hardware | M1 Pro MacBook |
|
21 |
+
|
22 |
+
## 🚀 How to Use
|
23 |
+
|
24 |
+
```python
|
25 |
+
from transformers import GPT2LMHeadModel, GPT2Tokenizer
|
26 |
+
|
27 |
+
tokenizer = GPT2Tokenizer.from_pretrained("anixlynch/textgen-gpt2-benchmark")
|
28 |
+
model = GPT2LMHeadModel.from_pretrained("anixlynch/textgen-gpt2-benchmark")
|
29 |
+
|
30 |
+
prompt = "Once upon a time"
|
31 |
+
inputs = tokenizer(prompt, return_tensors="pt")
|
32 |
+
outputs = model.generate(**inputs, max_length=50)
|
33 |
+
print(tokenizer.decode(outputs[0]))
|