Skip to content

Latest commit

 

History

History
18 lines (9 loc) · 294 Bytes

README.md

File metadata and controls

18 lines (9 loc) · 294 Bytes

moGPT

Building my first GPT model.

A statitican journey to master GPT models.

First step, load shakespeare data

python  python data/get_data.py

This would load a training data which has 301,966 tokens, and validation data with 36,059 tokens.

preparing the model