Methz M.1 Alpha
Exploration of a small decoder-only Transformer language model built with PyTorch.
- Tokenization
- Attention
- Training and evaluation

Two exploratory research initiatives, with milestones and results to be published when verified.
Exploration of a small decoder-only Transformer language model built with PyTorch.
Exploration of adapting a suitably licensed open-weight model for coding tasks.