AI RESEARCH

Exploring intelligent systems.

Two exploratory research initiatives, with milestones and results to be published when verified.

Methz M.1 Alpha

Exploration of a small decoder-only Transformer language model built with PyTorch.

  • Tokenization
  • Attention
  • Training and evaluation

Methz M.1 Code

Exploration of adapting a suitably licensed open-weight model for coding tasks.

  • LoRA / QLoRA
  • Code fine-tuning
  • Coding benchmarks