Skip to content

Latest commit

 

History

History
5 lines (3 loc) · 254 Bytes

File metadata and controls

5 lines (3 loc) · 254 Bytes

Decoder_model

Decoder model for language modelling.

This repository serves educational purposes only. Here I try to recreate a decoder-only model of the transformer architecture from scratch. It includes a model itself as well as training mechanisms