Used makemore to build a cursive handwriting model

[greydanus]

Hi Andrej,

I wanted to share that, with a few judicious modifications to the Transformer code in makemore.py (in particular, a custom tokenizer as shown in the image + cross attention for ascii characters), I was able to train a rather high-quality pen-stroke cursive generation model.

Blog post

Thanks for writing the makemore + mingpt + nanogpt repos; they are wonderful, minimalist starting points for this kind of light exploratory research/hobby project.

[Rishik00]

THATS SOO COOL, imma try to recreate this.

[ryanyogan]

Thanks for the blog post, awesome stuff!