Mamram Language Modelling Workshop The materials for Yotam's Language Modelling lecture at Mamaram Lecture slides Language Models - The Hidden Secrets (PDF) Notebooks Notebook File Description Google Colab Train_a_language_model.ipynb Notebook for training a custom language model. gpt4_api.ipynb Demonstrates how to use GPT-4 API for various tasks. tokenizers.ipynb Covers different types of tokenizers in NLP. AutoGPTQ_transformers.ipynb Extra: Notebook to experiment with AutoGPTQ and transformers.