Local LLMs

[PCK1992]

Hi Kaicheng,

Thank you, this is super helpful! Considering data privacy issues and the emergence of really powerful small models I think a tutorial for using local LLMs would be very useful. I've experimented with this software https://github.com/oobabooga/text-generation-webui and it's great as a start but I think some tutorial that incorporates batch processing etc. would be super useful for many people!

[yang3kc]

Thank you for sharing this resource. I will definitely look into it and try to incorporate it into my tutorial once I have some firsthand experience.

Additionally, thank you for your contribution to the community!