From 38314ddc36224563e2d5b1f068c1b0d6a4b905bc Mon Sep 17 00:00:00 2001 From: I-Jong Lin Date: Wed, 19 Oct 2022 22:17:41 -0700 Subject: [PATCH] Tiyaro Support Changes --- README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/README.md b/README.md index 5678c80..1eb8b65 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,10 @@ # T-Zero +

+ +

+ + This repository serves primarily as codebase and instructions for training, evaluation and inference of T0. T0 is the model developed in [Multitask Prompted Training Enables Zero-Shot Task Generalization](https://arxiv.org/abs/2110.08207). In this paper, we demonstrate that massive multitask prompted fine-tuning is extremely effective to obtain task zero-shot generalization. T0 outperforms or matches GPT-3 while being 16x smaller.