next token embedding was not used #293
Description
In the training script, it seems that the next token embedding was not used to predict the next next token during the multi-step prediction calculation of loss.
{{ message }}
In the training script, it seems that the next token embedding was not used to predict the next next token during the multi-step prediction calculation of loss.