Skip to content

Recent changes break code #22

@andrewpeng02

Description

@andrewpeng02

Hi, this commit change breaks generation, eval, and likely other scripts because in transformers v4.46, position_embeddings is a required field, but it isn't passed in forward_early or forward_remaining. See https://github.com/huggingface/transformers/blob/53fad641cfdb5105e2470bcf3ef17ea8e25cc300/src/transformers/models/llama/modeling_llama.py#L369

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions