Skip to content
This repository was archived by the owner on Jan 24, 2024. It is now read-only.
This repository was archived by the owner on Jan 24, 2024. It is now read-only.

可以自定义分词器吗？还是必须自己重写Reader?ಥ_ಥ #83

Open
Open
可以自定义分词器吗？还是必须自己重写Reader?ಥ_ಥ#83
@yang9112

Description

@yang9112
yang9112
opened on Jun 17, 2020

看到分词部分默认是英文的，包括可选项也只有’wordpiece‘，ಥ_ಥ，用起来确实比tf方便，但是定制方面好像没有太多可指导的demo~

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions