huggingface下载的数据有点大 #82

Open

opened

我看介绍应该硬盘空间是600G，但我用huggingface加载占用了1个多T还没弄完

Generating train split: 208463017 examples [1:07:59, 51102.37 examples/s]

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests