Skip to content

[dataset] support dynamic batch and dynamic padding#24

Draft
cdliang11 wants to merge 7 commits into
devfrom
chengdong-batch
Draft

[dataset] support dynamic batch and dynamic padding#24
cdliang11 wants to merge 7 commits into
devfrom
chengdong-batch

Conversation

@cdliang11

@cdliang11 cdliang11 commented Feb 24, 2025

Copy link
Copy Markdown
Collaborator
  • support padding based on the maximum length of each batch
  • support dynamic batch

we will use sequence packing

@cdliang11 cdliang11 marked this pull request as draft February 24, 2025 03:06
@cdliang11 cdliang11 requested a review from robin1001 February 24, 2025 07:59
@cdliang11 cdliang11 marked this pull request as ready for review February 24, 2025 07:59
@cdliang11 cdliang11 changed the title [wenet/dataset] Support padding based on the maximum length of each batch [wenet/dataset] support padding based on the maximum length of each batch and dynamic batch Feb 24, 2025
@cdliang11 cdliang11 changed the title [wenet/dataset] support padding based on the maximum length of each batch and dynamic batch [wenet/dataset] support dynamic batch and padding based on the maximum length of each batch Feb 24, 2025
@cdliang11 cdliang11 changed the title [wenet/dataset] support dynamic batch and padding based on the maximum length of each batch [dataset] support dynamic batch and padding based on the maximum length of each batch Feb 27, 2025
@cdliang11 cdliang11 changed the title [dataset] support dynamic batch and padding based on the maximum length of each batch [dataset] support dynamic batch and dynamic padding Feb 28, 2025
@cdliang11 cdliang11 marked this pull request as draft March 6, 2025 02:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant