Skip to content

[bugfix] add missing dataset utils test#139

Merged
tiankongdeguiji merged 1 commit intoalibaba:masterfrom
tiankongdeguiji:bugfix/missing_utils_test
Mar 14, 2025
Merged

[bugfix] add missing dataset utils test#139
tiankongdeguiji merged 1 commit intoalibaba:masterfrom
tiankongdeguiji:bugfix/missing_utils_test

Conversation

@tiankongdeguiji
Copy link
Collaborator

No description provided.

for i in range(num_tables):
for j in range(num_workers):
start, end, remain_row_counts[j] = calc_slice_position(
row_count=81,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个 81 能用前面81个table的数字不一样吗?
下面81 和82 是和num_tables 还是row_count 相关?

Copy link
Collaborator Author

@tiankongdeguiji tiankongdeguiji Mar 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

都是81才会触发需要drop一条数据的corner case

@tiankongdeguiji tiankongdeguiji merged commit e827e2d into alibaba:master Mar 14, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants