-
Notifications
You must be signed in to change notification settings - Fork 1.3k
PartitionStatistics support totalBuckets #6964
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PartitionStatistics support totalBuckets #6964
Conversation
9441daf to
541ea26
Compare
a0c7e51 to
9e42afc
Compare
|
Is this change compatible?
Perhaps you need to conduct some tests to ensure |
I have test old version RESTCatalog listPartitions request to DLF catalog server(which return Partition with new totalBuckets field), server response can be deserialized into Partition successfully. @JsonIgnoreProperties annotation and DeserializationFeature.FAIL_ON_UNKNOWN_PROPERTIES ensure that. |
| protected final long lastFileCreationTime; | ||
|
|
||
| @JsonProperty(FIELD_TOTAL_BUCKETS) | ||
| protected final int totalBuckets; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add comments to explain value when missing.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add comments to explain value when missing.
done
| protected final long lastFileCreationTime; | ||
|
|
||
| @JsonProperty(FIELD_TOTAL_BUCKETS) | ||
| protected final int totalBuckets; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also add test to missing case.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
add PartitionStatisticsTest
|
+1 |
Purpose
PartitionStatistics add totalBuckets field, get value from ManifestEntry.totalBuckets()
Tests
org.apache.paimon.flink.RESTCatalogITCase#testTotalBucketsStatistics:
verify totalBuckets stats for 3 bucket mode
API and Format
Partition and PartitionStatistics add new totalBuckets field
Documentation
rest-catalog-open-api doc:
Partition and PartitionStatistics add totalBuckets field