Skip to content
This repository was archived by the owner on Mar 5, 2026. It is now read-only.

feat: Row readers using storage API acceleration can leverage full precision avro values#658

Merged
danieljbruce merged 10 commits intomainfrom
avro-reader-test
Mar 5, 2026
Merged

feat: Row readers using storage API acceleration can leverage full precision avro values#658
danieljbruce merged 10 commits intomainfrom
avro-reader-test

Conversation

@danieljbruce
Copy link
Contributor

Description

This PR allows users to fetch high precision timestamps for read calls with avro readers. Previous to this PR there was no way users could fetch such timestamps.

Impact

With a custom Avro reader, now users can fetch and consume data from the server that preserves high precision timestamps on the backend while providing information about the avro reader in the request.

Testing

A system test is added that proves the timestamp fetched from the server is high precision.

Additional Information

The source code changes are pretty much exactly in the same place as those from #656. The main difference is data coming back from the server for arrow readers is very different from data coming back from avro readers. That means instead of using arrow reader transforms from the source code we need to leverage the avsc library to parse server results in the same way that the quickstart guide demonstrates. This allows the test to produce a high precision timestamp.

@danieljbruce danieljbruce requested review from a team as code owners March 4, 2026 19:51
@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigquerystorage Issues related to the googleapis/nodejs-bigquery-storage API. labels Mar 4, 2026
@danieljbruce danieljbruce changed the title Avro reader test feat: Row readers using storage API acceleration can leverage full precision arrow values Mar 4, 2026
@danieljbruce danieljbruce changed the title feat: Row readers using storage API acceleration can leverage full precision arrow values feat: Row readers using storage API acceleration can leverage full precision avro values Mar 4, 2026
@danieljbruce danieljbruce requested a review from alvarowolfx March 4, 2026 20:16
@danieljbruce danieljbruce merged commit fa090c6 into main Mar 5, 2026
20 of 21 checks passed
@danieljbruce danieljbruce deleted the avro-reader-test branch March 5, 2026 18:09
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

api: bigquerystorage Issues related to the googleapis/nodejs-bigquery-storage API. size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants