Skip to content

Conversation

@ebyhr
Copy link
Member

@ebyhr ebyhr commented May 22, 2024

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.

We shouldn't list datasets when case insensitive
name matching is disabled.
@cla-bot cla-bot bot added the cla-signed label May 22, 2024
@github-actions github-actions bot added the bigquery BigQuery connector label May 22, 2024
@ebyhr ebyhr requested review from hashhar, nineinchnick and wendigo May 22, 2024 00:52

Map<String, Optional<RemoteDatabaseObject>> mapping = new HashMap<>();
for (DatasetId datasetId : datasetIds) {
for (DatasetId datasetId : datasetIds.get()) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we call listDatasetIds(projectId) instead of passing this as an argument?

Copy link
Member Author

@ebyhr ebyhr May 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This method is called from the following place (in schemas loop):

return remoteSchemaNames.map(remoteSchema -> client.toRemoteDataset(projectId, remoteSchema.toLowerCase(ENGLISH), datasetIds))

Such change will cause slow metadata listing we fixed in #22033
Maybe, worth leaving a code comment?

@ebyhr ebyhr merged commit 87b8160 into master May 22, 2024
@ebyhr ebyhr deleted the ebi/bigquery-list-datasets branch May 22, 2024 12:46
@github-actions github-actions bot added this to the 449 milestone May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bigquery BigQuery connector cla-signed

Development

Successfully merging this pull request may close these issues.

4 participants