Skip to content

Conversation

@wzhfy
Copy link
Contributor

@wzhfy wzhfy commented Sep 8, 2016

What changes were proposed in this pull request?

For data source table in InMemoryCatalog, it's catalogTable.storage.locationUri is None, so total size can't be calculated. But we can use the path parameter in catalogTable.storage.properties to calculate size.

How was this patch tested?

fix test case

@wzhfy
Copy link
Contributor Author

wzhfy commented Sep 8, 2016

@cloud-fan @gatorsmile

@wzhfy wzhfy changed the title No total size for data source tables in InMemoryCatalog [SPARK-17446] [SQL] No total size for data source tables in InMemoryCatalog Sep 8, 2016
@SparkQA
Copy link

SparkQA commented Sep 8, 2016

Test build #65089 has finished for PR 15012 at commit 8276ab0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@cloud-fan
Copy link
Contributor

can you hold it for a while? We are consolidating locationUri for Hive serde table and path for datasource table recently.

@wzhfy
Copy link
Contributor Author

wzhfy commented Sep 8, 2016

@cloud-fan OK, please let me know when it's done.

@cloud-fan
Copy link
Contributor

PR is already sent: #15024

@wzhfy
Copy link
Contributor Author

wzhfy commented Nov 8, 2016

The issue is resolved after merging #15024, so I'll close this pr.

@wzhfy wzhfy closed this Nov 8, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants