-
Notifications
You must be signed in to change notification settings - Fork 4k
ARROW-6780: [C++][Parquet] Support DurationType in writing/reading parquet (written as int64) #12449
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…rquet (written as int64)
| parquet_fields.push_back( | ||
| PrimitiveNode::Make("duration[us]", Repetition::REQUIRED, ParquetType::INT64)); | ||
| arrow_fields.push_back(::arrow::field("duration[us]", INT64, false)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What is the purpose of this? It's just an INT64 field like any other, no?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah, I initially wrote the test with duration type, but because this test is for the pure Parquet->Arrow schema conversion (without any usage of ARROW:schema), it failed and I changed it to int64. Which of course renders it useless as it's indeed just testing int64 type. Will remove.
pitrou
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thank you @jorisvandenbossche !
|
Benchmark runs are scheduled for baseline = d33b6a5 and contender = 17fcbdb. 17fcbdb is a master commit associated with this PR. Results will be available as each benchmark for each run completes. |
No description provided.