Skip to content

Conversation

@boazberman
Copy link
Contributor

Which issue does this PR close?

Depends on: apache/arrow-rs#693
Closes #240 .
This is a new version (arrow native) of: #342 (which is also me, from the company account)

Rationale for this change

Described in the issue.

What changes are included in this PR?

Described in the issue.

Are there any user-facing changes?

No

@boazberman
Copy link
Contributor Author

The build will fail due to the fact it relies on an new api to BooleanBufferBuilder which is under this PR: apache/arrow-rs#693

Please let me know what If you need anything else on my side to make this happen. Thanks! (cc @alamb that corresponded with me on the previous PR)

@houqp houqp added the performance Make DataFusion faster label Aug 14, 2021
Copy link
Contributor

@Dandandan Dandandan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me (if it's integrated to arrow)👍 thanks @boazberman , nice addition!

@alamb
Copy link
Contributor

alamb commented Aug 15, 2021

FYI assuming we merge + backport apache/arrow-rs#693 (which seems likely) it would be available in arrow-rs 5.3.0 (target release date in about 2 weeks time). Thank you very much for sticking with this @boazberman

Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks very nice ❤️ -- thank you @boazberman

@houqp
Copy link
Member

houqp commented Aug 15, 2021

Nice work @boazberman ! I wish there is automated benchmark report against master on every PR so we get to see the sweet performance gain number :) I vaguely remember ursalabs built a tool for this particular use-case for the main arrow repo.

@alamb alamb added the waiting-on-upstream PR is waiting on an upstream dependency to be updated label Aug 17, 2021
@houqp houqp removed the waiting-on-upstream PR is waiting on an upstream dependency to be updated label Sep 19, 2021
@alamb alamb added the stale-pr label Oct 26, 2021
@alamb
Copy link
Contributor

alamb commented Oct 26, 2021

Marking PRs that haven't had activity in over a month as 'stale-pr' to help me filter the list. Please remove the label or let me know if "stale" is not the correct designation

@alamb
Copy link
Contributor

alamb commented Nov 2, 2021

Closing a seemingly stale PR -- please reopen if that was a mistake.

@alamb alamb closed this Nov 2, 2021
H0TB0X420 pushed a commit to H0TB0X420/datafusion that referenced this pull request Oct 7, 2025
* remove xfail from passing tests

* update xfail cmoment for datetime_s

* document upstream issue for timestamp[s] xfail test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

performance Make DataFusion faster

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Left join could use bitmap for left join instead of Vec<bool>

4 participants