Skip to content
This repository was archived by the owner on Jan 22, 2025. It is now read-only.

Conversation

@mvines
Copy link
Contributor

@mvines mvines commented Aug 4, 2018

Empirically removing the nested par_iter()s in this file avoids a
deadlock within rayon when another par_iter() is running in parallel.

Fixes #764

Empirically removing the nested par_iter()s in this file avoids a
deadlock within rayon when another par_iter() is running in parallel.

See solana-labs#764 for more detail.
@mvines mvines requested a review from garious August 4, 2018 09:44
@mvines
Copy link
Contributor Author

mvines commented Aug 4, 2018

This may have a slight impact on CPU signature verification performance but verify_packet() is still run in parallel. Any benchmarks you want to see run @garious before landing this?

@aeyakovenko
Copy link
Member

That’s lame. I think rayon has an option for a local thread pool

@garious
Copy link
Contributor

garious commented Aug 4, 2018

How about chaining all the par iterators and calling collect() once?

Copy link
Contributor

@garious garious left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mvines
Copy link
Contributor Author

mvines commented Aug 4, 2018

Nope nope nope. This is wrong. rayon is working fine, the problem is that ed25519_verify_cpu() is grabbing all the rayon threads and nothing else runs 😊

@mvines mvines closed this Aug 4, 2018
@rob-solana
Copy link
Contributor

rob-solana commented Aug 4, 2018

is there an issue covering "ed25519_verify_cpu() is grabbing all the rayon threads"?

@mvines
Copy link
Contributor Author

mvines commented Aug 4, 2018

Yep, that's just #764.

brooksprumo added a commit to brooksprumo/solana that referenced this pull request Apr 17, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants