-
Notifications
You must be signed in to change notification settings - Fork 433
Open
Labels
P3area/client/hadoopfscontributorfeature-requestgood first issueGood for newcomersGood for newcomersno staleUsing this label will prevent items from being marked as staleUsing this label will prevent items from being marked as staleperformanceteam/ecosystemTeam EcosystemTeam Ecosystem
Description
As we did in the Spark metadata client for GC. If an API call times out and the exception leaks it can be really expensive on Spark! First the entire job is retried, this can cause partitions to be recomputed. And if it times out enough times the entire is aborted and all work is pretty much lost. Note that when lakeFS is under load it gets worse with more partitions rather than better :-/
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P3area/client/hadoopfscontributorfeature-requestgood first issueGood for newcomersGood for newcomersno staleUsing this label will prevent items from being marked as staleUsing this label will prevent items from being marked as staleperformanceteam/ecosystemTeam EcosystemTeam Ecosystem