-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Add availability-recovery from systematic chunks #1644
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
alindima
merged 176 commits into
master
from
alindima/add-systematic-chunks-av-recovery
May 28, 2024
Merged
Changes from 1 commit
Commits
Show all changes
176 commits
Select commit
Hold shift + click to select a range
051328a
Draft of RecoveryStrategy based on linked enums
alindima 166aae5
add copright header
alindima 518d8fd
fix clippy
alindima dae34a5
Refactor RecoveryStrategy using dynamic dispatch
alindima 640c2d5
address comments
alindima ac18bab
Merge branch 'master' into alindima/refactor-availability-recovery-st…
alindima 2269f76
erasure-coding: add algorithm for systematic recovery
alindima dca9ce4
WIP
alindima 9eeb93a
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 6f58c3a
continue implementation
alindima a805a85
Fix some tests
alindima d83bf50
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 2a5d6d5
Merge remote-tracking branch 'origin/master' into alindima/refactor-a…
alindima f3d407b
replace hashmap of chunks with btreemap
alindima 67841bd
add chunk indices cache to av-recovery
alindima 3810eab
some more improvements
alindima bf39ba0
don't use the backing group if chunk size query failed
alindima 34408b5
add ImmediateError to chunks recovery strategy
alindima b68e671
modify and add metrics
alindima 1569e49
more review comments
alindima d5c32d1
fix test
alindima cb42bef
rollback to using TryConnect for fetch chunks
alindima 06f00a2
add runtime API knob for shuffling enablement
alindima 2b58895
av-recovery and av-distr: use relay parent from candidate_receipt
alindima f860b7d
add avail_chunk_shuffling params to HostConfiguration
alindima b82b2a0
replace BypassAvStore variant with a separate flag
alindima 8585628
move requesting_chunks to the strategy
alindima 2f9b767
Merge remote-tracking branch 'origin/master' into alindima/refactor-a…
alindima 824f7e3
Merge remote-tracking branch 'origin/alindima/refactor-availability-r…
alindima 818d9c0
fix tests
alindima 6b8afcb
add erasure-coding benchmark for systematic recovery
alindima ce633b4
fix clippy
alindima c1a5dbf
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 0fb256a
av-distribution is not sending av-recovery messages
alindima b2c92b3
fix clippy
alindima 3c3371a
add client_features runtime API
alindima 3d82eb9
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima d57396b
rustfmt
alindima 0a46a21
fix test
alindima e2ce0cd
add client_features to westend, fix fmt and clippy
alindima cc06a71
try fixing clippy again
alindima a83b178
fix copy-paste mistake
alindima 6e06d27
fix metrics and logs
alindima ce10f68
add new shuffling algorithm
alindima b3ea7c9
add newtype for ChunkIndex
alindima 926bcb0
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 6b6e924
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima f28e01e
add v10 config migration to westend
alindima 21811ef
replace u8 ClientFeatures with u64
alindima ad43e4a
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 67954e6
some fixes to get clippy to pass
alindima c93985b
use Pallet::current_storage_version()::put() instead of explicitly
alindima 201b09e
replace RecoveryError::Unavailable with Invalid
alindima 9c51bf2
add tests to availability-distribution
alindima fabc044
add comma
alindima 8ee0027
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 4283214
fix migration test
alindima 77d5370
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima a9ef2a4
add some more tests
alindima 2035f30
add more tests and small fix
alindima eef1e14
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima fac014c
bump novelpoly
alindima 7a71f0f
av-recovery: revert to with_chunks_if_pov_large for testing purposes
alindima 6973295
improve migrate_to_v10 test
alindima 1af0657
address some review comments
alindima 38e1361
some more tests
alindima 1d825df
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 1318a21
enable systematic recovery for testing purposes
alindima a98cdd6
don't request chunks that past strategies deemed not available
alindima 9dc87ae
more tests
alindima c462e25
fix infinite request loop for network errors.
alindima fc621f9
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 716606e
add extensive unit tests for av-recovery
alindima c0b1c6c
fix clippy
alindima 862501b
runtime config: enable AVAILABILITY_CHUNK_SHUFFLING for new chains
alindima 91a52fa
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 8b0d583
use fatality in av-recovery
alindima 25ba4fd
bump SYSTEMATIC_CHUNKS_REQ_RETRY_LIMIT to 2
alindima 850c0a3
rename historical_errors to recorded_errors
alindima ab4d8d1
deduplicate get_block_number
alindima d9282ad
address some review comments
alindima 9deec5f
more tests
alindima 8494496
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 5524385
remove unused env_logger from test
alindima d2babf7
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 13c4253
small metrics and logging improvements
alindima b8792ff
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 81ebaa8
add more explicit error message on decode
alindima ef893c3
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima f681e1e
add more metrics for full data requests
alindima 60f0e79
move ChunkIndexCacheRegistry to its own module
alindima 90fdec8
fix test compilation
alindima 68ad6a6
add license header
alindima 4e22ef7
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima a943f25
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 6e34e90
fix cumulus pov_recovery with RPC node
alindima 5feed4a
fix test
alindima 949e732
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima db1225b
add more tests for #2287
alindima b4a125b
add backers as backup for requesting systematic chunks
alindima d151626
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima e58a405
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 0906bf0
fix clippy and remove unneeded dep
alindima 0ed37a8
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 2d0b587
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 894880b
update lockfile
alindima fada5d9
integrate reed-solomon from master git branch
alindima 145097e
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 4233871
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 965c139
Adapt code to new design from RFC
alindima 4530caa
fix av-store tests
alindima 1ee008c
don't allow systematic recovery if chunk mapping is disabled
alindima 46486db
launch systematic recovery during approval voting
alindima 376619e
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 199bc88
add zombienet test for network-level compatibility
alindima d923269
add systematic recovery to subsystem-bench
alindima bc22b81
fix clippy
alindima 3edd33b
fix some backing tests
alindima c9ab410
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 2d2d868
random small fixes
alindima 557e410
try fixing zombienet test
alindima 3df708b
add v2 protocol to cumulus
alindima e6de96a
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 278028b
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 65c8ecf
fix clippy
alindima 951119e
address some review feedback
alindima c94e7d5
some more comments
alindima e4cbf1d
fill prdoc
alindima 2f21035
zombienet tests
alindima 33d6162
try fixing zombienet tests
alindima ad975a6
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima eddae38
update implementer's guide
alindima c2f0f23
markdown format
alindima 9b49d40
move erasure_task_tx to the common recovery params
alindima 8f027fb
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 826208f
address some review comments
alindima d25cc1c
try fixing zombienet tests
alindima 4e958ba
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima dbc27b3
more zombienet
alindima 6aa3b16
zombienet
alindima bf93b63
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 2316316
fix yaml formatting
alindima 0c57295
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima df8a096
fix import
alindima 486cf64
fix bench
alindima 70e8840
clippy
alindima ee93f68
fix image name
alindima 8a2931c
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 7d9e21a
try another image for the zombienet test
alindima 9000f5c
Use cumulus image for collator
pepoviola e2a95c2
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima eeab22a
fix yaml format
alindima e39ea78
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima a57f5fd
fix merge commit
alindima 6948ea1
fix bench
alindima 91a6180
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima da66e88
re-add enable-node-feature script
alindima d20ced9
fix zombienet tests
alindima 3ace495
Merge remote-tracking branch 'origin' into alindima/add-systematic-ch…
alindima 78a7959
add semver to prdoc
alindima da8ca22
try fixing prdoc
alindima 84ca508
Merge branch 'master' into alindima/add-systematic-chunks-av-recovery
alindima 5dc877e
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 345d896
update lockfile
alindima 01795b0
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 0ed57f8
unify fatality versions
alindima 8acc2c1
some metrics and logs polishes
alindima 7ddf494
more details to prdoc
alindima 5bd966f
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima c721152
prdoc fixup
alindima 6faa1ee
fix
alindima 25dc880
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima 5669eec
try to make markdown linter happy
alindima 99f09e3
use higher glutton PoV sizes for tests
alindima ce08e60
bump zombienet version
pepoviola fdbc31f
Merge remote-tracking branch 'origin/master' into alindima/add-system…
alindima File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
fix copy-paste mistake
- Loading branch information
commit a83b178310a2400f3a6619ce0db83ad90815c271
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.