Skip to content

Add extra allocation/eviction policies #67

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 21 commits into
base: develop
Choose a base branch
from
Draft

Add extra allocation/eviction policies #67

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
b791b77
Run centos and debian workflows on push and PR
igchor Nov 2, 2021
470f563
Introduce 'markedForEviction' state for the Item.
igchor Dec 15, 2022
c1020df
Adds createPutToken and switches findEviction
byrnedj Feb 4, 2023
9bb6775
- Change the cache size calculation to use getCacheSize()
byrnedj Jan 4, 2023
1759e83
- Add memory tier configs to cache allocator based on NUMA bindings
byrnedj Jan 4, 2023
62b0c41
added ability for compressed pointer to use full 32 bits for addressi…
guptask Nov 14, 2022
b7459ee
Add memory usage statistics for allocation classes
igchor Jul 6, 2022
fafface
Initial multi-tier support implementation (rebased with NUMA and cs p…
igchor Sep 28, 2021
369e55b
AC stats multi-tier
byrnedj Jan 17, 2023
713c6d9
This commit contains the additional memory tiers tests
byrnedj Feb 8, 2023
d209d78
This is the additional multi-tier support needed
guptask Nov 14, 2022
e74fa40
added per pool class rolling average latency (upstream PR version)
guptask Jul 21, 2022
bab780a
added per tier pool class rolling average latency (based on upstream PR)
guptask Jul 21, 2022
f0baeb1
MM2Q promotion iterators (#1)
byrnedj Aug 9, 2022
8ab8c75
CS Patch Part 2 for mulit-tier cachelib:
byrnedj Feb 7, 2023
2152639
basic multi-tier test based on numa bindings
igchor Dec 30, 2021
e303104
Aadding new configs to hit_ratio/graph_cache_leader_fobj
vinser52 Jan 27, 2022
1e40a00
Do not block reader if a child item is moving
igchor Dec 19, 2022
b99bb9d
Background data movement (#20)
byrnedj Oct 21, 2022
08bf0b4
fix race in moveRegularItemWith sync where insertOrReplace can cause …
byrnedj Feb 16, 2023
8f88aa6
Add extra allocation/eviction policies
igchor Mar 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Aadding new configs to hit_ratio/graph_cache_leader_fobj 
-updated configs for numa bindings
  • Loading branch information
@vinser52 @byrnedj
vinser52 authored and byrnedj committed Mar 3, 2023
commit e30310470e55efeb9b05c9f5ea8f17be16de2fac
42 changes: 42 additions & 0 deletions .../cachebench/test_configs/hit_ratio/graph_cache_leader_fbobj/config-4GB-DRAM-4GB-PMEM.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
{
"cache_config": {
"cacheSizeMB": 8192,
"poolRebalanceIntervalSec": 0,
"cacheDir": "/tmp/mem-tiers",
"memoryTiers" : [
{
"ratio": 1,
"memBindNodes": 0
},
{
"ratio": 1,
"memBindNodes": 0
}
]
},
"test_config":
{
"addChainedRatio": 0.0,
"delRatio": 0.0,
"enableLookaside": true,
"getRatio": 0.7684563460126871,
"keySizeRange": [
1,
8,
64
],
"keySizeRangeProbability": [
0.3,
0.7
],
"loneGetRatio": 0.2315436539873129,
"numKeys": 71605574,
"numOps": 5000000,
"numThreads": 24,
"popDistFile": "pop.json",

"setRatio": 0.0,
"valSizeDistFile": "sizes.json"
}

}
32 changes: 32 additions & 0 deletions cachelib/cachebench/test_configs/hit_ratio/graph_cache_leader_fbobj/config-8GB-DRAM.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
{
"cache_config": {
"cacheSizeMB": 8192,
"poolRebalanceIntervalSec": 0,
"cacheDir": "/tmp/mem-tier"
},
"test_config":
{
"addChainedRatio": 0.0,
"delRatio": 0.0,
"enableLookaside": true,
"getRatio": 0.7684563460126871,
"keySizeRange": [
1,
8,
64
],
"keySizeRangeProbability": [
0.3,
0.7
],
"loneGetRatio": 0.2315436539873129,
"numKeys": 71605574,
"numOps": 5000000,
"numThreads": 24,
"popDistFile": "pop.json",

"setRatio": 0.0,
"valSizeDistFile": "sizes.json"
}

}
38 changes: 38 additions & 0 deletions cachelib/cachebench/test_configs/hit_ratio/graph_cache_leader_fbobj/config-8GB-PMEM.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
{
"cache_config": {
"cacheSizeMB": 8192,
"poolRebalanceIntervalSec": 0,
"cacheDir": "/tmp/mem-tier",
"memoryTiers" : [
{
"ratio": 1,
"memBindNodes": 0
}
]
},
"test_config":
{
"addChainedRatio": 0.0,
"delRatio": 0.0,
"enableLookaside": true,
"getRatio": 0.7684563460126871,
"keySizeRange": [
1,
8,
64
],
"keySizeRangeProbability": [
0.3,
0.7
],
"loneGetRatio": 0.2315436539873129,
"numKeys": 71605574,
"numOps": 5000000,
"numThreads": 24,
"popDistFile": "pop.json",

"setRatio": 0.0,
"valSizeDistFile": "sizes.json"
}

}
12 changes: 8 additions & 4 deletions cachelib/cachebench/test_configs/simple_tiers_test.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,14 +1,18 @@
// @nolint instantiates a small cache and runs a quick run of basic operations.
{
"cache_config" : {
"cacheSizeMB" : 512,
"usePosixShm" : false,
"cacheSizeMB" : 1024,
"cacheDir" : "/tmp/mem-tiers",
"memoryTiers" : [
{
"ratio": 1,
"memBindNodes": "0"
},
{
"ratio": 1,
"memBindNodes": "0"
}

],
"poolRebalanceIntervalSec" : 1,
"moveOnSlabRelease" : false,
Expand All @@ -19,7 +23,7 @@
"test_config" : {
"numOps" : 100000,
"numThreads" : 32,
"numKeys" : 1000000,
"numKeys" : 2000000,

"keySizeRange" : [1, 8, 64],
"keySizeRangeProbability" : [0.3, 0.7],
Expand All @@ -33,4 +37,4 @@
"keyPoolDistribution": [0.4, 0.6],
"opPoolDistribution" : [0.5, 0.5]
}
}
}