Skip to content
Draft
Changes from 1 commit
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
4e91546
Migrate arbitrary amounts of synth data
greenape Mar 14, 2022
d82c94a
Wrong path
greenape Mar 14, 2022
f68010b
No structlog
greenape Mar 14, 2022
5bf32f0
No threadlocal
greenape Mar 14, 2022
11a0629
Silly logging
greenape Mar 14, 2022
665436d
Update migrate_synth_data.py
greenape Mar 14, 2022
d52fee8
Run for synth data as well
greenape Mar 14, 2022
4d31f10
Update migrate_synth_data.py
greenape Mar 14, 2022
5ddd25e
Update migrate_synth_data.py
greenape Mar 14, 2022
e8cddf9
Update migrate_synth_data.py
greenape Mar 14, 2022
f844b44
Fix partitions and logging
greenape Mar 14, 2022
bf4592c
Deal with missing gambia
greenape Mar 14, 2022
3e6e79e
Lint
greenape Mar 14, 2022
9c0f345
Longer timeout, fix number of days
greenape Mar 14, 2022
87368d9
Migrate arbitrary amounts of synth data
greenape Mar 14, 2022
85e8ff0
Wrong path
greenape Mar 14, 2022
4c5f026
No structlog
greenape Mar 14, 2022
f0ce2eb
No threadlocal
greenape Mar 14, 2022
eea308a
Silly logging
greenape Mar 14, 2022
553b682
Update migrate_synth_data.py
greenape Mar 14, 2022
5bcd20d
Run for synth data as well
greenape Mar 14, 2022
863821a
Update migrate_synth_data.py
greenape Mar 14, 2022
cb3033f
Update migrate_synth_data.py
greenape Mar 14, 2022
5af9837
Update migrate_synth_data.py
greenape Mar 14, 2022
912fd2f
Fix partitions and logging
greenape Mar 14, 2022
7ee97a5
Deal with missing gambia
greenape Mar 14, 2022
519c561
Lint
greenape Mar 14, 2022
3da74f4
Longer timeout, fix number of days
greenape Mar 14, 2022
b2ad188
Use pipenv python
greenape Jun 14, 2023
81fbaf8
Merge branch 'synth-data-migrator' of https://github.com/Flowminder/F…
Thingus Jun 14, 2023
37d3bcf
Dropping events schema, bringing up to date with master
Thingus Jun 14, 2023
b748822
skip synth dfs events because they use the events tables
greenape Jun 14, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update migrate_synth_data.py
  • Loading branch information
greenape committed Apr 28, 2023
commit 4d31f101e9d5195079e0d79d2f3780186d7e1d58
2 changes: 1 addition & 1 deletion flowdb/testdata/bin/migrate_synth_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,7 @@ def do_exec(args):
trans.execute(
f"CREATE TABLE interactions.subscriber_sightings_{date.strftime('%Y%M%d')} PARTITION OF interactions.subscriber_sightings FOR VALUES {partition_period};"
)
for event_type in ("calls", "sms", "mds", "topups"):
for event_type in ("calls", "sms", "mds", "topup"):
trans.execute(
f"CREATE TABLE interactions.{event_type}_{date.strftime('%Y%M%d')} PARTITION OF interactions.{event_type} FOR VALUES {partition_period};"
)
Expand Down