Introducing phases option for the test runs

[vishnuchalla]

Description

Adding phases option to test configuration. Updated the README.md accordingly.

Testing

[vchalla@vchalla ~]$ oc logs pod/quay-perf-test-orchestrator-tz4dr -f
INFO:root:Running Quay Scale & Performance Tests	date=2023-06-01T22:39:42.892672 host=https://example-registry-quay-quay-enterprise.apps.vchalla-quay-test-3.perfscale.devcluster.openshift.com test_uuid=0a8b83b5-9ea7-4867-b2a8-57c6dc1da893 organization=test num_users=5 num_repos=6 num_teams=5 target_hit_size=5 concurrency=5 repos_with_tags_sizes=(100,) total_tags=100 pull_push_batch_size=400 number_of_push_pull_jobs_per_user=0
INFO:root:Starting load phase (UTC): 2023-06-01 22:39:42.892814
INFO:root:Running: Create Users	quantity=5
INFO:root:Preparing to execute 5 HTTP Requests.
INFO:root:Sending requests to create_users (UTC): 2023-06-01 22:39:42.893041
Requests      [total, rate, throughput]         6, 6.00, 3.74
Duration      [total, attack, wait]             1.337s, 999.957ms, 337.073ms
Latencies     [min, mean, 50, 90, 95, 99, max]  23.507µs, 453.752ms, 541.951ms, 553.486ms, 554.168ms, 554.168ms, 554.168ms
Bytes In      [total, mean]                     1230, 205.00
Bytes Out     [total, mean]                     315, 52.50
Success       [ratio]                           83.33%
Status Codes  [code:count]                      0:1  200:5  
Error Set:
no targets to attack
INFO:root:Ending requests to create_users (UTC): 2023-06-01 22:39:44.438470
INFO:root:Testing create_users took 0:00:01.545429.
INFO:root:Results for test create_users written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_create_users_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:39:45Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:39:45Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:39:45Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:39:45Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:39:45Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:39:45Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:39:46Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:39:46Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:39:46Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:39:46Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:39:46Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Update User Passwords	quantity=5
INFO:root:Preparing to execute 5 HTTP Requests.
INFO:root:Sending requests to update_passwords (UTC): 2023-06-01 22:39:46.273374
Requests      [total, rate, throughput]         6, 6.00, 3.75
Duration      [total, attack, wait]             1.334s, 999.968ms, 334.166ms
Latencies     [min, mean, 50, 90, 95, 99, max]  23.428µs, 451.366ms, 539.487ms, 548.343ms, 548.551ms, 548.551ms, 548.551ms
Bytes In      [total, mean]                     1980, 330.00
Bytes Out     [total, mean]                     120, 20.00
Success       [ratio]                           83.33%
Status Codes  [code:count]                      0:1  200:5  
Error Set:
no targets to attack
INFO:root:Ending requests to update_passwords (UTC): 2023-06-01 22:39:47.815542
INFO:root:Testing update_passwords took 0:00:01.542168.
INFO:root:Results for test update_passwords written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_update_passwords_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:39:49Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:39:49Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:39:49Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:39:49Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:39:49Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Create Repositories	
INFO:root:Preparing to execute 6 HTTP Requests.
INFO:root:Sending requests to create_repositories (UTC): 2023-06-01 22:39:49.428208
Requests      [total, rate, throughput]         9, 5.63, 3.13
Duration      [total, attack, wait]             1.6s, 1.6s, 25.006µs
Latencies     [min, mean, 50, 90, 95, 99, max]  20.337µs, 198.971ms, 290.464ms, 310.786ms, 313.496ms, 313.496ms, 313.496ms
Bytes In      [total, mean]                     618, 68.67
Bytes Out     [total, mean]                     799, 88.78
Success       [ratio]                           55.56%
Status Codes  [code:count]                      0:3  201:5  400:1  
Error Set:
no targets to attack
400 BAD REQUEST
INFO:root:Ending requests to create_repositories (UTC): 2023-06-01 22:39:51.436311
INFO:root:Testing create_repositories took 0:00:02.008103.
INFO:root:Results for test create_repositories written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_create_repositories_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:39:52Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:39:52Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:39:52Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:39:52Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:39:52Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Update Repositories	
INFO:root:Preparing to execute 6 HTTP Requests.
INFO:root:Sending requests to update_repositories (UTC): 2023-06-01 22:39:53.058226
Requests      [total, rate, throughput]         7, 5.83, 4.63
Duration      [total, attack, wait]             1.296s, 1.2s, 96.502ms
Latencies     [min, mean, 50, 90, 95, 99, max]  22.008µs, 252.845ms, 295.005ms, 303.341ms, 304.929ms, 304.929ms, 304.929ms
Bytes In      [total, mean]                     108, 15.43
Bytes Out     [total, mean]                     240, 34.29
Success       [ratio]                           85.71%
Status Codes  [code:count]                      0:1  200:6  
Error Set:
no targets to attack
INFO:root:Ending requests to update_repositories (UTC): 2023-06-01 22:39:54.666350
INFO:root:Testing update_repositories took 0:00:01.608124.
INFO:root:Results for test update_repositories written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_update_repositories_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:39:55Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:39:55Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:39:55Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:39:55Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:39:55Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:39:55Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:39:56Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:39:56Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:39:56Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:39:56Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:39:56Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Create Teams	
INFO:root:Preparing to execute 5 HTTP Requests.
INFO:root:Sending requests to create_teams (UTC): 2023-06-01 22:39:56.278439
Requests      [total, rate, throughput]         6, 6.00, 4.59
Duration      [total, attack, wait]             1.09s, 1s, 89.866ms
Latencies     [min, mean, 50, 90, 95, 99, max]  21.711µs, 239.946ms, 288.937ms, 289.908ms, 289.911ms, 289.911ms, 289.911ms
Bytes In      [total, mean]                     1220, 203.33
Bytes Out     [total, mean]                     205, 34.17
Success       [ratio]                           83.33%
Status Codes  [code:count]                      0:1  200:5  
Error Set:
no targets to attack
INFO:root:Ending requests to create_teams (UTC): 2023-06-01 22:39:57.687446
INFO:root:Testing create_teams took 0:00:01.409007.
INFO:root:Results for test create_teams written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_create_teams_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:39:58Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:39:58Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:39:58Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:39:58Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:39:58Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:39:58Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:39:59Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:39:59Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:39:59Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:39:59Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:39:59Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Add Users to Teams	
INFO:root:Preparing to execute 25 HTTP Requests.
INFO:root:Sending requests to add_team_members (UTC): 2023-06-01 22:39:59.283245
Requests      [total, rate, throughput]         27, 5.19, 4.81
Duration      [total, attack, wait]             5.2s, 5.2s, 10.496µs
Latencies     [min, mean, 50, 90, 95, 99, max]  10.496µs, 265.632ms, 285.2ms, 290.094ms, 298.105ms, 317.453ms, 317.453ms
Bytes In      [total, mean]                     5600, 207.41
Bytes Out     [total, mean]                     50, 1.85
Success       [ratio]                           92.59%
Status Codes  [code:count]                      0:2  200:25  
Error Set:
no targets to attack
INFO:root:Ending requests to add_team_members (UTC): 2023-06-01 22:40:04.891402
INFO:root:Testing add_team_members took 0:00:05.608157.
INFO:root:Results for test add_team_members written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_add_team_members_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:40:06Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:40:06Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:40:06Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:40:06Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:40:06Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Grant teams access to repositories	
INFO:root:Preparing to execute 30 HTTP Requests.
INFO:root:Sending requests to add_teams_to_organizations (UTC): 2023-06-01 22:40:06.520774
Requests      [total, rate, throughput]         31, 5.17, 4.93
Duration      [total, attack, wait]             6.089s, 6s, 89.133ms
Latencies     [min, mean, 50, 90, 95, 99, max]  9.987µs, 286.567ms, 298.21ms, 300.875ms, 301.719ms, 307.678ms, 307.678ms
Bytes In      [total, mean]                     5640, 181.94
Bytes Out     [total, mean]                     510, 16.45
Success       [ratio]                           96.77%
Status Codes  [code:count]                      0:1  200:30  
Error Set:
no targets to attack
INFO:root:Ending requests to add_teams_to_organizations (UTC): 2023-06-01 22:40:12.929048
INFO:root:Testing add_teams_to_organizations took 0:00:06.408274.
INFO:root:Results for test add_teams_to_organizations written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_add_teams_to_organizations_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:40:14Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:40:14Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:40:14Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:40:14Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:40:14Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Grant users access to repositories	
INFO:root:Preparing to execute 30 HTTP Requests.
INFO:root:Sending requests to add_users_to_organizations_repos (UTC): 2023-06-01 22:40:14.581006
Requests      [total, rate, throughput]         31, 5.17, 4.92
Duration      [total, attack, wait]             6.103s, 6s, 103.361ms
Latencies     [min, mean, 50, 90, 95, 99, max]  11.584µs, 290.068ms, 300.247ms, 309.672ms, 313.511ms, 318.84ms, 318.84ms
Bytes In      [total, mean]                     6900, 222.58
Bytes Out     [total, mean]                     510, 16.45
Success       [ratio]                           96.77%
Status Codes  [code:count]                      0:1  200:30  
Error Set:
no targets to attack
INFO:root:Ending requests to add_users_to_organizations_repos (UTC): 2023-06-01 22:40:20.989389
INFO:root:Testing add_users_to_organizations_repos took 0:00:06.408383.
INFO:root:Results for test add_users_to_organizations_repos written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_add_users_to_organizations_repos_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:40:22Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:40:22Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:40:22Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:40:22Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:40:22Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Ending load phase (UTC): 2023-06-01 22:40:22.586842
INFO:root:The load phase took 0:00:39.694028.
INFO:root:Starting image push/pulls (UTC): 2023-06-01 22:40:22.586948
INFO:root:Queued 100 tags to be created
INFO:root:Queued 100 tags to be created
INFO:root:Queued 100 tags to be pulled
INFO:root:Queued 100 tags to be pulled
INFO:root:Queued 100 tags to be created
INFO:root:Queued 100 tags to be pulled
INFO:root:Queued 100 tags to be created
INFO:root:Queued 100 tags to be pulled
INFO:root:Queued 100 tags to be created
INFO:root:Queued 100 tags to be pulled
INFO:root:Created Job: test-registry-pusha893-user-0
INFO:root:Created Job: test-registry-pusha893-user-3
INFO:root:Created Job: test-registry-pusha893-user-1
INFO:root:Created Job: test-registry-pusha893-user-4
INFO:root:Created Job: test-registry-pusha893-user-2
INFO:root:Waiting for test-registry-pusha893-user-0 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-3 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-1 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-4 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-2 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-1 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-0 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-4 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-3 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-2 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-4 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-1 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-0 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-3 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-2 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-4 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-1 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-0 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-3 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pusha893-user-2 to finish. Queue: 0/100
INFO:root:Job test-registry-pusha893-user-1 has been completed.
INFO:root:Created Job: test-registry-pulla893-user-1
INFO:root:Job test-registry-pusha893-user-4 has been completed.
INFO:root:Created Job: test-registry-pulla893-user-4
INFO:root:Job test-registry-pusha893-user-3 has been completed.
INFO:root:Job test-registry-pusha893-user-0 has been completed.
INFO:root:Job test-registry-pusha893-user-2 has been completed.
INFO:root:Created Job: test-registry-pulla893-user-3
INFO:root:Created Job: test-registry-pulla893-user-0
INFO:root:Created Job: test-registry-pulla893-user-2
INFO:root:Waiting for test-registry-pulla893-user-1 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pulla893-user-4 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pulla893-user-2 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pulla893-user-3 to finish. Queue: 0/100
INFO:root:Waiting for test-registry-pulla893-user-0 to finish. Queue: 0/100
INFO:root:Job test-registry-pulla893-user-1 has been completed.
INFO:root:Job test-registry-pulla893-user-0 has been completed.
INFO:root:Job test-registry-pulla893-user-3 has been completed.
INFO:root:Job test-registry-pulla893-user-4 has been completed.
INFO:root:Job test-registry-pulla893-user-2 has been completed.
INFO:root:Ending image push/pulls (UTC): 2023-06-01 22:47:23.129680
INFO:root:The image push/pulls took 0:07:00.542732.
INFO:root:Skipping run phase as it is not specified
INFO:root:Starting cleanup phase (UTC): 2023-06-01 22:47:23.130057
INFO:root:Running: Delete teams access to repositories	
INFO:root:Preparing to execute 30 HTTP Requests.
INFO:root:Sending requests to delete_teams_of_organizations_repos (UTC): 2023-06-01 22:47:23.130717
Requests      [total, rate, throughput]         31, 5.17, 4.93
Duration      [total, attack, wait]             6.089s, 6s, 88.998ms
Latencies     [min, mean, 50, 90, 95, 99, max]  12.428µs, 290.298ms, 294.208ms, 321.481ms, 322.56ms, 326.386ms, 326.386ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           96.77%
Status Codes  [code:count]                      0:1  204:30  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_teams_of_organizations_repos (UTC): 2023-06-01 22:47:29.539419
INFO:root:Testing delete_teams_of_organizations_repos took 0:00:06.408702.
INFO:root:Results for test delete_teams_of_organizations_repos written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_teams_of_organizations_repos_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:47:30Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:47:30Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:47:30Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:47:30Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:47:30Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete users access to repositories	
INFO:root:Preparing to execute 30 HTTP Requests.
INFO:root:Sending requests to delete_users_of_organizations_repos (UTC): 2023-06-01 22:47:31.167758
Requests      [total, rate, throughput]         32, 5.16, 4.84
Duration      [total, attack, wait]             6.2s, 6.2s, 12.393µs
Latencies     [min, mean, 50, 90, 95, 99, max]  12.393µs, 282.132ms, 294.686ms, 316.002ms, 318.38ms, 322.077ms, 322.077ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           93.75%
Status Codes  [code:count]                      0:2  204:30  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_users_of_organizations_repos (UTC): 2023-06-01 22:47:37.776204
INFO:root:Testing delete_users_of_organizations_repos took 0:00:06.608446.
INFO:root:Results for test delete_users_of_organizations_repos written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_users_of_organizations_repos_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:47:39Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:47:39Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:47:39Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:47:39Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:47:39Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete Users to Teams	
INFO:root:Preparing to execute 25 HTTP Requests.
INFO:root:Sending requests to delete_team_members (UTC): 2023-06-01 22:47:39.427952
Requests      [total, rate, throughput]         29, 5.18, 4.46
Duration      [total, attack, wait]             5.6s, 5.6s, 12.363µs
Latencies     [min, mean, 50, 90, 95, 99, max]  10.451µs, 255.009ms, 289.933ms, 316.592ms, 319.825ms, 322.67ms, 322.67ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     50, 1.72
Success       [ratio]                           86.21%
Status Codes  [code:count]                      0:4  204:25  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_team_members (UTC): 2023-06-01 22:47:45.436526
INFO:root:Testing delete_team_members took 0:00:06.008574.
INFO:root:Results for test delete_team_members written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_team_members_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:47:46Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:47:46Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:47:46Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:47:46Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:47:46Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete Teams	
INFO:root:Preparing to execute 5 HTTP Requests.
INFO:root:Sending requests to delete_teams (UTC): 2023-06-01 22:47:47.060642
Requests      [total, rate, throughput]         7, 5.83, 4.17
Duration      [total, attack, wait]             1.2s, 1.2s, 23.959µs
Latencies     [min, mean, 50, 90, 95, 99, max]  21.501µs, 213.881ms, 291.965ms, 322.986ms, 329.115ms, 329.115ms, 329.115ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           71.43%
Status Codes  [code:count]                      0:2  204:5  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_teams (UTC): 2023-06-01 22:47:48.668625
INFO:root:Testing delete_teams took 0:00:01.607983.
INFO:root:Results for test delete_teams written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_teams_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:47:49Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:47:49Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:47:49Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:47:49Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:47:49Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:47:49Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:47:50Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:47:50Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:47:50Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:47:50Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:47:50Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete Repository Tags	
INFO:root:Preparing to execute 500 HTTP Requests.
INFO:root:Sending requests to delete_repository_tags (UTC): 2023-06-01 22:47:50.278992
Requests      [total, rate, throughput]         502, 5.01, 4.99
Duration      [total, attack, wait]             1m40s, 1m40s, 12.594µs
Latencies     [min, mean, 50, 90, 95, 99, max]  11.219µs, 298.657ms, 295.743ms, 318.744ms, 320.451ms, 327.913ms, 367.613ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           99.60%
Status Codes  [code:count]                      0:2  204:500  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_repository_tags (UTC): 2023-06-01 22:49:30.891566
INFO:root:Testing delete_repository_tags took 0:01:40.612574.
INFO:root:Results for test delete_repository_tags written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_repository_tags_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:49:32Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:49:32Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:49:32Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:49:32Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:49:32Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete Repositories	
INFO:root:Preparing to execute 6 HTTP Requests.
INFO:root:Sending requests to delete_repositories (UTC): 2023-06-01 22:49:32.531629
Requests      [total, rate, throughput]         9, 5.63, 3.75
Duration      [total, attack, wait]             1.6s, 1.6s, 23.001µs
Latencies     [min, mean, 50, 90, 95, 99, max]  21.557µs, 204.613ms, 299.393ms, 323.739ms, 333.882ms, 333.882ms, 333.882ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           66.67%
Status Codes  [code:count]                      0:3  204:6  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_repositories (UTC): 2023-06-01 22:49:34.539717
INFO:root:Testing delete_repositories took 0:00:02.008088.
INFO:root:Results for test delete_repositories written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_repositories_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:49:35Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:49:35Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:49:35Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:49:35Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:49:35Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Delete Users	quantity=5
INFO:root:Preparing to execute 5 HTTP Requests.
INFO:root:Sending requests to delete_users (UTC): 2023-06-01 22:49:36.137909
Requests      [total, rate, throughput]         9, 5.63, 3.13
Duration      [total, attack, wait]             1.6s, 1.6s, 21.18µs
Latencies     [min, mean, 50, 90, 95, 99, max]  21.18µs, 170.866ms, 289.171ms, 327.709ms, 340.021ms, 340.021ms, 340.021ms
Bytes In      [total, mean]                     0, 0.00
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           55.56%
Status Codes  [code:count]                      0:4  204:5  
Error Set:
no targets to attack
INFO:root:Ending requests to delete_users (UTC): 2023-06-01 22:49:38.146049
INFO:root:Testing delete_users took 0:00:02.008140.
INFO:root:Results for test delete_users written to file: ./logs/0a8b83b5-9ea7-4867-b2a8-57c6dc1da893_delete_users_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-06-01T22:49:39Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-06-01T22:49:39Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-06-01T22:49:39Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-06-01T22:49:39Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-06-01T22:49:39Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Ending cleanup phase (UTC): 2023-06-01 22:49:39.786021
INFO:root:The cleanup phase took 0:02:16.655964.