Skip to content

Started refactoring and added app restart assets.#54

Merged
vishnuchalla merged 8 commits intoquay:masterfrom
vishnuchalla:dev
May 8, 2023
Merged

Started refactoring and added app restart assets.#54
vishnuchalla merged 8 commits intoquay:masterfrom
vishnuchalla:dev

Conversation

@vishnuchalla
Copy link
Collaborator

Description

  • Started refactoring as the project is going to grow naturally due to additional API endpoints. Will continue this as we keep on adding more code/endpoints.
  • Adding shell scripts to restart the quay-app after every run.

Testing

Tested on AWS self managed cluster using quay-operator

[vchalla@vchalla ~]$ oc logs pod/quay-perf-test-orchestrator-5zmvx -f
INFO:root:Running Quay Scale & Performance Tests	date=2023-04-30T21:49:30.590009 host=https://example-registry-quay-quay-enterprise.apps.vchalla-quay-test-2.perfscale.devcluster.openshift.com test_uuid=8b2780ba-9f86-4628-b5aa-1d7eca2f3412 organization=test num_users=10 num_repos=11 num_teams=10 target_hit_size=10 concurrency=5 repos_with_tags_sizes=(5,) total_tags=5 pull_push_batch_size=400 number_of_push_pull_jobs_per_user=0
INFO:root:Running: Create Users	quantity=10
INFO:root:Preparing to execute 10 HTTP Requests.
Requests      [total, rate, throughput]         11, 5.50, 4.07
Duration      [total, attack, wait]             2.46s, 2s, 459.687ms
Latencies     [min, mean, 50, 90, 95, 99, max]  7.863µs, 537.987ms, 557.979ms, 688.832ms, 708.39ms, 710.168ms, 710.168ms
Bytes In      [total, mean]                     2460, 223.64
Bytes Out     [total, mean]                     630, 57.27
Success       [ratio]                           90.91%
Status Codes  [code:count]                      0:1  200:10  
Error Set:
no targets to attack
INFO:root:Results for test create_users written to file: ./logs/3de75888-76b4-4505-81cc-9421516be33c_create_users_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:49:34Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:49:34Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:49:34Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:49:34Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:49:34Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Update User Passwords	quantity=10 password=password
INFO:root:Preparing to execute 10 HTTP Requests.
Requests      [total, rate, throughput]         11, 5.50, 4.29
Duration      [total, attack, wait]             2.333s, 2s, 332.658ms
Latencies     [min, mean, 50, 90, 95, 99, max]  4.139µs, 541.299ms, 620.538ms, 640.952ms, 647.803ms, 648.426ms, 648.426ms
Bytes In      [total, mean]                     3960, 360.00
Bytes Out     [total, mean]                     240, 21.82
Success       [ratio]                           90.91%
Status Codes  [code:count]                      0:1  200:10  
Error Set:
no targets to attack
INFO:root:Results for test update_passwords written to file: ./logs/855baf52-3757-4c42-8ecf-039233544602_update_passwords_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:49:38Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:49:38Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:49:38Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:49:38Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:49:38Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Create Repositories	
INFO:root:Preparing to execute 11 HTTP Requests.
Requests      [total, rate, throughput]         13, 5.42, 4.17
Duration      [total, attack, wait]             2.4s, 2.4s, 4.606µs
Latencies     [min, mean, 50, 90, 95, 99, max]  4.606µs, 259.055ms, 298.208ms, 322.279ms, 327.901ms, 329.198ms, 329.198ms
Bytes In      [total, mean]                     928, 71.38
Bytes Out     [total, mean]                     1457, 112.08
Success       [ratio]                           76.92%
Status Codes  [code:count]                      0:2  201:10  400:1  
Error Set:
no targets to attack
400 BAD REQUEST
INFO:root:Results for test create_repositories written to file: ./logs/a225a074-2476-4cc9-aca7-04238ccfe608_create_repositories_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:49:42Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:49:42Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:49:42Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:49:42Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:49:42Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Create Teams	
INFO:root:Preparing to execute 10 HTTP Requests.
Requests      [total, rate, throughput]         11, 5.50, 4.74
Duration      [total, attack, wait]             2.108s, 2s, 108.042ms
Latencies     [min, mean, 50, 90, 95, 99, max]  5.861µs, 266.917ms, 289.892ms, 306.257ms, 307.891ms, 308.039ms, 308.039ms
Bytes In      [total, mean]                     2440, 221.82
Bytes Out     [total, mean]                     410, 37.27
Success       [ratio]                           90.91%
Status Codes  [code:count]                      0:1  200:10  
Error Set:
no targets to attack
INFO:root:Results for test create_teams written to file: ./logs/15e82ca3-35c1-4f6e-8224-924fd9a794ab_create_teams_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:49:46Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:49:46Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:49:46Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:49:46Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:49:46Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Add Users to Teams	
INFO:root:Preparing to execute 100 HTTP Requests.
Requests      [total, rate, throughput]         101, 5.05, 4.98
Duration      [total, attack, wait]             20.078s, 20s, 77.54ms
Latencies     [min, mean, 50, 90, 95, 99, max]  6.723µs, 288.763ms, 297.853ms, 303.694ms, 307.718ms, 322.882ms, 327.014ms
Bytes In      [total, mean]                     22400, 221.78
Bytes Out     [total, mean]                     200, 1.98
Success       [ratio]                           99.01%
Status Codes  [code:count]                      0:1  200:100  
Error Set:
no targets to attack
INFO:root:Results for test add_team_members written to file: ./logs/f9917aed-351a-43cb-9290-9a5c695b29d5_add_team_members_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:50:08Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:50:08Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:50:08Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:50:08Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:50:08Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Running: Grant teams access to repositories	
INFO:root:Preparing to execute 110 HTTP Requests.
Requests      [total, rate, throughput]         113, 5.04, 4.91
Duration      [total, attack, wait]             22.4s, 22.4s, 6.316µs
Latencies     [min, mean, 50, 90, 95, 99, max]  4.876µs, 294.634ms, 311.859ms, 315.074ms, 316.769ms, 343.831ms, 379.997ms
Bytes In      [total, mean]                     20680, 183.01
Bytes Out     [total, mean]                     1870, 16.55
Success       [ratio]                           97.35%
Status Codes  [code:count]                      0:3  200:110  
Error Set:
no targets to attack
INFO:root:Results for test add_teams_to_organizations written to file: ./logs/403f3892-4fd6-4dbf-9a04-e9e608ec8780_add_teams_to_organizations_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:50:32Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:50:32Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:50:32Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:50:32Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:50:32Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Created Job: test-registry-push3412-user-3
INFO:root:Created Job: test-registry-push3412-user-1
INFO:root:Created Job: test-registry-push3412-user-4
INFO:root:Created Job: test-registry-push3412-user-2
INFO:root:Created Job: test-registry-push3412-user-0
INFO:root:Job test-registry-push3412-user-4 has been completed.
INFO:root:Job test-registry-push3412-user-1 has been completed.
INFO:root:Job test-registry-push3412-user-3 has been completed.
INFO:root:Created Job: test-registry-pull3412-user-4
INFO:root:Created Job: test-registry-pull3412-user-3
INFO:root:Created Job: test-registry-pull3412-user-1
INFO:root:Job test-registry-push3412-user-2 has been completed.
INFO:root:Job test-registry-push3412-user-0 has been completed.
INFO:root:Created Job: test-registry-pull3412-user-2
INFO:root:Created Job: test-registry-pull3412-user-0
INFO:root:Job test-registry-pull3412-user-3 has been completed.
INFO:root:Job test-registry-pull3412-user-4 has been completed.
INFO:root:Job test-registry-pull3412-user-1 has been completed.
INFO:root:Job test-registry-pull3412-user-2 has been completed.
INFO:root:Job test-registry-pull3412-user-0 has been completed.
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Queued 5 tags to be created
INFO:root:Queued 5 tags to be pulled
INFO:root:Created Job: test-registry-push3412-user-7
INFO:root:Created Job: test-registry-push3412-user-9
INFO:root:Created Job: test-registry-push3412-user-6
INFO:root:Created Job: test-registry-push3412-user-5
INFO:root:Created Job: test-registry-push3412-user-8
INFO:root:Job test-registry-push3412-user-6 has been completed.
INFO:root:Created Job: test-registry-pull3412-user-6
INFO:root:Job test-registry-push3412-user-8 has been completed.
INFO:root:Job test-registry-push3412-user-7 has been completed.
INFO:root:Job test-registry-push3412-user-9 has been completed.
INFO:root:Job test-registry-push3412-user-5 has been completed.
INFO:root:Created Job: test-registry-pull3412-user-8
INFO:root:Created Job: test-registry-pull3412-user-7
INFO:root:Created Job: test-registry-pull3412-user-9
INFO:root:Created Job: test-registry-pull3412-user-5
INFO:root:Job test-registry-pull3412-user-6 has been completed.
INFO:root:Job test-registry-pull3412-user-7 has been completed.
INFO:root:Job test-registry-pull3412-user-8 has been completed.
INFO:root:Job test-registry-pull3412-user-9 has been completed.
INFO:root:Job test-registry-pull3412-user-5 has been completed.
INFO:root:Running: get_catalog	
INFO:root:Preparing to execute 1000 HTTP Requests.
Requests      [total, rate, throughput]         1002, 5.00, 5.00
Duration      [total, attack, wait]             3m20s, 3m20s, 6.904µs
Latencies     [min, mean, 50, 90, 95, 99, max]  6.885µs, 4.698ms, 4.68ms, 5.48ms, 5.669ms, 10.305ms, 21.972ms
Bytes In      [total, mean]                     20000, 19.96
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           99.80%
Status Codes  [code:count]                      0:2  200:1000  
Error Set:
no targets to attack
INFO:root:Results for test get_catalog written to file: ./logs/aa64e130-21f6-47d1-88e7-467c0633de89_get_catalog_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T21:57:55Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T21:57:55Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T21:57:55Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T21:57:55Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T21:57:55Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'
INFO:root:List Tags	repository=repo_with_5_tags
INFO:root:Preparing to execute 1000 HTTP Requests.
Requests      [total, rate, throughput]         1002, 5.00, 5.00
Duration      [total, attack, wait]             3m20s, 3m20s, 7.995µs
Latencies     [min, mean, 50, 90, 95, 99, max]  7.861µs, 11.575ms, 11.724ms, 13.788ms, 14.463ms, 30.072ms, 63.572ms
Bytes In      [total, mean]                     62000, 61.88
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           99.80%
Status Codes  [code:count]                      0:2  200:1000  
Error Set:
no targets to attack
INFO:root:Results for test list_tags_for_repo_with_5_tags written to file: ./logs/bb533298-f5ff-4e31-a75b-fef874496614_list_tags_for_repo_with_5_tags_result.json
INFO:root:Recording test results in ElasticSearch: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com
INFO:root:b'2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: logging level is INFO\n2023-04-30T22:01:17Z - INFO     - MainProcess - _load_benchmarks: Successfully imported 3 benchmark modules: coremarkpro, systemd_analyze, uperf\n2023-04-30T22:01:17Z - INFO     - MainProcess - _load_benchmarks: Failed to import 0 benchmark modules: \n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: Using elasticsearch server with host: https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com\n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: Using index prefix for ES: ripsaw-vegeta\n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: Connected to the elasticsearch cluster with info as follows:\n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: {\n    "name": "0bcd132328f2f0c8ee451d471960750e",\n    "cluster_name": "415909267177:perfscale-dev",\n    "cluster_uuid": "Xz2IU4etSieAeaO2j-QCUw",\n    "version": {\n        "number": "7.10.2",\n        "build_type": "tar",\n        "build_hash": "unknown",\n        "build_date": "2023-03-22T14:16:51.874273Z",\n        "build_snapshot": false,\n        "lucene_version": "9.3.0",\n        "minimum_wire_compatibility_version": "7.10.0",\n        "minimum_index_compatibility_version": "7.0.0"\n    },\n    "tagline": "The OpenSearch Project: https://opensearch.org/"\n}\n2023-04-30T22:01:17Z - INFO     - MainProcess - py_es_bulk: Using streaming bulk indexer\n2023-04-30T22:01:17Z - INFO     - MainProcess - wrapper_factory: identified vegeta as the benchmark wrapper\n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: Indexed results - 1 success, 0 duplicates, 0 failures, with 0 retries.\n2023-04-30T22:01:17Z - INFO     - MainProcess - run_snafu: Duration of execution - 0:00:00, with total size of 232 bytes\n'

Attacker().run_vegeta('create_users', reqs, target_name=target_name)

@staticmethod
def update_passwords(quay_url, usernames, password):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

something to note here: This function will work only on a standalone quay deployment and not on quay.io because superuser is disabled in quay.io

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Acknowledged. I am keeping it same for now. Will replace them as below once we get to quay.io in our testing.

  • POST /api/v1/superuser/users -> POST /api/v1/user/ for creating users, which is working.
  • But PUT /api/v1/superuser/users -> PUT /api/v1/user/ is not working (Getting 500 error response), may be due to users not having admin roles while being created using /api/v1/user endpoint. Ref: code.

So is there a way to do a PUT operation on /api/v1/user endpoint or is there an endpoint exposed for update user role to admin (Couldn't find one from the list of exposed endpoints)? Because we are using this PUT operation to update user passwords. Please let me know your thoughts on this. Thanks!

@vishnuchalla vishnuchalla merged commit b51e0ad into quay:master May 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants