[CI] Add custom prefix to service RunID tests used in system tests

[mrodm]

Proposed commit message

Include the required environment variables to customize the TestRunID used in system tests run by elastic-package. This TestRunID is used among other things to add a suffix in the resources created by terraform.

Example of bucket created adding the prefix:

• elastic-package-canva-bucket-eabc63175
  • eabc prefix added
  • 63175 previous TestRunID value

Author's Checklist

• Test with canva package that creates resources in AWS via terraform.

How to test this PR locally

elastic-package stack up -v -d
cd packages/<package>/

export ELASTIC_PACKAGE_PREFIX_SERVICE_TEST_RUN_ID=1a2b
elastic-package test system -v

elastic-package stack down -v

Related issues

• Relates [system tests] Allow setting an optional prefix for the service TestRunID elastic-package#2744

[elastic-vault-github-plugin-prod]

🚀 Benchmarks report

Package aws 👍(15) 💚(5) 💔(2)

Expand to view

Data stream	Previous EPS	New EPS	Diff (%)	Result
cloudwatch_logs	500000	333333.33	-166666.67 (-33.33%)	💔
elb_logs	4807.69	3861	-946.69 (-19.69%)	💔

To see the full report comment with /test benchmark fullreport

[jsoriano]

We need to wait for a new version of elastic-package, right?

[mrodm]

No need to wait for a new version.

In this commit ffb5f8d I'm removing that replacement. It was there just to test that elastic-package run the system tests as expected.

[elasticmachine]

💔 Build Failed

• Buildkite Build
• Commit: ffb5f8d

Failed CI Steps

• Check integrations amazon_security_lake
• Check integrations apache
• Check integrations nginx
• Check integrations osquery_manager
• Check integrations panw
• Check integrations php_fpm
• Check integrations prisma_access
• Check integrations rapid7_insightvm
• Check integrations slack
• Check integrations suricata
• Check integrations symantec_endpoint_security
• Check integrations syslog_router
• Check integrations system_audit
• Check integrations tanium
• Check integrations tencent_cloud
• Check integrations ti_anomali
• Check integrations ti_rapid7_threat_command
• Check integrations vectra_rux
• Check integrations windows_etw
• Check integrations zeronetworks
• Check integrations zoom

History

• 💔 Build #28751 failed 82aefab
• 💚 Build #28747 succeeded 65c2bac
• 💔 Build #28745 failed 0013c62
• 💔 Build #28715 failed 8033933

cc @mrodm

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

[mrodm]

Merging PR since after retrying the builds failed, just apache and nginx packages have failed https://buildkite.com/elastic/integrations/builds/28762

This is a known issue #14523