Test failure JIT/superpmi/superpmicollect/superpmicollect.sh

[v-wenyuxu]

Failed in Run: runtime-coreclr outerloop 20230312.2

Failed tests:

coreclr linux arm Checked @ (Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7
    - JIT/superpmi/superpmicollect/superpmicollect.sh

Error message:

ERROR: program /usr/bin/perl not found

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false superpmicollect.dll ''
SuperPMI collection and playback - BEGIN
Setting environment variables:
   SuperPMIShimLogPath=/tmp/hpyohdl2.ol2SPMI
   SuperPMIShimPath=/root/helix/work/correlation/libclrjit.so
   DOTNET_JitName=libsuperpmi-shim-collector.so
SuperPMI collection and playback - FAILED
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 3/12/2023 7:36:18 PM
Test Harness Exitcode is : 1
To run the test:
> set CORE_ROOT=/root/helix/work/correlation
> /root/helix/work/workitem/e/JIT/superpmi/superpmicollect/superpmicollect.sh
Expected: True
Actual:   False

Stack trace:

  at JIT_superpmi._superpmicollect_superpmicollect_._superpmicollect_superpmicollect_sh()
  at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
  at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

Queued	Pipeline	Pipeline_Configuration	OS	Arch	Test	Outcome	Properties	BuildReason
2023-03-12T19:10:20.019Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"AzurePipelinesTestRunId":"3777707","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","BuildNumber":"20230312.2","configuration":"Checked-no_tiered_compilation","System.PhaseAttempt":"1","Project":"public","System.StageName":"Build","Reason":"Schedule","System.JobName":"__default","System.StageAttempt":"1","DefinitionId":"108","BuildId":"201881","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm_checked","architecture":"arm","DefinitionName":"runtime-coreclr outerloop","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273"}	Schedule
2023-03-12T19:10:18.817Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","BuildId":"201881","System.JobName":"__default","BuildNumber":"20230312.2","Project":"public","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","configuration":"Checked","System.StageName":"Build","DefinitionId":"108","Reason":"Schedule","DefinitionName":"runtime-coreclr outerloop","System.PhaseName":"run_test_p1__linux_musl_arm_checked","architecture":"arm","AzurePipelinesTestRunId":"3777706","System.StageAttempt":"1"}	Schedule
2023-03-12T19:08:54.174Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.StageName":"Build","Project":"public","System.StageAttempt":"1","AzurePipelinesTestRunId":"3777701","System.PhaseName":"run_test_p1__linux_musl_x64_checked","BuildId":"201881","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","BuildNumber":"20230312.2","configuration":"Checked-no_tiered_compilation","DefinitionId":"108","Reason":"Schedule","architecture":"x64","DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","System.JobAttempt":"1","System.JobName":"__default"}	Schedule
2023-03-12T19:08:52.976Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.PhaseAttempt":"1","System.StageAttempt":"1","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"201881","architecture":"x64","configuration":"Checked","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","Project":"public","System.JobAttempt":"1","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_musl_x64_checked","System.StageName":"Build","BuildNumber":"20230312.2","DefinitionId":"108","AzurePipelinesTestRunId":"3777700","DefinitionName":"runtime-coreclr outerloop","System.JobName":"__default"}	Schedule
2023-03-12T19:08:30.397Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Project":"public","architecture":"arm64","DefinitionId":"108","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","DefinitionName":"runtime-coreclr outerloop","System.StageAttempt":"1","AzurePipelinesTestRunId":"3777695","BuildId":"201881","System.StageName":"Build","System.JobAttempt":"1","BuildNumber":"20230312.2","System.PhaseAttempt":"1","Reason":"Schedule"}	Schedule
2023-03-12T19:08:29.491Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Reason":"Schedule","BuildId":"201881","System.StageName":"Build","Project":"public","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"3777694","architecture":"arm64","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.JobAttempt":"1","DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","BuildNumber":"20230312.2","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","System.JobName":"__default","configuration":"Checked","System.PhaseName":"run_test_p1__linux_musl_arm64_checked"}	Schedule
2023-03-12T10:10:00.48Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.JobAttempt":"1","BuildId":"201774","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","DefinitionName":"runtime-coreclr outerloop","BuildNumber":"20230312.1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_x64_checked","AzurePipelinesTestRunId":"3776325","Reason":"Schedule","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","DefinitionId":"108","Project":"public","System.StageName":"Build","configuration":"Checked-no_tiered_compilation","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","System.JobName":"__default"}	Schedule
2023-03-12T10:09:59.355Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.StageName":"Build","AzurePipelinesTestRunId":"3776324","System.PhaseAttempt":"1","architecture":"x64","configuration":"Checked","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","Reason":"Schedule","DefinitionId":"108","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","Project":"public","BuildId":"201774","DefinitionName":"runtime-coreclr outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_x64_checked","BuildNumber":"20230312.1"}	Schedule
2023-03-12T10:09:51.213Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"configuration":"Checked-no_tiered_compilation","architecture":"arm64","System.JobAttempt":"1","System.JobName":"__default","Project":"public","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","BuildId":"201774","BuildNumber":"20230312.1","System.StageAttempt":"1","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","Reason":"Schedule","AzurePipelinesTestRunId":"3776317"}	Schedule
2023-03-12T10:09:50.197Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Reason":"Schedule","BuildId":"201774","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionName":"runtime-coreclr outerloop","DefinitionId":"108","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","System.PhaseAttempt":"1","System.StageName":"Build","configuration":"Checked","AzurePipelinesTestRunId":"3776315","architecture":"arm64","Project":"public","System.StageAttempt":"1","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","BuildNumber":"20230312.1"}	Schedule
2023-03-12T10:08:57.168Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"BuildNumber":"20230312.1","architecture":"arm","DefinitionId":"108","System.JobAttempt":"1","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","configuration":"Checked-no_tiered_compilation","System.PhaseName":"run_test_p1__linux_musl_arm_checked","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","AzurePipelinesTestRunId":"3776309","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","System.StageAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","System.PhaseAttempt":"1","BuildId":"201774"}	Schedule
2023-03-12T10:08:56.209Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Project":"public","DefinitionName":"runtime-coreclr outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildNumber":"20230312.1","System.JobName":"__default","configuration":"Checked","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","BuildId":"201774","architecture":"arm","AzurePipelinesTestRunId":"3776307","System.StageName":"Build","Reason":"Schedule","DefinitionId":"108","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm_checked","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","System.PhaseAttempt":"1"}	Schedule

More failures

Queued	OS	Arch	Column1
2023-03-12T02:10:11.275Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-12T02:10:10.264Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-12T02:09:55.654Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-12T02:09:54.522Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-12T02:08:42.318Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-12T02:08:40.947Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:11:03.853Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:03.853Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:02.823Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:02.823Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-11T19:10:28.327Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:10:28.327Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:10:27.158Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:10:27.158Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:09:43.221Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:09:43.221Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:09:41.977Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:09:41.977Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch, @kunalspathak
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Failed in Run: runtime-coreclr outerloop 20230312.2

Failed tests:

coreclr linux arm Checked @ (Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7
    - JIT/superpmi/superpmicollect/superpmicollect.sh

Error message:

ERROR: program /usr/bin/perl not found

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt
Raw output:
BEGIN EXECUTION
/root/helix/work/correlation/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false superpmicollect.dll ''
SuperPMI collection and playback - BEGIN
Setting environment variables:
   SuperPMIShimLogPath=/tmp/hpyohdl2.ol2SPMI
   SuperPMIShimPath=/root/helix/work/correlation/libclrjit.so
   DOTNET_JitName=libsuperpmi-shim-collector.so
SuperPMI collection and playback - FAILED
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 3/12/2023 7:36:18 PM
Test Harness Exitcode is : 1
To run the test:
> set CORE_ROOT=/root/helix/work/correlation
> /root/helix/work/workitem/e/JIT/superpmi/superpmicollect/superpmicollect.sh
Expected: True
Actual:   False

Stack trace:

  at JIT_superpmi._superpmicollect_superpmicollect_._superpmicollect_superpmicollect_sh()
  at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
  at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

Queued	Pipeline	Pipeline_Configuration	OS	Arch	Test	Outcome	Properties	BuildReason
2023-03-12T19:10:20.019Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"AzurePipelinesTestRunId":"3777707","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","BuildNumber":"20230312.2","configuration":"Checked-no_tiered_compilation","System.PhaseAttempt":"1","Project":"public","System.StageName":"Build","Reason":"Schedule","System.JobName":"__default","System.StageAttempt":"1","DefinitionId":"108","BuildId":"201881","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm_checked","architecture":"arm","DefinitionName":"runtime-coreclr outerloop","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273"}	Schedule
2023-03-12T19:10:18.817Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","BuildId":"201881","System.JobName":"__default","BuildNumber":"20230312.2","Project":"public","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","configuration":"Checked","System.StageName":"Build","DefinitionId":"108","Reason":"Schedule","DefinitionName":"runtime-coreclr outerloop","System.PhaseName":"run_test_p1__linux_musl_arm_checked","architecture":"arm","AzurePipelinesTestRunId":"3777706","System.StageAttempt":"1"}	Schedule
2023-03-12T19:08:54.174Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.StageName":"Build","Project":"public","System.StageAttempt":"1","AzurePipelinesTestRunId":"3777701","System.PhaseName":"run_test_p1__linux_musl_x64_checked","BuildId":"201881","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","BuildNumber":"20230312.2","configuration":"Checked-no_tiered_compilation","DefinitionId":"108","Reason":"Schedule","architecture":"x64","DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","System.JobAttempt":"1","System.JobName":"__default"}	Schedule
2023-03-12T19:08:52.976Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.PhaseAttempt":"1","System.StageAttempt":"1","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"201881","architecture":"x64","configuration":"Checked","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","Project":"public","System.JobAttempt":"1","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_musl_x64_checked","System.StageName":"Build","BuildNumber":"20230312.2","DefinitionId":"108","AzurePipelinesTestRunId":"3777700","DefinitionName":"runtime-coreclr outerloop","System.JobName":"__default"}	Schedule
2023-03-12T19:08:30.397Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Project":"public","architecture":"arm64","DefinitionId":"108","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","DefinitionName":"runtime-coreclr outerloop","System.StageAttempt":"1","AzurePipelinesTestRunId":"3777695","BuildId":"201881","System.StageName":"Build","System.JobAttempt":"1","BuildNumber":"20230312.2","System.PhaseAttempt":"1","Reason":"Schedule"}	Schedule
2023-03-12T19:08:29.491Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Reason":"Schedule","BuildId":"201881","System.StageName":"Build","Project":"public","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"3777694","architecture":"arm64","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.JobAttempt":"1","DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","BuildNumber":"20230312.2","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","System.JobName":"__default","configuration":"Checked","System.PhaseName":"run_test_p1__linux_musl_arm64_checked"}	Schedule
2023-03-12T10:10:00.48Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.JobAttempt":"1","BuildId":"201774","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","DefinitionName":"runtime-coreclr outerloop","BuildNumber":"20230312.1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_x64_checked","AzurePipelinesTestRunId":"3776325","Reason":"Schedule","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","DefinitionId":"108","Project":"public","System.StageName":"Build","configuration":"Checked-no_tiered_compilation","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","System.JobName":"__default"}	Schedule
2023-03-12T10:09:59.355Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt	x64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"System.StageName":"Build","AzurePipelinesTestRunId":"3776324","System.PhaseAttempt":"1","architecture":"x64","configuration":"Checked","operatingSystem":"(Alpine.315.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-amd64","Reason":"Schedule","DefinitionId":"108","System.JobId":"958a2a9a-ade5-50b3-3ce6-ea69efbcce9c","Project":"public","BuildId":"201774","DefinitionName":"runtime-coreclr outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_x64_checked","BuildNumber":"20230312.1"}	Schedule
2023-03-12T10:09:51.213Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"configuration":"Checked-no_tiered_compilation","architecture":"arm64","System.JobAttempt":"1","System.JobName":"__default","Project":"public","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","BuildId":"201774","BuildNumber":"20230312.1","System.StageAttempt":"1","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","Reason":"Schedule","AzurePipelinesTestRunId":"3776317"}	Schedule
2023-03-12T10:09:50.197Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm64	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Reason":"Schedule","BuildId":"201774","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionName":"runtime-coreclr outerloop","DefinitionId":"108","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm64_checked","System.JobId":"7c87b8fc-cd86-5445-5ca8-4814cf8d81d6","System.PhaseAttempt":"1","System.StageName":"Build","configuration":"Checked","AzurePipelinesTestRunId":"3776315","architecture":"arm64","Project":"public","System.StageAttempt":"1","operatingSystem":"(Alpine.315.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm64v8","BuildNumber":"20230312.1"}	Schedule
2023-03-12T10:08:57.168Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"BuildNumber":"20230312.1","architecture":"arm","DefinitionId":"108","System.JobAttempt":"1","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","configuration":"Checked-no_tiered_compilation","System.PhaseName":"run_test_p1__linux_musl_arm_checked","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","AzurePipelinesTestRunId":"3776309","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","System.StageAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr outerloop","Reason":"Schedule","System.PhaseAttempt":"1","BuildId":"201774"}	Schedule
2023-03-12T10:08:56.209Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open	arm	JIT/superpmi/superpmicollect/superpmicollect.sh	Failed	{"Project":"public","DefinitionName":"runtime-coreclr outerloop","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildNumber":"20230312.1","System.JobName":"__default","configuration":"Checked","System.JobId":"67940218-a6cd-574d-6681-11ea1e4ee273","BuildId":"201774","architecture":"arm","AzurePipelinesTestRunId":"3776307","System.StageName":"Build","Reason":"Schedule","DefinitionId":"108","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_musl_arm_checked","operatingSystem":"(Alpine.315.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.15-helix-arm32v7","System.PhaseAttempt":"1"}	Schedule

More failures

Queued	OS	Arch	Column1
2023-03-12T02:10:11.275Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-12T02:10:10.264Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-12T02:09:55.654Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-12T02:09:54.522Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-12T02:08:42.318Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-12T02:08:40.947Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:11:03.853Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:03.853Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:02.823Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-11T19:11:02.823Z	runtime-coreclr outerloop	Checked	ubuntu.1804.amd64.open.rt
2023-03-11T19:10:28.327Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:10:28.327Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:10:27.158Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:10:27.158Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:09:43.221Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:09:43.221Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T19:09:41.977Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T19:09:41.977Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:16.741Z	runtime-coreclr outerloop	Checked-no_tiered_compilation	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open
2023-03-11T10:09:15.577Z	runtime-coreclr outerloop	Checked	ubuntu.1804.armarch.open

Author:	v-wenyuxu
Assignees:	-
Labels:	os-linux, area-CodeGen-coreclr, untriaged, blocking-outerloop
Milestone:	-

[BruceForstall]

It looks like the failures are only on Alpine.

The "ERROR: program /usr/bin/perl not found" is probably coming because the test invokes perl:

runtime/src/tests/JIT/superpmi/superpmicollect.cs

Line 227 in bd7e1cb

RunProgram("/usr/bin/perl", @"-pi -e 's/\r\n|\n|\r/\n/g' " + "\"" + testName + "\"");

Maybe Alpine no longer has perl? Or maybe we just started running this test on Alpine?

[BruceForstall]

Alpine images were just updated: #82931

[BruceForstall]

@wfurt @ManickaP You updated the Alpine images we use for testing. It looks like possibly the new images don't contain perl and this test depends on perl being available.

Is it an easy fix to add (back) perl? How is that specified?

[BruceForstall]

Maybe the change that actually caused perl to be removed from the Alpine images was dotnet/dotnet-buildtools-prereqs-docker#818?

[jakobbotsch]

The perl use here is just normalizing the newlines, can it be replaced by some simple C# code to accomplish the same?
Is it even still necessary? It refers to runtest.sh but I can't find what it refers to.

[wfurt]

We can bring Perl back. I tried to keep the image minimal bu we can certainly bring more. As @jakobbotsch said, we can perhaps fix it in different ways - perhaps in stages. Either via shell script, c# or Pythin (that is needed anyway for Helix)
Let me know how you want to move forward @BruceForstall

[BruceForstall]

I'll look into alternatives, either C# or Python.

Is it even still necessary?

Possibly not. We used to build the wrapper scripts on Windows (even the .sh ones) and copy them to Linux/Mac for running, where they would need CR/LF->LF munging before running. Not sure if that's still required.