ReleaseMutex failed. WaitOne Id: {originalThreadId} Release Id: {releaseThreadId} in Microsoft.Extensions.Logging.Generators.Roslyn4.0

[carlossanlop]

Found in a release/7.0 backport PR: dotnet/runtime#75284

Please help determine if this needs a fix to get backported to 7.0.

• Queue: Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly
• Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8964&view=logs&j=8d661eb8-1694-5b60-6fbc-3f561a726c69&t=85fabc09-846c-57ca-7481-53449124685f&l=2817
• Build log message:

Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/ref/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: Unexpected exception:  [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: (NETCORE_ENGINEERING_TELEMETRY=Build) Unexpected exception: 
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : (NETCORE_ENGINEERING_TELEMETRY=Build) One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12)
  Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
 

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Found in a release/7.0 backport PR: dotnet/runtime#75284

Please help determine if this needs a fix to get backported to 7.0.

• Queue: Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly
• Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8964&view=logs&j=8d661eb8-1694-5b60-6fbc-3f561a726c69&t=85fabc09-846c-57ca-7481-53449124685f&l=2817
• Build log message:

Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/ref/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: Unexpected exception:  [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: (NETCORE_ENGINEERING_TELEMETRY=Build) Unexpected exception: 
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : (NETCORE_ENGINEERING_TELEMETRY=Build) One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12)
  Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
 

Author:	carlossanlop
Assignees:	-
Labels:	arch-wasm, area-Extensions-Logging, source-generator
Milestone:	-

Tagging subscribers to this area: @dotnet/area-extensions-logging
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Found in a release/7.0 backport PR: dotnet/runtime#75284

Please help determine if this needs a fix to get backported to 7.0.

• Queue: Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly
• Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8964&view=logs&j=8d661eb8-1694-5b60-6fbc-3f561a726c69&t=85fabc09-846c-57ca-7481-53449124685f&l=2817
• Build log message:

Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/ref/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: Unexpected exception:  [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: (NETCORE_ENGINEERING_TELEMETRY=Build) Unexpected exception: 
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : (NETCORE_ENGINEERING_TELEMETRY=Build) One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12)
  Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
 

Author:	carlossanlop
Assignees:	-
Labels:	arch-wasm, area-Extensions-Logging, source-generator
Milestone:	-

[carlossanlop]

@lewing @radical @steveisok @akoeplinger

[radical]

Looks similar to dotnet/runtime#70836 .

[steveisok]

Should we run these tests on wasm/mobile at all?

[radical]

This is probably getting triggered because src/libraries has changes.

[radical]

This is not even running any tests, it's failing while building. And the will only build - Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly.

[lewing]

yeah this is a CSC crash it isn't really wasm related

[tarekgh]

error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]

Does this suggest something not supported on WASM?

[lewing]

There is no wasm running at all at this point, it looks like the generator failed for some reason.

[eerhardt]

Looks like it is coming from this line in Roslyn:

roslyn/src/Compilers/Shared/BuildServerConnection.cs

Line 245 in 3e39dd3

var message = $"ReleaseMutex failed. WaitOne Id: {originalThreadId} Release Id: {releaseThreadId}";

[radical]

"/__w/1/s/.packages/microsoft.dotnet.arcade.sdk/7.0.0-beta.22418.4/tools/Build.proj" (default target) (1) ->
"/__w/1/s/Build.proj" (Build target) (3:2) ->
"/__w/1/s/src/libraries/oob.proj" (default target) (333) ->
"/__w/1/s/src/libraries/shims.proj" (default target) (334) ->
"/__w/1/s/src/libraries/shims/src/WindowsBase.csproj" (default target) (362) ->
"/__w/1/s/src/libraries/oob-src.proj" (default target) (339:23) ->
"/__w/1/s/src/libraries/Microsoft.Extensions.Caching.Memory/src/Microsoft.Extensions.Caching.Memory.csproj" (default target) (366:6) ->
"/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/src/Microsoft.Extensions.Logging.Abstractions.csproj" (default target) (389:7) ->
"/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj" (default target) (462:2) ->
(CoreGenerateSatelliteAssemblies target) ->
  /__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: Unexpected exception:  [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
  /__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]

[tarekgh]

Make sense @lewing.

Looking at the build analysis results too and I am seeing https://github.com/dotnet/runtime/pull/75284/checks?check_run_id=8258063425 all failures are on Mono only. This suggests specific to Mono.

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Found in a release/7.0 backport PR: dotnet/runtime#75284

Please help determine if this needs a fix to get backported to 7.0.

• Queue: Build Browser wasm Linux Release _Threading_PerfTracing_BuildOnly
• Job results: https://dev.azure.com/dnceng-public/public/_build/results?buildId=8964&view=logs&j=8d661eb8-1694-5b60-6fbc-3f561a726c69&t=85fabc09-846c-57ca-7481-53449124685f&l=2817
• Build log message:

Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/ref/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: Unexpected exception:  [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error MSB3883: (NETCORE_ENGINEERING_TELEMETRY=Build) Unexpected exception: 
/__w/1/s/.dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12) [/__w/1/s/src/libraries/Microsoft.Extensions.Logging.Abstractions/gen/Microsoft.Extensions.Logging.Generators.Roslyn4.0.csproj]
##[error].dotnet/sdk/7.0.100-preview.7.22377.5/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.Sdk.targets(952,5): error : (NETCORE_ENGINEERING_TELEMETRY=Build) One or more errors occurred. (ReleaseMutex failed. WaitOne Id: 12 Release Id: 12)
  Microsoft.Extensions.Configuration.Abstractions -> /__w/1/s/artifacts/bin/Microsoft.Extensions.Configuration.Abstractions/Release/net7.0/Microsoft.Extensions.Configuration.Abstractions.dll
 

Author:	carlossanlop
Assignees:	-
Labels:	arch-wasm, untriaged, area-Infrastructure-mono, source-generator
Milestone:	-