[NativeAOT-iOS] MacCatalyst fails to start/log `nativeaot.SmokeTests` tests

[matouskozak]

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Build error leg or test failing:

• nativeaot.SmokeTests.Reflection,
• nativeaot.SmokeTests.StackTraceMetadata
• nativeaot.SmokeTests.Preinitialization

Affected CI: maccatalyst-arm64 Release AllSubsets_NativeAOT_RuntimeTests (runtime-extra-platforms)

The test are failing either with:
XHarness exit code: 83 (APP_LAUNCH_FAILURE)

[05:10:37.6845280] The application cannot be opened for an unexpected reason, error=Error Domain=NSOSStatusErrorDomain Code=-600 "procNotFound: no eligible process with specified descriptor" UserInfo={_LSLine=387, _LSFunction=_LSAnnotateAndSendAppleEventWithOptions}

or
XHarness exit code: 82 (RETURN_CODE_NOT_SET)

Failed to detect application's exit code. The log file was empty / not found at /tmp/helix/working/9D2308EA/w/9FFA08F1/uploads/Reports/nativeaot.SmokeTests.Reflection/Reflection/net.dot.nativeaot_SmokeTests_Reflection.log

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorPattern": "nativeaot/SmokeTests/.+\\[FAIL\\]",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Error message validated: [nativeaot/SmokeTests/.+\[FAIL\]]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/12/2024 10:07:58 AM UTC

Report

Build	Definition	Test	Pull Request
1428980	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1428400	dotnet/runtime	nativeaot.SmokeTests.DynamicGenerics.WorkItemExecution
1427585	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1427236	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1425179	dotnet/runtime	nativeaot.SmokeTests.DynamicGenerics.WorkItemExecution
1420282	dotnet/runtime	nativeaot.SmokeTests.TrimmingBehaviors.WorkItemExecution
1419167	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1418874	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution
1418441	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1418163	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1418184	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1418156	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1412581	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1412157	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1410405	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1409175	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
1404155	dotnet/runtime	nativeaot.SmokeTests.AttributeTrimming.WorkItemExecution
1402968	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
1400922	dotnet/runtime	nativeaot.SmokeTests.UnitTests.WorkItemExecution
1395964	dotnet/runtime	nativeaot.SmokeTests.AttributeTrimming.WorkItemExecution
1391817	dotnet/runtime	nativeaot.SmokeTests.Preinitialization.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	5	21

[matouskozak]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

[ivanpovazan]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

I don't think so, that issue did disable the test, but we had a failure with it on tvos-arm64 even before in:
#90460

If I remember correctly the behavior was similar to what you are getting ie the device log showed correct output in the logs but test return value was not what the test runner expected.

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.

[ivanpovazan]

@matouskozak @kotlarmilos could you check this:

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.