Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
953354 dotnet/roslyn Run Integration Tests Log
953158 dotnet/roslyn Run Integration Tests Log
952643 dotnet/roslyn Run Integration Tests Log
951994 dotnet/roslyn Run Integration Tests Log
951831 dotnet/roslyn Run Integration Tests Log
2642380 dotnet-interactive Test / Blame Log
2640448 dotnet-roslyn Run Unit Tests Log
947549 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
947519 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76665
947207 dotnet/roslyn Run Integration Tests Log
2639037 dotnet-interactive Test / Blame Log
945086 dotnet/roslyn Run Integration Tests Log
943509 dotnet/roslyn Run Unit Tests Log
943517 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
943510 dotnet/roslyn Run Integration Tests Log
941461 dotnet/roslyn Run Integration Tests Log
941307 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77059
2635492 dotnet-interactive Test / Blame Log
940054 dotnet/roslyn Run Integration Tests Log
2634639 dotnet-fsharp CmdLine@2 Log
2633709 dotnet-interactive Test / Blame Log
2631578 dotnet-interactive Test / Blame Log
931325 dotnet/roslyn Run Integration Tests Log
930761 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76932
928955 dotnet/roslyn Run Integration Tests Log
928927 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76918
928738 dotnet/roslyn Run Integration Tests Log
927094 dotnet/roslyn Run Integration Tests Log
2625793 dotnet-interactive Test / Blame Log
924837 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76852
2625489 dotnet-interactive Test / Blame Log
2625493 dotnet-interactive Test / Blame Log
923681 dotnet/roslyn Run Integration Tests Log
923659 dotnet/roslyn Run Integration Tests Log
921574 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75581
Build Definition Test Pull Request
953438 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46868
953411 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46874
2643482 dotnet-roslyn workitem_9.WorkItemExecution
2643419 dotnet-aspnetcore Microsoft.AspNetCore.Components.Forms.Tests--net10.0.WorkItemExecution
953179 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46868
953092 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#46860
952912 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46860
952938 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46836
952814 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46652
952597 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#42861
952584 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46829
952502 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#42861
952474 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46831
952393 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46837
952384 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#46803
952376 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#41376
952209 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46849
952195 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46846
952181 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46845
952283 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46853
952219 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46851
952075 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46837
952090 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45419
952016 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
952001 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46843
951909 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45520
951842 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46838
951749 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46836
951701 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46833
951573 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46800
951080 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46823
951072 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46759
951006 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46827
950887 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46759
950882 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46815
950867 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46812
950851 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46810
950681 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46803
950710 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46337
2641740 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
950631 dotnet/roslyn workitem_228.WorkItemExecution dotnet/roslyn#77172
950598 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46759
950572 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46786
950535 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46796
950216 dotnet/aspnetcore Sockets.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60247
950264 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46558
950064 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46779
949890 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46558
949881 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46783
949737 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46779
2641156 dotnet-aspnetcore Interop.FunctionalTests--net10.0.WorkItemExecution
2641152 dotnet-aspnetcore InMemory.FunctionalTests--net9.0.WorkItemExecution
949609 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution dotnet/sdk#46773
949487 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46717
949498 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution dotnet/sdk#46766
949473 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46377
949316 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46753
949358 dotnet/aspnetcore Sockets.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60326
949334 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46759
949323 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46757
949123 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46745
2640650 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
948953 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46742
948522 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45419
948679 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46377
948644 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46710
947957 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46633
947949 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46691
947928 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46546
947843 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46694
947698 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46701
947726 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46706
947612 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46675
2639773 dotnet-roslyn workitem_270.WorkItemExecution
947576 dotnet/aspire Aspire.Hosting.Azure.Tests.WorkItemExecution
947443 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46633
947114 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46694
947092 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46685
947079 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#43073
946702 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46642
946547 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46643
946370 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46633
946262 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46680
946278 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46676
946199 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46679
946050 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
946022 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46650
945969 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46663
945754 dotnet/aspnetcore Interop.FunctionalTests--net9.0.WorkItemExecution
945692 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46676
2638421 dotnet-aspnetcore Microsoft.AspNetCore.SignalR.Client.Tests--net10.0.WorkItemExecution
945548 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46675
2638215 dotnet-aspnetcore Microsoft.AspNetCore.App.Analyzers.Test--net10.0.WorkItemExecution
945204 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46546
945202 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46666
945197 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46664
945082 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#46527
945054 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46642
945020 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46653
2637864 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.Razor.RuntimeCompilation.Test--net9.0.WorkItemExecution
Displaying 100 of 591 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
20 104 626

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants