Skip to content

Conversation

@zivkan
Copy link
Member

@zivkan zivkan commented Sep 28, 2022

Bug

Tracking issue: NuGet/Home#12122

Regression? no

Description

See linked issue for details

PR Checklist

  • PR has a meaningful title

  • PR has a linked issue.

  • Described changes

  • Tests

    • Automated tests added
    • OR
    • Test exception
    • OR
    • N/A
  • Documentation

    • Documentation PR or issue filled
    • OR
    • N/A

@zivkan zivkan requested a review from a team as a code owner September 28, 2022 06:46
Copy link
Contributor

@erdembayar erdembayar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

According to https://github.com/NuGet/Entropy/tree/main/client-ci-analysis/ci-testfailure-analyzer this test failed 17 times in last 30 weeks, so this is definitely flaky test.
image

@kartheekp-ms
Copy link
Contributor

kartheekp-ms commented Sep 28, 2022

According to https://github.com/NuGet/Entropy/tree/main/client-ci-analysis/ci-testfailure-analyzer this test failed 17 times in last 30 weeks, so this is definitely flaky test.

I didn't know that we have an analyzer to help analyze CI builds for failed/flaky tests. Good find @erdembayar. Thanks.

This test has failed few times in my PR builds also. I am okay to skip this one for now.

@zivkan
Copy link
Member Author

zivkan commented Sep 28, 2022

@erdembayar Azure DevOps also has an "Analytics" tab near the top of the page when viewing the pipeline. The test analytics can show the most common failures. It's a bit limited in its functionality, so a custom tool certainly has the potential for more advanced features, but if you just want to check most common test failures, it's probably quicker to used AzDO's website.

@zivkan zivkan merged commit d0e9194 into dev Sep 28, 2022
@zivkan zivkan deleted the dev-zivkan-skip-flaky-plugin-test branch September 28, 2022 20:28
AdmiringWorm added a commit to chocolatey/NuGet.Client that referenced this pull request Dec 19, 2022
Insert 6.4.0-rc.123 into rel/d17.4 on 11/07/2022 23:47:12

* tag '6.4.0.123': (60 commits)
  fix a logic error that caused AbandonedMutexException while executing migrations (release-6.4.x) (NuGet#4895)
  unblock source build failing due to fatal: transport 'file' not allowed error (NuGet#4867) (NuGet#4874)
  Signing:  update to August 2022 CTL (NuGet#4791) (NuGet#4850)
  Merged PR 422933: Prefer BCL Directory create API over helper class (7.0.1xx-rc2)
  Fix empty combobox when package is not present in project file (NuGet#4844) (NuGet#4848)
  Fix component detection alert for microsoft.owin package (NuGet#4841) (NuGet#4845)
  Make release label RC, move to escrow mode
  Adds special case to include transitive origins in GetInstalledAndTransitivePackagesAsync API (NuGet#4824)
  Add longPathAware manifest to NuGet.Build.Tasks.Console (NuGet#4830)
  VsPackageInstallerServices should not post ProjectNotNominatedException faults (NuGet#4814)
  Skip test GetOrCreateAsync_WithUnhandledExceptionInPlugin_Throws (NuGet#4831)
  Improve OptProf pipeline job run names (NuGet#4825)
  Increase HttpClientHandler.MaxConnectionsPerServer to 64 to improve PM UI performance in Visual Studio (NuGet#4798)
  Suppress CA2213 warnings to unblock dev branch (NuGet#4823)
  Ensure IsVsOfflineFeed is calculated correctly on 64-bit machines (NuGet#4817)
  Add better handling of AggregateExceptions in static graph-based restore (NuGet#4809)
  Add Component Detection task into each pipeline (NuGet#4813)
  Localizes nuget.exe with default, embedded resource assembly lookup (NuGet#4773)
  Removes BrowseObjectBase class in NuGet Solution Explorer (NuGet#4807)
  Improve TryCreateContext  (NuGet#4762)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants