Skip to content

Bicep Playground e2e is flaky #19382

@brendandburns

Description

@brendandburns

Logs:

Run dotnet test --configuration Release --no-build --nologo
  dotnet test --configuration Release --no-build --nologo
  shell: /usr/bin/bash -e {0}
  env:
    CI: true
    DOTNET_NOLOGO: true
    DOTNET_CLI_TELEMETRY_OPTOUT: true
    DOTNET_ROOT: /usr/share/dotnet
Test run for /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/bin/Release/net10.0/Bicep.Playground.E2ETests.dll (.NETCoreApp,Version=v10.0)
A total of 1 test files matched the specified pattern.
[xUnit.net 00:00:31.59]     Bicep.Playground.E2ETests.PlaygroundSpecs.WhenInsertingBicep_ThenShouldCompileToArmJson [FAIL]
  Failed Bicep.Playground.E2ETests.PlaygroundSpecs.WhenInsertingBicep_ThenShouldCompileToArmJson [30 s]
  Error Message:
   System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for Locator(".playground-editorpane").First
  Stack Trace:
     at Microsoft.Playwright.Transport.Connection.InnerSendMessageToServerAsync[T](ChannelOwner object, String method, Dictionary`2 dictionary, Boolean keepNulls) in /_/src/Playwright/Transport/Connection.cs:line 201
   at Microsoft.Playwright.Transport.Connection.WrapApiCallAsync[T](Func`1 action, Boolean isInternal, String title) in /_/src/Playwright/Transport/Connection.cs:line 499
   at Bicep.Playground.E2ETests.PlaygroundPage.PasteInBicepEditor(String bicep) in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundPage.cs:line 44
   at Bicep.Playground.E2ETests.PlaygroundSpecs.WhenInsertingBicep_ThenShouldCompileToArmJson() in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundSpecs.cs:line 82
--- End of stack trace from previous location ---
[xUnit.net 00:01:02.17]     Bicep.Playground.E2ETests.PlaygroundSpecs.WhenCopyLink_ThenContentShouldBeSameAfterOpenLink [FAIL]
  Failed Bicep.Playground.E2ETests.PlaygroundSpecs.WhenCopyLink_ThenContentShouldBeSameAfterOpenLink [30 s]
  Error Message:
   System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for Locator(".playground-editorpane").First
  Stack Trace:
     at Microsoft.Playwright.Transport.Connection.InnerSendMessageToServerAsync[T](ChannelOwner object, String method, Dictionary`2 dictionary, Boolean keepNulls) in /_/src/Playwright/Transport/Connection.cs:line 201
   at Microsoft.Playwright.Transport.Connection.WrapApiCallAsync[T](Func`1 action, Boolean isInternal, String title) in /_/src/Playwright/Transport/Connection.cs:line 499
   at Bicep.Playground.E2ETests.PlaygroundPage.PasteInBicepEditor(String bicep) in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundPage.cs:line 44
   at Bicep.Playground.E2ETests.PlaygroundSpecs.WhenCopyLink_ThenContentShouldBeSameAfterOpenLink() in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundSpecs.cs:line 68
--- End of stack trace from previous location ---
[xUnit.net 00:01:32.69]     Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplate_ThenShouldOpenSampleAndDecompileToArm [FAIL]
  Failed Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplate_ThenShouldOpenSampleAndDecompileToArm [30 s]
  Error Message:
   System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for GetByRole(AriaRole.Button, new() { Name = "Sample Template" })
  Stack Trace:
     at Microsoft.Playwright.Transport.Connection.InnerSendMessageToServerAsync[T](ChannelOwner object, String method, Dictionary`2 dictionary, Boolean keepNulls) in /_/src/Playwright/Transport/Connection.cs:line 201
   at Microsoft.Playwright.Transport.Connection.WrapApiCallAsync[T](Func`1 action, Boolean isInternal, String title) in /_/src/Playwright/Transport/Connection.cs:line 499
   at Bicep.Playground.E2ETests.PlaygroundPage.SelectSampleTemplate(String templateName) in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundPage.cs:line 58
   at Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplate_ThenShouldOpenSampleAndDecompileToArm() in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundSpecs.cs:line 45
--- End of stack trace from previous location ---
[xUnit.net 00:02:03.17]     Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplateWithLocalModules_ThenShouldCompileToArm [FAIL]
  Failed Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplateWithLocalModules_ThenShouldCompileToArm [30 s]
  Error Message:
   System.TimeoutException : Timeout 30000ms exceeded.
Call log:
  - waiting for GetByRole(AriaRole.Button, new() { Name = "Sample Template" })
  Stack Trace:
     at Microsoft.Playwright.Transport.Connection.InnerSendMessageToServerAsync[T](ChannelOwner object, String method, Dictionary`2 dictionary, Boolean keepNulls) in /_/src/Playwright/Transport/Connection.cs:line 201
   at Microsoft.Playwright.Transport.Connection.WrapApiCallAsync[T](Func`1 action, Boolean isInternal, String title) in /_/src/Playwright/Transport/Connection.cs:line 499
   at Bicep.Playground.E2ETests.PlaygroundPage.SelectSampleTemplate(String templateName) in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundPage.cs:line 58
   at Bicep.Playground.E2ETests.PlaygroundSpecs.WhenSelectingQuickStarterTemplateWithLocalModules_ThenShouldCompileToArm() in /home/runner/work/bicep/bicep/src/Bicep.Playground.E2ETests/PlaygroundSpecs.cs:line 58
--- End of stack trace from previous location ---

Failed!  - Failed:     4, Passed:     0, Skipped:     0, Total:     4, Duration: 2 m 2 s - Bicep.Playground.E2ETests.dll (net10.0)
Error: Process completed with exit code 1.

Metadata

Metadata

Type

No type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions