Skip to content

Update test framework to support RRTs#12012

Merged
lakshmimsft merged 3 commits into
mainfrom
feat/core-types-test-migration
Jun 4, 2026
Merged

Update test framework to support RRTs#12012
lakshmimsft merged 3 commits into
mainfrom
feat/core-types-test-migration

Conversation

@lakshmimsft

@lakshmimsft lakshmimsft commented May 28, 2026

Copy link
Copy Markdown
Contributor

This pull request extends the functional test framework to support the new resource types (Radius.Core/environments, Radius.Core/applications, Radius.Compute/containers) alongside the existing Applications.Core/* types. It migrates the first group of tests as aproof-of-concept.

Type of change

Fixes: #11942

Contributor checklist

Please verify that the PR meets the following requirements, where applicable:

  • An overview of proposed schema changes is included in a linked GitHub issue.
    • Yes
    • Not applicable
  • A design document is added or updated under eng/design-notes/ in this repository, if new APIs are being introduced.
    • Yes
    • Not applicable
  • The design document has been reviewed and approved by Radius maintainers/approvers.
    • Yes
    • Not applicable
  • A PR for resource-types-contrib is created, if resource types or recipes are affected by the changes in this PR.
    • Yes
    • Not applicable
  • A PR for dashboard is created, if the Radius Dashboard is affected by the changes in this PR.
    • Yes
    • Not applicable
  • A PR for the documentation repository is created, if the changes in this PR affect the documentation or any user facing updates are made.
    • Yes
    • Not applicable

@github-actions

github-actions Bot commented May 28, 2026

Copy link
Copy Markdown

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@github-actions

github-actions Bot commented May 28, 2026

Copy link
Copy Markdown

Unit Tests

    2 files  ±0    438 suites  ±0   7m 19s ⏱️ -9s
5 322 tests ±0  5 320 ✅ ±0  2 💤 ±0  0 ❌ ±0 
6 476 runs  ±0  6 474 ✅ ±0  2 💤 ±0  0 ❌ ±0 

Results for commit a1d1e6f. ± Comparison against base commit 6233b4b.

♻️ This comment has been updated with latest results.

@codecov

codecov Bot commented May 28, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 52.14%. Comparing base (6233b4b) to head (a1d1e6f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #12012      +/-   ##
==========================================
- Coverage   52.14%   52.14%   -0.01%     
==========================================
  Files         734      734              
  Lines       46704    46704              
==========================================
- Hits        24356    24352       -4     
- Misses      20014    20016       +2     
- Partials     2334     2336       +2     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@lakshmimsft lakshmimsft force-pushed the feat/core-types-test-migration branch 2 times, most recently from ba9d11b to bf766e4 Compare June 2, 2026 16:14
@lakshmimsft lakshmimsft changed the title [WIP-Do Not Review] upd test frmwrk to work with RRTs [WIP-Do Not Review] Update test framework to support RRTs Jun 2, 2026
@lakshmimsft lakshmimsft force-pushed the feat/core-types-test-migration branch from bf766e4 to 0999bfc Compare June 2, 2026 16:41
@lakshmimsft lakshmimsft marked this pull request as ready for review June 2, 2026 17:19
@lakshmimsft lakshmimsft requested review from a team as code owners June 2, 2026 17:19
Copilot AI review requested due to automatic review settings June 2, 2026 17:19
@lakshmimsft lakshmimsft changed the title [WIP-Do Not Review] Update test framework to support RRTs Update test framework to support RRTs Jun 2, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR extends the functional test framework to accommodate the newer Radius.Core/* and Radius.Compute/* resource types (alongside the existing Applications.Core/* types) and migrates an initial set of CoreRP portable functional tests as a proof-of-concept. It also updates default recipe pack tagging to align with recipe image tags.

Changes:

  • Added new RP resource-type constants and updated cleanup logic to delete Radius.Core environments/applications via rad ... --preview.
  • Introduced a PreSetup hook plus a helper to create/update preview environments (incl. Kubernetes namespace) for recipe-driven tests.
  • Migrated several CoreRP “resources” Bicep templates/tests to Radius.Core/* and Radius.Compute/*, and updated recipe-pack tag selection to use version.Release() (with latest for edge).

Reviewed changes

Copilot reviewed 13 out of 13 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
test/validation/shared.go Adds new Radius.Core/* and Radius.Compute/* resource type constants; updates delete behavior for Core types via CLI preview commands.
test/rp/rptest.go Adds PreSetup hook and NewPreviewEnvPreSetup helper; invokes PreSetup before executing test steps.
test/radcli/cli.go Extends EnvironmentUpdatePreview to optionally set Kubernetes namespace; adds ApplicationDeletePreview.
test/functional-portable/corerp/noncloud/resources/testdata/corerp-resources-environment.bicep Migrates environment template to Radius.Core/environments@2025-08-01-preview and new providers.kubernetes.namespace shape.
test/functional-portable/corerp/noncloud/resources/testdata/corerp-resources-container.bicep Migrates app/container resources to Radius.Core/applications + Radius.Compute/containers schema.
test/functional-portable/corerp/noncloud/resources/testdata/corerp-resources-application.bicep Migrates application template to Radius.Core/applications@2025-08-01-preview.
test/functional-portable/corerp/noncloud/resources/testdata/corerp-resources-app-env.bicep Migrates app+env template to Radius.Core/* and uses environment: env.id.
test/functional-portable/corerp/noncloud/resources/environment_test.go Updates expected RP resource type to CoreEnvironmentsResource.
test/functional-portable/corerp/noncloud/resources/container_test.go Uses preview environment pre-setup and deploy parameterization; updates expected RP resource types.
test/functional-portable/corerp/noncloud/resources/application_test.go Updates expected RP resource type to CoreApplicationsResource; removes namespace existence verification.
test/functional-portable/corerp/noncloud/resources/application_environment_test.go Updates expected RP resource types to Core; removes namespace checks.
test/functional-portable/cli/noncloud/cli_test.go Updates call site for new EnvironmentUpdatePreview(..., kubernetesNamespace) signature.
pkg/cli/recipepack/recipepack.go Switches recipe OCI tag from version.Channel() to version.Release() (edge uses latest).

lakshmimsft added a commit that referenced this pull request Jun 4, 2026
This pull request updates how the OCI tag is determined for core
resource type recipes in the `GetCoreTypesRecipeInfo` function. Instead
of using the version channel (like "0.40" or "edge"), it now uses the
full semantic version (like "0.58.0") to align with tags from the
kube-recipes publishing pipeline. For edge or development builds,
"latest" is still used.

note: tests for this update will be included in pr:
#12012

## Type of change

- This pull request fixes a bug in Radius and has an approved issue
(#12026 ).

Fixes: #12026 

## Contributor checklist
Please verify that the PR meets the following requirements, where
applicable:

- An overview of proposed schema changes is included in a linked GitHub
issue.
    - [ ] Yes
    - [x] Not applicable
- A design document is added or updated under `eng/design-notes/` in
this repository, if new APIs are being introduced.
    - [ ] Yes
    - [x] Not applicable
- The design document has been reviewed and approved by Radius
maintainers/approvers.
    - [ ] Yes
    - [x] Not applicable
- A PR for
[resource-types-contrib](https://github.com/radius-project/resource-types-contrib/)
is created, if resource types or recipes are affected by the changes in
this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for [dashboard](https://github.com/radius-project/dashboard/) is
created, if the Radius Dashboard is affected by the changes in this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for the [documentation
repository](https://github.com/radius-project/docs) is created, if the
changes in this PR affect the documentation or any user facing updates
are made.
    - [ ] Yes
    - [x] Not applicable

Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
Comment thread test/rp/rptest.go
@lakshmimsft lakshmimsft force-pushed the feat/core-types-test-migration branch 2 times, most recently from e3aa3db to 7e5f88d Compare June 4, 2026 20:40
@lakshmimsft lakshmimsft enabled auto-merge (squash) June 4, 2026 20:41
@lakshmimsft lakshmimsft force-pushed the feat/core-types-test-migration branch from 7e5f88d to 49f2c17 Compare June 4, 2026 22:04
@radius-functional-tests

radius-functional-tests Bot commented Jun 4, 2026

Copy link
Copy Markdown

Radius functional test overview

🔍 Go to test action run

Click here to see the test run details
Name Value
Repository radius-project/radius
Commit ref 49f2c17
Unique ID funcb4c8270abf
Image tag pr-funcb4c8270abf
  • gotestsum 1.13.0
  • KinD: v0.29.0
  • Dapr: 1.14.4
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.3.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funcb4c8270abf
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funcb4c8270abf
  • dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-funcb4c8270abf
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-funcb4c8270abf
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funcb4c8270abf
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ corerp-cloud functional tests succeeded
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting corerp-cloud functional tests...
⌛ Starting ucp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
@lakshmimsft lakshmimsft force-pushed the feat/core-types-test-migration branch from 49f2c17 to a1d1e6f Compare June 4, 2026 22:34
@radius-functional-tests

Copy link
Copy Markdown

Radius functional test overview

🔍 Go to test action run

Click here to see the test run details
Name Value
Repository radius-project/radius
Commit ref a1d1e6f
Unique ID func48331b386c
Image tag pr-func48331b386c
  • gotestsum 1.13.0
  • KinD: v0.29.0
  • Dapr: 1.14.4
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.3.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func48331b386c
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func48331b386c
  • dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func48331b386c
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-func48331b386c
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func48331b386c
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

@lakshmimsft lakshmimsft merged commit 067afe9 into main Jun 4, 2026
59 checks passed
@lakshmimsft lakshmimsft deleted the feat/core-types-test-migration branch June 4, 2026 23:09
Reshrahim pushed a commit to Reshrahim/radius that referenced this pull request Jun 15, 2026
…2027)

This pull request updates how the OCI tag is determined for core
resource type recipes in the `GetCoreTypesRecipeInfo` function. Instead
of using the version channel (like "0.40" or "edge"), it now uses the
full semantic version (like "0.58.0") to align with tags from the
kube-recipes publishing pipeline. For edge or development builds,
"latest" is still used.

note: tests for this update will be included in pr:
radius-project#12012

## Type of change

- This pull request fixes a bug in Radius and has an approved issue
(radius-project#12026 ).

Fixes: radius-project#12026

## Contributor checklist
Please verify that the PR meets the following requirements, where
applicable:

- An overview of proposed schema changes is included in a linked GitHub
issue.
    - [ ] Yes
    - [x] Not applicable
- A design document is added or updated under `eng/design-notes/` in
this repository, if new APIs are being introduced.
    - [ ] Yes
    - [x] Not applicable
- The design document has been reviewed and approved by Radius
maintainers/approvers.
    - [ ] Yes
    - [x] Not applicable
- A PR for
[resource-types-contrib](https://github.com/radius-project/resource-types-contrib/)
is created, if resource types or recipes are affected by the changes in
this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for [dashboard](https://github.com/radius-project/dashboard/) is
created, if the Radius Dashboard is affected by the changes in this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for the [documentation
repository](https://github.com/radius-project/docs) is created, if the
changes in this PR affect the documentation or any user facing updates
are made.
    - [ ] Yes
    - [x] Not applicable

Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
Signed-off-by: Reshma Abdul Rahim <reshmarahim.abdul@microsoft.com>
Reshrahim pushed a commit to Reshrahim/radius that referenced this pull request Jun 15, 2026
This pull request extends the functional test framework to support the
new resource types (Radius.Core/environments, Radius.Core/applications,
Radius.Compute/containers) alongside the existing Applications.Core/*
types. It migrates the first group of tests as aproof-of-concept.

## Type of change
- This pull request adds or changes features of Radius and has an
approved issue (radius-project#11942 .

Fixes: radius-project#11942

## Contributor checklist
Please verify that the PR meets the following requirements, where
applicable:

- An overview of proposed schema changes is included in a linked GitHub
issue.
    - [ ] Yes
    - [x] Not applicable
- A design document is added or updated under `eng/design-notes/` in
this repository, if new APIs are being introduced.
    - [ ] Yes
    - [x] Not applicable
- The design document has been reviewed and approved by Radius
maintainers/approvers.
    - [ ] Yes
    - [x] Not applicable
- A PR for
[resource-types-contrib](https://github.com/radius-project/resource-types-contrib/)
is created, if resource types or recipes are affected by the changes in
this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for [dashboard](https://github.com/radius-project/dashboard/) is
created, if the Radius Dashboard is affected by the changes in this PR.
    - [ ] Yes
    - [x] Not applicable
- A PR for the [documentation
repository](https://github.com/radius-project/docs) is created, if the
changes in this PR affect the documentation or any user facing updates
are made.
    - [ ] Yes
    - [x] Not applicable

---------

Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
Signed-off-by: Reshma Abdul Rahim <reshmarahim.abdul@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update test framework to work with new types (rad app * --preview is precursor)

3 participants