Skip to content

util: migrate spec06 benchmark_type to gcc12/gcc15#783

Merged
edwu186 merged 1 commit intoxs-devfrom
CI-gcc15
Mar 12, 2026
Merged

util: migrate spec06 benchmark_type to gcc12/gcc15#783
edwu186 merged 1 commit intoxs-devfrom
CI-gcc15

Conversation

@edwu186
Copy link
Copy Markdown
Contributor

@edwu186 edwu186 commented Mar 12, 2026

  • gem5-perf-template.yml: renamed SPEC06 baseline benchmark keys from spec06-{0.3c,0.8c,1.0c} to gcc12-spec06-{0.3c,0.8c,1.0c}; added gcc15-spec06-{0.3c,0.8c,1.0c} mappings with dedicated checkpoint_list/checkpoint_root_node/score_script/cluster_config/artifact_name/comment outputs; updated benchmark_type input description and Invalid benchmark_type error list to the new full option set.

  • gem5-perf.yml: updated benchmark_type from spec06-0.8c to gcc12-spec06-0.8c.

  • gem5-ideal-btb-perf.yml: updated benchmark_type from spec06-0.8c to gcc12-spec06-0.8c.

  • gem5-ideal-btb-0.3c.yml: updated benchmark_type from spec06-0.3c to gcc12-spec06-0.3c.

  • gem5-ideal-btb-perf-weekly.yml: switched both SPEC06 jobs to gcc15-spec06-1.0c; kept SPEC17 jobs unchanged.

  • manual-perf.yml: changed benchmark_type default to gcc12-spec06-0.8c; replaced SPEC06 options with explicit gcc12/gcc15 variants (gcc12-spec06-{0.3c,0.8c,1.0c} and gcc15-spec06-{0.3c,0.8c,1.0c}); kept spec17/rvv options.

  • on-demand-spec.yml: migrated on-demand SPEC06 naming to gcc12-only scope (default/options/label-trigger default/comment text), without adding gcc15 options.

Change-Id: Ie086b2fca06178f9dc47338da93a3af6f0f7327e

Summary by CodeRabbit

  • Chores

    • Updated CI performance workflows and inputs to adopt new gcc-based benchmark names (gcc12-spec06 and gcc15-spec06 variants).
    • Changed default benchmark selection across manual and automated perf runs to the gcc12-spec06 default.
  • Documentation

    • Updated README and workflow docs/examples to reflect the new benchmark naming and updated trigger/label text.

@edwu186 edwu186 requested a review from jensen-yan March 12, 2026 03:31
@coderabbitai
Copy link
Copy Markdown

coderabbitai bot commented Mar 12, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 7978c082-415c-40ad-a658-47bd40fbca45

📥 Commits

Reviewing files that changed from the base of the PR and between 0bf4094 and 1b4ce3b.

📒 Files selected for processing (9)
  • .github/workflows/README.md
  • .github/workflows/gem5-ideal-btb-0.3c.yml
  • .github/workflows/gem5-ideal-btb-perf-weekly.yml
  • .github/workflows/gem5-ideal-btb-perf.yml
  • .github/workflows/gem5-perf-template.yml
  • .github/workflows/gem5-perf.yml
  • .github/workflows/manual-perf.yml
  • .github/workflows/on-demand-spec.yml
  • README.md
🚧 Files skipped from review as they are similar to previous changes (7)
  • README.md
  • .github/workflows/gem5-perf.yml
  • .github/workflows/manual-perf.yml
  • .github/workflows/gem5-ideal-btb-perf.yml
  • .github/workflows/gem5-ideal-btb-0.3c.yml
  • .github/workflows/on-demand-spec.yml
  • .github/workflows/gem5-ideal-btb-perf-weekly.yml

📝 Walkthrough

Walkthrough

CI workflow configurations updated to use compiler-prefixed SPEC benchmark names: gcc12-spec06-* and gcc15-spec06-*, replacing many spec06-* identifiers and expanding supported benchmark options and artifact naming in workflow templates and dispatch inputs.

Changes

Cohort / File(s) Summary
Individual Workflow Defaults
.github/workflows/gem5-ideal-btb-0.3c.yml, .github/workflows/gem5-ideal-btb-perf.yml, .github/workflows/gem5-perf.yml
Replaced benchmark_type defaults from spec06-* to gcc12-spec06-* literals in job with configurations.
Weekly Perf Jobs
.github/workflows/gem5-ideal-btb-perf-weekly.yml
Updated spec06-1.0c entries to gcc15-spec06-1.0c for relevant weekly jobs; preserved spec17 entries (minor whitespace).
Perf Template & Cases
.github/workflows/gem5-perf-template.yml
Expanded case branches to include gcc12-spec06-* and new gcc15-spec06-* variants; updated artifact_name, checkpoints, root nodes, cluster configs, and the valid-options error message.
Manual & On-demand Triggers
.github/workflows/manual-perf.yml, .github/workflows/on-demand-spec.yml, .github/workflows/README.md
Changed workflow_dispatch defaults/options and PR-label handling/comments from spec06-0.8c/spec06-0.3c to gcc12-spec06-* variants; updated examples and descriptions.
Repository Docs
README.md
Updated three CI configuration references to use gcc12-spec06-* identifiers in documentation examples.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

Suggested labels

perf

Suggested reviewers

  • tastynoob
  • CJ362ff
  • Yakkhini

Poem

🐰 I hop through YAML, tidy and spry,

gcc12 names now catch my eye.
Benchmarks wear new coats so bright,
Workflows hum through day and night,
Happy hops for CI delight!

🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely summarizes the main change: migrating SPEC06 benchmark naming to include GCC compiler variants.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch CI-gcc15

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Copy Markdown

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1


ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: e065844f-6bce-46d8-b29a-4ca6ec4db8e8

📥 Commits

Reviewing files that changed from the base of the PR and between ace3fd5 and 0bf4094.

📒 Files selected for processing (9)
  • .github/workflows/README.md
  • .github/workflows/gem5-ideal-btb-0.3c.yml
  • .github/workflows/gem5-ideal-btb-perf-weekly.yml
  • .github/workflows/gem5-ideal-btb-perf.yml
  • .github/workflows/gem5-perf-template.yml
  • .github/workflows/gem5-perf.yml
  • .github/workflows/manual-perf.yml
  • .github/workflows/on-demand-spec.yml
  • README.md

@github-actions
Copy link
Copy Markdown

🚀 Coremark Smoke Test Results

Branch IPC Change
Base (xs-dev) 2.2607 -
This PR 2.2607 ➡️ 0.0000 (0.00%)

✅ Difftest smoke test passed!

- gem5-perf-template.yml: renamed SPEC06 baseline benchmark keys from spec06-{0.3c,0.8c,1.0c} to gcc12-spec06-{0.3c,0.8c,1.0c}; added gcc15-spec06-{0.3c,0.8c,1.0c} mappings with dedicated checkpoint_list/checkpoint_root_node/score_script/cluster_config/artifact_name/comment outputs; updated benchmark_type input description and Invalid benchmark_type error list to the new full option set.
- gem5-perf.yml: updated benchmark_type from spec06-0.8c to gcc12-spec06-0.8c.
- gem5-ideal-btb-perf.yml: updated benchmark_type from spec06-0.8c to gcc12-spec06-0.8c.
- gem5-ideal-btb-0.3c.yml: updated benchmark_type from spec06-0.3c to gcc12-spec06-0.3c.
- gem5-ideal-btb-perf-weekly.yml: switched both SPEC06 jobs to gcc15-spec06-1.0c; kept SPEC17 jobs unchanged.
- manual-perf.yml: changed benchmark_type default to gcc12-spec06-0.8c; replaced SPEC06 options with explicit gcc12/gcc15 variants (gcc12-spec06-{0.3c,0.8c,1.0c} and gcc15-spec06-{0.3c,0.8c,1.0c}); kept spec17/rvv options.
- on-demand-spec.yml: migrated on-demand SPEC06 naming to gcc12-only scope (default/options/label-trigger default/comment text), without adding gcc15 options.

Change-Id: Ie086b2fca06178f9dc47338da93a3af6f0f7327e
@jensen-yan
Copy link
Copy Markdown
Collaborator

不确定,要不要把默认的0.3c, 0.8c 的自动切换到gcc15 上,如果这次不切换,那就下周切换一下
此外
gem5_data_proc_yy 那个,现在还得-j 指定gcc15 的json, 或许之后可以改成默认为gcc15 的json

@github-actions
Copy link
Copy Markdown

🚀 Coremark Smoke Test Results

Branch IPC Change
Base (xs-dev) 2.2607 -
This PR 2.2607 ➡️ 0.0000 (0.00%)

✅ Difftest smoke test passed!

@edwu186
Copy link
Copy Markdown
Contributor Author

edwu186 commented Mar 12, 2026

不确定,要不要把默认的0.3c, 0.8c 的自动切换到gcc15 上,如果这次不切换,那就下周切换一下 此外 gem5_data_proc_yy 那个,现在还得-j 指定gcc15 的json, 或许之后可以改成默认为gcc15 的json

ok的,另外就是-perf默认触发还是gcc12 0.8的,这周组会再确认下,后续一起再切换吧

@edwu186 edwu186 merged commit ceed8e7 into xs-dev Mar 12, 2026
2 checks passed
@edwu186 edwu186 deleted the CI-gcc15 branch March 12, 2026 06:53
@coderabbitai coderabbitai bot mentioned this pull request Mar 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants