Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
80 changes: 80 additions & 0 deletions .github/workflows/manual-perf.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
name: Manual Performance Test

on:
workflow_dispatch:
inputs:
configuration:
description: 'Choose Kunminghu configuration'
required: true
type: choice
default: 'idealkmhv3.py'
options:
- 'kmhv2.py'
- 'kmhv3.py'
- 'idealkmhv3.py'
benchmark_type:
description: 'Benchmark coverage type'
required: true
type: choice
default: 'spec06-0.8c'
options:
- spec06-0.3c
- spec06-0.8c
- spec06-1.0c
- spec17-1.0c
- spec06-rvv-1.0c
- spec06int-rvv-0.8c
vector_type:
description: 'Vector decode strategy (only for rvv benchmarks)'
required: false
type: choice
default: 'base'
options:
- base
- simple
branch:
description: 'Branch, tag or SHA to test (leave empty for current branch)'
required: false
type: string

jobs:
setup:
runs-on: ubuntu-latest
outputs:
script_path: ${{ steps.resolve.outputs.script_path }}
pr_sha: ${{ steps.resolve.outputs.pr_sha }}
steps:
- name: Resolve parameters
id: resolve
run: |
case "${{ github.event.inputs.configuration }}" in
"kmhv2.py")
echo "script_path=../kmh_6wide.sh" >> $GITHUB_OUTPUT
;;
"kmhv3.py")
echo "script_path=../kmh_v3_btb.sh" >> $GITHUB_OUTPUT
;;
"idealkmhv3.py")
echo "script_path=../kmh_v3_ideal.sh" >> $GITHUB_OUTPUT
;;
*)
echo "Error: unsupported configuration '${{ github.event.inputs.configuration }}'" >&2
exit 1
;;
esac

if [ -n "${{ github.event.inputs.branch }}" ]; then
echo "pr_sha=${{ github.event.inputs.branch }}" >> $GITHUB_OUTPUT
else
echo "pr_sha=${{ github.sha }}" >> $GITHUB_OUTPUT
fi

perf_test:
needs: setup
uses: ./.github/workflows/gem5-perf-template.yml
with:
script_path: ${{ needs.setup.outputs.script_path }}
benchmark_type: ${{ github.event.inputs.benchmark_type }}
vector_type: ${{ github.event.inputs.vector_type }}
pr_sha: ${{ needs.setup.outputs.pr_sha }}
check_result: true
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,7 @@ Note:
- The V3 RTL BPU predictor and backend updates are still being implemented. Several performance switches remain off in `kmhv3.py` to stay aligned with the RTL snapshot; as RTL work lands, we will re-enable them and expect the mainline V3 scores to pull ahead of V2.
- A score with 0.3c would be 1 point higher by default than a score with 0.8c, and 1.2 points higher by default than a score with 1c, so benchmark scores with different coverage cannot be directly compared.
- You can trigger kmhv3.py by *-align* branch suffix, e.g., `feature-xyz-align`. trigger idealkmhv3.py by *-perf* suffix.
- You can also manually trigger a performance test with custom configuration and coverage via the `Manual Performance Test` CI in the Actions tab.

## Branches

Expand Down