Skip to content

ci(runner): Add benchmark example and print benchmark results#512

Merged
espzav merged 2 commits intomasterfrom
ci/bsp_wall_benchmark
Feb 24, 2025
Merged

ci(runner): Add benchmark example and print benchmark results#512
espzav merged 2 commits intomasterfrom
ci/bsp_wall_benchmark

Conversation

@espzav
Copy link
Copy Markdown
Collaborator

@espzav espzav commented Feb 18, 2025 •
edited
Loading

ESP-BSP Pull Request checklist

  • Version of modified component bumped
  • CI passing

Change description

  • Added new example exactly for benchmark
  • CI run benchmark example, compare results with master and print results to comment (with diff)
  • For run benchmark, there is needed to add label "Run benchmark"

@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from d8b355f to 5c6f8f9 Compare February 18, 2025 13:54
@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 18, 2025 •
edited
Loading

Benchmark for BOARD esp32_p4_function_ev_board

DATE: 24.02.2025 07:33

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 28% 27 6 0 6
Moving wallpaper 37% 28 12 11 1
Single rectangle 4% 28 0 0 0
Multiple rectangles 12% 28 4 2 2
Multiple RGB images 46% (-2) 28 16 (+1) 13 3 (+1)
Multiple ARGB images 96% (+1) 24 34 (-1) 32 (-1) 2
Rotated ARGB images 99% 3 250 (+1) 249 (+3) 1 (-2)
Multiple labels 85% (+3) 28 24 (-2) 24 (-1) 0 (-1)
Screen sized text 6% (+1) 28 1 (-2) 1 (-2) 0
Multiple arcs 69% (+1) 28 21 (-1) 19 2 (-1)
Containers 46% (+2) 28 11 (-1) 11 (-1) 0
Containers with overlay 93% (-1) 17 51 (+1) 48 3 (+1)
Containers with opa 65% (-2) 28 20 (-1) 20 (-1) 0
Containers with opa_layer 96% (-1) 10 83 (+1) 81 2 (+1)
Containers with scrolling 99% 18 51 49 2
Widgets demo 98% 17 (+1) 52 (-2) 50 (-2) 2
All scenes avg. 61% 23 (+1) 39 38 1

Benchmark for BOARD esp32_s3_eye

DATE: 24.02.2025 07:37

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 21% 27 3 2 1
Moving wallpaper 15% 28 4 4 0
Single rectangle 2% 28 0 0 0
Multiple rectangles 39% 28 13 1 12
Multiple RGB images 8% 28 0 0 0
Multiple ARGB images 10% 28 2 2 0
Rotated ARGB images 43% 28 14 14 0
Multiple labels 17% 28 3 0 3
Screen sized text 42% 28 14 14 0
Multiple arcs 2% 28 0 0 0
Containers 11% 28 4 4 0
Containers with overlay 33% 28 11 11 0
Containers with opa 20% 28 8 7 1
Containers with opa_layer 29% 28 13 13 0
Containers with scrolling 38% 28 11 11 0
Widgets demo 61% 28 9 8 1
All scenes avg. 24% 27 6 5 1

Benchmark for BOARD esp32_s3_lcd_ev_board_2

DATE: 24.02.2025 07:44

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 71% 24 (-1) 26 (-1) 19 (-1) 7
Moving wallpaper 97% 14 64 51 (-1) 13 (+1)
Single rectangle 42% (-1) 28 8 (-2) 3 (-1) 5 (-1)
Multiple rectangles 78% 27 27 19 (-1) 8 (+1)
Multiple RGB images 98% 20 44 (+1) 33 (+1) 11
Multiple ARGB images 100% 16 55 46 9
Rotated ARGB images 100% 3 274 (+2) 266 (+2) 8
Multiple labels 76% 28 (+1) 23 16 (-1) 7 (+1)
Screen sized text 99% (+1) 12 78 (-1) 66 (-1) 12
Multiple arcs 58% (+1) 28 15 (+1) 7 (+1) 8
Containers 79% (-2) 25 30 24 6
Containers with overlay 98% 11 78 (-1) 68 (-1) 10
Containers with opa 91% (-1) 21 38 (-1) 29 (-1) 9
Containers with opa_layer 98% (-1) 11 (+1) 81 (-1) 75 (-1) 6
Containers with scrolling 100% (+1) 14 64 55 9
Widgets demo 99% 11 67 (+1) 58 9 (+1)
All scenes avg. 86% 18 60 52 8

Benchmark for BOARD esp32_s3_lcd_ev_board

DATE: 24.02.2025 07:41

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 98% 16 53 29 24
Moving wallpaper 99% 9 (-1) 91 (+3) 81 10 (+3)
Single rectangle 60% (-2) 28 (+1) 18 (-1) 5 13 (-1)
Multiple rectangles 95% (+1) 17 (+1) 52 (-1) 30 22 (-1)
Multiple RGB images 99% 11 80 (+1) 59 (+2) 21 (-1)
Multiple ARGB images 99% (-1) 10 (-1) 88 (+8) 80 (+1) 8 (+7)
Rotated ARGB images 100% 2 333 324 (-1) 9 (+1)
Multiple labels 99% 16 50 31 19
Screen sized text 100% (+1) 8 110 (+1) 97 (+1) 13
Multiple arcs 99% 17 51 46 5
Containers 100% (+1) 10 83 (+2) 72 (+2) 11
Containers with overlay 99% 7 114 (+2) 101 (+2) 13
Containers with opa 99% 8 104 87 17
Containers with opa_layer 100% (+1) 4 191 184 (+3) 7 (-3)
Containers with scrolling 99% (-1) 8 110 100 (+1) 10 (-1)
Widgets demo 99% 8 (+1) 96 (-2) 81 15 (-2)
All scenes avg. 96% 11 100 87 13

Benchmark for BOARD esp_box_3

DATE: 24.02.2025 07:39

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 93% 26 34 3 31
Moving wallpaper 98% 25 36 5 31
Single rectangle 5% 28 0 0 0
Multiple rectangles 51% 28 16 6 10
Multiple RGB images 21% 28 6 0 6
Multiple ARGB images 28% 28 9 4 5
Rotated ARGB images 92% 22 41 28 13
Multiple labels 12% 28 0 0 0
Screen sized text 94% 16 55 24 31
Multiple arcs 19% 28 0 0 0
Containers 33% 28 19 6 13
Containers with overlay 88% 21 43 13 30
Containers with opa 48% 28 19 6 13
Containers with opa_layer 57% 27 29 15 14
Containers with scrolling 96% 20 45 14 31
Widgets demo 94% 25 25 11 14
All scenes avg. 58% 25 23 8 15

Benchmark for BOARD m5dial

DATE: 24.02.2025 07:48

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 79% 27 26 6 20
Moving wallpaper 83% 28 24 9 15
Single rectangle 9% 28 0 0 0
Multiple rectangles 43% 28 13 7 6
Multiple RGB images 16% 28 1 1 0
Multiple ARGB images 18% 28 5 4 1
Rotated ARGB images 52% 28 17 16 1
Multiple labels 20% 28 3 2 1
Screen sized text 82% 27 31 27 4
Multiple arcs 12% 28 0 0 0
Containers 28% 28 13 8 5
Containers with overlay 74% 28 27 18 9
Containers with opa 38% 28 14 11 3
Containers with opa_layer 38% 28 19 17 2
Containers with scrolling 81% 28 28 19 9
Widgets demo 82% 27 14 13 1
All scenes avg. 47% 27 13 9 4

Benchmark for BOARD m5stack_core_s3

DATE: 24.02.2025 07:51

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 94% 27 33 5 28
Moving wallpaper 97% 26 33 9 24
Single rectangle 14% 28 0 0 0
Multiple rectangles 41% 28 14 6 8
Multiple RGB images 25% 28 6 3 3
Multiple ARGB images 27% 28 8 6 2
Rotated ARGB images 70% 28 28 28 0
Multiple labels 17% 28 1 0 1
Screen sized text 93% 23 39 31 8
Multiple arcs 18% 28 2 1 1
Containers 30% 28 15 7 8
Containers with overlay 92% 25 35 17 18
Containers with opa 41% 28 17 9 8
Containers with opa_layer 50% 28 25 21 4
Containers with scrolling 95% 24 37 20 17
Widgets demo 82% 27 16 13 3
All scenes avg. 55% 27 19 11 8

Benchmark for BOARD m5stack_core_s3_se

DATE: 24.02.2025 07:54

LVGL version: 9.2.2

Name Avg. CPU Avg. FPS Avg. time render time flush time
Empty screen 94% 26 32 4 28
Moving wallpaper 96% 26 32 8 24
Single rectangle 14% 28 0 0 0
Multiple rectangles 41% 28 14 6 8
Multiple RGB images 25% 28 6 3 3
Multiple ARGB images 27% 28 8 6 2
Rotated ARGB images 70% 28 28 28 0
Multiple labels 17% 28 1 0 1
Screen sized text 93% 23 39 31 8
Multiple arcs 18% 28 2 1 1
Containers 30% 28 15 7 8
Containers with overlay 92% 25 35 17 18
Containers with opa 41% 28 17 9 8
Containers with opa_layer 50% 28 25 21 4
Containers with scrolling 95% 24 37 20 17
Widgets demo 82% 27 16 13 3
All scenes avg. 55% 26 18 10 8

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 18, 2025 •
edited
Loading

Test Results

 17 files  17 suites   5m 55s ⏱️
 68 tests 24 ✅  44 💤 0 ❌
408 runs  24 ✅ 384 💤 0 ❌

Results for commit 183916d.

♻️ This comment has been updated with latest results.

@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 5c6f8f9 to 52f1ff6 Compare February 18, 2025 14:26
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 52f1ff6 to ef17a13 Compare February 19, 2025 06:40
@espzav
Copy link
Copy Markdown
Collaborator Author

espzav commented Feb 19, 2025

@tore-espressif @igrr PTAL

tore-espressif
tore-espressif reviewed Feb 19, 2025
View reviewed changes
Copy link
Copy Markdown
Collaborator

@tore-espressif tore-espressif left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks very nice @espzav !

I put few comments about the workflow file.

I also added few non-blocking nitpicks in Python

Comment thread examples/display_lvgl_benchmark/README.md
Comment thread examples/display_lvgl_benchmark/main/CMakeLists.txt
Comment thread examples/display_lvgl_benchmark/pytest_display_lvgl_benchmark.py Outdated
Comment thread examples/display_lvgl_benchmark/pytest_display_lvgl_benchmark.py Outdated
Comment thread examples/display_lvgl_benchmark/pytest_display_lvgl_benchmark.py Outdated
Comment thread examples/display_lvgl_benchmark/pytest_display_lvgl_benchmark.py
Comment thread .github/workflows/build-run-applications.yml
Comment thread .github/workflows/build-run-applications.yml Outdated
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 5 times, most recently from 4f32c0f to 7b18341 Compare February 20, 2025 14:16
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 9 times, most recently from 0f67a76 to a4118c2 Compare February 21, 2025 09:05
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 2 times, most recently from d4e089d to 5196883 Compare February 21, 2025 10:56
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch 6 times, most recently from c20a9de to 538ca59 Compare February 24, 2025 06:49
@espzav espzav force-pushed the ci/bsp_wall_benchmark branch from 538ca59 to 183916d Compare February 24, 2025 08:06
@espzav espzav merged commit 731fa5e into master Feb 24, 2025
@espzav espzav deleted the ci/bsp_wall_benchmark branch February 24, 2025 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tore-espressif tore-espressif tore-espressif approved these changes

@igrr igrr Awaiting requested review from igrr

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@espzav @tore-espressif
⚡