Skip to content

Remove 99-percentile columns from RecipeRunStats data table#6072

Merged
knutwannheden merged 7 commits intomainfrom
fix-run-stats
Sep 25, 2025
Merged

Remove 99-percentile columns from RecipeRunStats data table#6072
knutwannheden merged 7 commits intomainfrom
fix-run-stats

Conversation

@knutwannheden
Copy link
Copy Markdown
Contributor

@knutwannheden knutwannheden commented Sep 25, 2025

The only operational use of P99 is in A/B testing and we haven’t ever operated something like that for multiple versions of recipes.

Currently, `RecipeRunStats` uses the default configuration for the timer's distribution statistic configuration, which uses an expiry of 1 minute and a buffer length of 3. This means that the 99-percentile reported by `RecipeRunStats` will in fact only be computed by the values recorded during the last minute of the recipe run.

This commit addresses this by setting the expiry to 24 hours and also only using a buffer length of 1 (translating to one bucket in `TimeWindowPercentileHistogram`), so that there isn't any bias for recent scans/edits.
@github-project-automation github-project-automation Bot moved this to In Progress in OpenRewrite Sep 25, 2025
@knutwannheden knutwannheden changed the title RecipeRunStats should cover the entire recipe run RecipeRunStats 99-percentile value should be cumulative Sep 25, 2025
@github-project-automation github-project-automation Bot moved this from In Progress to Ready to Review in OpenRewrite Sep 25, 2025
@knutwannheden knutwannheden changed the title RecipeRunStats 99-percentile value should be cumulative Make RecipeRunStats 99-percentile cumulative for entire recipe run Sep 25, 2025
Copy link
Copy Markdown
Member

@jkschneider jkschneider left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would prefer we simply remove these columns. The only operational use of P99 is in A/B testing and we haven’t ever operated something like that for multiple versions of recipes

@knutwannheden knutwannheden changed the title Make RecipeRunStats 99-percentile cumulative for entire recipe run Remove 99-percentile columns from RecipeRunStats data table Sep 25, 2025
knutwannheden added a commit to moderneinc/moderne-visualizations-misc that referenced this pull request Sep 25, 2025
These weren't used anyway and the columns are about to get dropped from OpenRewrite: openrewrite/rewrite#6072
@knutwannheden knutwannheden merged commit 2a9c9ba into main Sep 25, 2025
2 checks passed
@github-project-automation github-project-automation Bot moved this from Ready to Review to Done in OpenRewrite Sep 25, 2025
@knutwannheden knutwannheden deleted the fix-run-stats branch September 25, 2025 15:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

3 participants