Is your feature request related to a problem or challenge?
As mentioned in #21165 having sql based benchmarking would make creating some types of benchmarks much easier and would remove the necessity of writing rust code just to benchmark some sql. It could also allow us to migrate away from manual benchmarking towards using criterion or Divan for running the benchmarks with proper statistics.
Describe the solution you'd like
I would suggest that we should take inspiration from DuckDB's benchmarking tool and create a similar solution for Datafusion.
Describe alternatives you've considered
Leave things as they are.
Additional context
No response
Is your feature request related to a problem or challenge?
As mentioned in #21165 having sql based benchmarking would make creating some types of benchmarks much easier and would remove the necessity of writing rust code just to benchmark some sql. It could also allow us to migrate away from manual benchmarking towards using criterion or Divan for running the benchmarks with proper statistics.
Describe the solution you'd like
I would suggest that we should take inspiration from DuckDB's benchmarking tool and create a similar solution for Datafusion.
Describe alternatives you've considered
Leave things as they are.
Additional context
No response