Skip to content

Improve benchmark-queries command with new features and refactoring#269

Open
tanmay-9 wants to merge 1 commit intoqlever-dev:mainfrom
tanmay-9:improve-benchmark-queries
Open

Improve benchmark-queries command with new features and refactoring#269
tanmay-9 wants to merge 1 commit intoqlever-dev:mainfrom
tanmay-9:improve-benchmark-queries

Conversation

@tanmay-9
Copy link
Collaborator

@tanmay-9 tanmay-9 commented Feb 27, 2026

  • Move static methods from BenchmarkQueriesCommand class to module-level functions
  • Use the container system from Qleverfile to pretty print the query in pretty_printed_query function.
  • Split query text into query name and query description in benchmark result YML file.
  • Add benchmark_name and benchmark_description to benchmark result YML file (Priority: CLI args > YAML fields > dataset name fallback)
  • Add max_time parameter to run_curl_command in util.py to support server hang detection via curl's --max-time flag
  • Add --restart-on-hang option to automatically stop and restart the server when it gets stuck during benchmarking. Additionally, track and report server_restarted status per query
  • Add compute_index_stats() to include index time and size in benchmark output
  • Avoid mutating args and fix code styling issues
  • Update test to use module-level functions instead of class methods

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant