Skip to content

test - validate llamacpp cfg outputs#20

Open
lapp0 wants to merge 4 commits into
mainfrom
fix-796
Open

test - validate llamacpp cfg outputs#20
lapp0 wants to merge 4 commits into
mainfrom
fix-796

Conversation

@lapp0
Copy link
Copy Markdown
Owner

@lapp0 lapp0 commented May 20, 2024

No description provided.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 20, 2024

Benchmark Suite Results:

Before [b5c69cc] After [8089fcc] Ratio Benchmark (Parameter)
180±0.9ms 184±3ms 1.02 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('simple_phone')
128±1ms 130±0.7ms 1.02 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ssn')
4.55±0.01s 4.58±0.06s 1.01 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_fsm('complex_schema')
78.6±1μs 79.7±1μs 1.01 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_regex('complex_schema')
4.86±0.01s 4.91±0.03s 1.01 bench_numba_compile.NumbaCompileBenchmark.time_compile_numba
286±3ms 288±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('email')
240±5ms 242±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ip')
620M 621M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('complex_span_constrained_relation_extraction')
528M 528M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('simple_phone')
623±4ms 626±2ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_phone')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant