Skip to content

bench: compare UnicodeSegmenterTokenizer vs alyze UAX#29 tokenizer#2946

Open
fmassot wants to merge 2 commits into
mainfrom
bench/alyze-vs-unicode-seg-tokenizer
Open

bench: compare UnicodeSegmenterTokenizer vs alyze UAX#29 tokenizer#2946
fmassot wants to merge 2 commits into
mainfrom
bench/alyze-vs-unicode-seg-tokenizer

bench: add ASCII and Loghub corpus variants

fb30223
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar