fix: Unigram tokenizer checkpoints crash with "BPETokenizer requires … #433

Job	Run time
build_and_unit_test	19m 52s
ssd-draft-memory-guard	2m 10s
speculative-decoding	10m 3s
speculative-decoding-eval	9m 45s
integration_matrix (fixtures)	1m 13s
integration_matrix (omni, mlx-community/gemma-4-e4b-it-4bit)	3m 2s
integration_matrix (server, -gemma-e2b, mlx-community/gemma-4-e2b-it-4bit, mlx-community/gemma-4-...	5m 14s
integration_matrix (vision, mlx-community/Qwen2-VL-2B-Instruct-4bit LiquidAI/LFM2.5-VL-450M-MLX-4...	2m 11s
integration_matrix (graph)	39s
integration_matrix (contract, mlx-community/Qwen2.5-0.5B-Instruct-4bit)	1m 24s
integration_matrix (audio, mlx-community/gemma-4-e4b-it-4bit)	3m 55s
integration_matrix (server, mlx-community/Qwen2.5-0.5B-Instruct-4bit)	1m 37s
integration_matrix (opencode, mlx-community/gemma-4-e4b-it-4bit)	3m 3s
dflash-speculative-decoding	9m 55s
	1h 14m 3s

Navigation Menu