Skip to content

Add public SentencePieceTokenizer factory methods for Unigram from vocab list and tokenizer.json#7625

Draft
Copilot wants to merge 5 commits into
mainfrom
copilot/add-sentencepiece-tokenizer-api
Draft

Add public SentencePieceTokenizer factory methods for Unigram from vocab list and tokenizer.json#7625
Copilot wants to merge 5 commits into
mainfrom
copilot/add-sentencepiece-tokenizer-api

Commits

Commits on Jun 10, 2026

Commits on Jun 11, 2026

Commits on Jun 12, 2026