fix: add missing pre-tokenizer type for GPT-2 BPE models#508
Open
raphaelbgr wants to merge 1 commit intomicrosoft:mainfrom
Open
fix: add missing pre-tokenizer type for GPT-2 BPE models#508raphaelbgr wants to merge 1 commit intomicrosoft:mainfrom
raphaelbgr wants to merge 1 commit intomicrosoft:mainfrom
