Skip to content

Pull requests: bzick/tokenizer

New pull request New
6 Open 20 Closed
6 Open 20 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix parsing stream with first token size > parser's chunk size-4
#45 opened Jul 7, 2026 by n-peugnet Contributor Loading…
1
Fix parsing of ".E0" input
#43 opened Jul 7, 2026 by n-peugnet Contributor • Draft
1
Implement negatively signed numbers
#39 opened Nov 25, 2025 by kettek Loading…
4
support DefineTokens with AloneTokenOption and IgnoreCaseTokenOption
#38 opened Jun 30, 2025 by einsitang Loading…
7
WIP #34: add diacritics and sings
#37 opened Feb 13, 2025 by bzick Owner Loading…
Update to Go 1.22 and stretchr/testify 1.9.0
#22 opened Sep 26, 2024 by stone-z Loading…
6
ProTip! Adding no:label will show everything without a label.