Revisions of python-tiktoken
Ana Guerrero (anag+factory)
accepted
request 1225495
from
Dirk Mueller (dirkmueller)
(revision 2)
- Update to version 0.8.0: * Alas, emulation * Attempt to fix emulated builds * Partial sync of codebase * Add possessive quantifiers to avoid catastrophic backtracking (#258) * update README to mention gpt-4o * Sync codebase * Simplify byte_pair_merge (#255) * Inline custom mapping function in _byte_pair_merge * Avoid calling byte_pair_encode for existing tokens * Performance improvements
Ana Guerrero (anag+factory)
accepted
request 1202128
from
Daniel Garcia (dgarcia)
(revision 1)
New package of the python tiktoken module.
Displaying all 2 revisions
