python3-tiktoken (0.12.0-2)

Details

Core information at a glance

Distribution
debian
Origin
debian-sid
Repository
https://deb.debian.org/debian
Codename
sid
Component
main
Source
tiktoken
Architecture
s390x
Section
python
Priority
optional
Maintainer
Debian Deep Learning Team <[email protected]>

Size & integrity

Byte sizes and integrity verification

Installed size
5.5 kB
Size expected
799.7 kB
Size actual
799.7 kB
Size match

Dependencies

Required package dependencies

  • libc6 (>= 2.34)
  • libgcc-s1 (>= 4.2)
  • python3 (<< 3.15)
  • python3 (>= 3.13~)
  • python3-regex
  • python3-requests
  • python3:any

Suggested packages

Recommended additional packages

  • None

Description

fast BPE tokeniser for use with OpenAI's models

Homepage Download .deb

Tags

Package classification tags

None

Checksums

Hash values and integrity verification status

TypeActualMatch
MD5d2225f5e…9655e8e8
SHA-1c8005adb…f5d20ef9
SHA-256af94e798…1cdec5df
SHA-512aa2a555d…d7861929

Contents

Files and directories included

.
usr
usr/lib
usr/lib/python3
usr/lib/python3/dist-packages
usr/lib/python3/dist-packages/tiktoken
usr/lib/python3/dist-packages/tiktoken/__init__.py
usr/lib/python3/dist-packages/tiktoken/_educational.py
usr/lib/python3/dist-packages/tiktoken/_tiktoken.cpython-313-s390x-linux-gnu.so
usr/lib/python3/dist-packages/tiktoken/_tiktoken.cpython-314-s390x-linux-gnu.so
usr/lib/python3/dist-packages/tiktoken/core.py
usr/lib/python3/dist-packages/tiktoken/load.py
usr/lib/python3/dist-packages/tiktoken/model.py
usr/lib/python3/dist-packages/tiktoken/py.typed
usr/lib/python3/dist-packages/tiktoken/registry.py
usr/lib/python3/dist-packages/tiktoken-0.12.0.dist-info
usr/lib/python3/dist-packages/tiktoken-0.12.0.dist-info/INSTALLER
usr/lib/python3/dist-packages/tiktoken-0.12.0.dist-info/METADATA
usr/lib/python3/dist-packages/tiktoken-0.12.0.dist-info/WHEEL
usr/lib/python3/dist-packages/tiktoken-0.12.0.dist-info/top_level.txt
usr/lib/python3/dist-packages/tiktoken_ext
usr/lib/python3/dist-packages/tiktoken_ext/openai_public.py
usr/share
usr/share/doc
usr/share/doc/python3-tiktoken
usr/share/doc/python3-tiktoken/changelog.Debian.gz
usr/share/doc/python3-tiktoken/changelog.gz
usr/share/doc/python3-tiktoken/copyright