OpenSuSE Leap 16.0 for ppc64le : / usr /lib64 /python3.11 /site-packages /tokenizers /implementations

• __init__.py
• __pycache__
• base_tokenizer.py
• bert_wordpiece.py
• byte_level_bpe.py
• char_level_bpe.py
• sentencepiece_bpe.py
• sentencepiece_unigram.py

Generated by rpm2html 1.8.1

Fabrice Bellet, Fri Jan 24 23:25:24 2025