Skip to main content
Module bpe_compressor
sqz_
engine
2.1.1
Module bpe_
compressor
Module Items
Structs
Functions
In crate sqz_
engine
sqz_engine
Module
bpe_
compressor
Copy item path
Source
Structs
§
BpeConfig
Configuration for BPE compression.
BpeResult
Result of BPE compression.
Merge
Rule
A single BPE merge rule.
Functions
§
bpe_
compress
Compress text using byte-pair encoding at the word level.