Skip to content

Latest commit

 

History

16 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FRACTALS: Fractal Randomness for Aggregate Compression; a Tokenizer Alternative Looping over Seeds

Paper (VERY rough draft)

There's not much to see yet. The byte-level encoder and decoder (non-parametric, with optional UTF-8 normalization forms and automatic conversion to/from emoji/shortcodes or vice versa) are available in fractals/text.py.

Compression mechanisms are still in the works. Stay tuned.

About

Fractal Randomness for Aggregate Compression; a Tokenizer Alternative Looping over Seeds

Resources

Stars

2 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages