Luc Georges 787f2a1a26 feat: improve tokenizer config (#21) ... * feat: improve tokenizer config * fix: add untagged decorator to `TokenizerConfig` * feat: bump version to `0.2.0`		2023-09-21 17:57:19 +02:00
..
main.rs	feat: improve tokenizer config (#21)	2023-09-21 17:57:19 +02:00