The tokenizer should give a dictionary, dataclass, or similar object indicating the configuration used. Something dictionary-like would be good to allow micronlp.tokenizer.tokenize(text, **profile).
The tokenizer should give a dictionary, dataclass, or similar object indicating the configuration used. Something dictionary-like would be good to allow `micronlp.tokenizer.tokenize(text, **profile)`.
The tokenizer should give a dictionary, dataclass, or similar object indicating the configuration used. Something dictionary-like would be good to allow
micronlp.tokenizer.tokenize(text, **profile).