Skip to content

Document training_options for the udpipe engine in step_tokenize() - #354

Merged
EmilHvitfeldt merged 3 commits into
mainfrom
document-udpipe-training-options
Oct 9, 2026
Merged

EmilHvitfeldt merged 3 commits into
mainfrom
document-udpipe-training-options

Conversation

@EmilHvitfeldt

Copy link
Copy Markdown
Member

The training_options documentation for step_tokenize() only mentioned tokenizers.bpe, but the udpipe engine also requires it to pass the loaded model. This documents that and adds an example to the udpipe section.

Closes #237

@EmilHvitfeldt
EmilHvitfeldt merged commit 3967748 into main Oct 9, 2026
14 checks passed
@EmilHvitfeldt
EmilHvitfeldt deleted the document-udpipe-training-options branch October 9, 2026 19:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Documentation: in step_tokenize(), udpipe engine also takes training_options

1 participant