andras/vault-link
andras/vault-link
Watch
1
0
Fork
You've already forked vault-link
 0
Code Issues Pull requests 18 Projects Releases 55 Packages Wiki Activity Actions 28

Expose word_tokenizer

Browse source
This commit is contained in:
Andras Schmelczer 2025-06-14 11:44:06 +01:00
commit 1038f9cee0
No known key found for this signature in database
GPG key ID: FC8F2C3D3D1A718C
1 changed files with 6 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
backend/reconcile/src/lib.rs
View file

@ -7,4 +7,4 @@ pub use operation_transformation::{
CursorPosition, EditedText, TextWithCursors, reconcile, reconcile_with_cursors,
reconcile_with_tokenizer,
};
pub use tokenizer::{Tokenizer, token::Token};
pub use tokenizer::{Tokenizer, token::Token, word_tokenizer::word_tokenizer};