andras/reconcile
andras/reconcile
Watch
1
0
Fork
You've already forked reconcile
 0
Code Issues Pull requests 10 Projects Releases Packages Wiki Activity Actions

Improve docs and compare with alternatives

Browse source
This commit is contained in:
Andras Schmelczer 2026-03-10 20:29:35 +00:00
commit 3d382ad741
1 changed files with 106 additions and 69 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/tokenizer.rs
View file

@ -12,7 +12,7 @@ use wasm_bindgen::prelude::*;
pub mod token;
/// A trait for tokenizers that take a string and return a list of tokens.
/// Type alias for tokenizer functions that split a string into tokens.
pub type Tokenizer<T> = dyn Fn(&str) -> Vec<Token<T>>;
#[cfg_attr(feature = "wasm", wasm_bindgen)]