tokn 0.0.4
Given a script containing token descriptions (each a regular expression), tokn compiles a DFA which it then uses to efficiently extract a sequence of tokens from source files.
Given a script containing token descriptions (each a regular expression), tokn compiles a DFA which it then uses to efficiently extract a sequence of tokens from source files.
N/A