tokn 0.0.5
Given a script containing token descriptions (each a regular expression), tokn compiles a DFA which it then uses to efficiently extract a sequence of tokens from source files.
Given a script containing token descriptions (each a regular expression), tokn compiles a DFA which it then uses to efficiently extract a sequence of tokens from source files.
k.A.