RubyGems Navigation menu

tokn 0.1.1

Given a script containing token descriptions (each a regular expression), tokn compiles an automaton which it can then use to efficiently convert a text file to a sequence of those tokens.

Gemfile:
=

install:
=

Versions:

  1. 0.1.1 April 15, 2013 (117 KB)
  2. 0.1.0 April 09, 2013 (30.5 KB)
  3. 0.0.9 April 04, 2013 (28 KB)
  4. 0.0.8 April 04, 2013 (28.5 KB)
  5. 0.0.6 March 16, 2013 (44.5 KB)
Show all versions (9 total)

Owners:

Authors:

  • Jeff Sember

SHA 256 checksum:

=

Total downloads 20,135

For this version 3,899

Version Released:

License:

mit

Required Ruby Version: None

Links: