RubyGems Navigation menu

token_estimator 0.1.2

TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, Markdown, and input text files using different tokenizers.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 0.1.2 - July 15, 2024 (29 KB)
  2. 0.1.1 - July 15, 2024 (16 KB)
  3. 0.1.0 - July 11, 2024 (9 KB)

Runtime Dependencies (7):

csv ~> 3.3
kramdown ~> 2.4
nokogiri ~> 1.16, >= 1.16.6
pdf-reader ~> 2.12
rails >= 7.2.0.beta2
roo ~> 2.10, >= 2.10.1
tokenizers ~> 0.5.0

Owners:

Pushed by:

Authors:

  • aemabit

SHA 256 checksum:

= Copy to clipboard Copied!

Total downloads 506

For this version 179

Version Released:

License:

MIT

Required Ruby Version: >= 3.0.0

Links: