Skip to content

Instantly share code, notes, and snippets.

@tmvst
Created April 10, 2014 07:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tmvst/10351908 to your computer and use it in GitHub Desktop.
Save tmvst/10351908 to your computer and use it in GitHub Desktop.
Term frequency rake task
Document.all.each do |doc|
processor = FulltextProcessor.where(:document_id => doc.id, :status => Processor::StatusHelper::PROCESSED).last
if processor.present? && processor.get_data.present?
#puts "Doc #{doc.id} ma fulltext #{processor.get_data}"
stemmed = Text::TextProcessor.stem_text(processor.get_data).join(' ')
l = stemmed.scan(/and/).length
if l<0
puts "#{processor.get_data}"
puts "-----------------------------------------------"
puts "------ ma #{l} vyskytov -and-"
end
end
end
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment