dentarg

If you want, I can try and help with pointers as to how to improve the indexing speed you get. Its quite easy to really increase it by using some simple guidelines, for example:

- Use create in the index API (assuming you can).
- Relax the real time aspect from 1 second to something a bit higher (index.engine.robin.refresh_interval).
- Increase the indexing buffer size (indices.memory.index_buffer_size), it defaults to the value 10% which is 10% of the heap.
- Increase the number of dirty operations that trigger automatic flush (so the translog won't get really big, even though its FS based) by setting index.translog.flush_threshold (defaults to 5000).
- Increase the memory allocated to elasticsearch node. By default its 1g.
- Start with a lower replica count (even 0), and then once the bulk loading is done, increate it to the value you want it to be using the update_settings API. This will improve things as possibly less shards will be allocated to each machine.
- Increase the number of machines you have so

dentarg

=== START OF INFORMATION SECTION ===
Model Family:     Hitachi Deskstar 7K250
Device Model:     HDS722525VLAT80
Serial Number:    VN693ECFF0VWED
Firmware Version: V36OA6MA
User Capacity:    250,059,350,016 bytes [250 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   6
ATA Standard is:  ATA/ATAPI-6 T13 1410D revision 3a

dentarg

$ file ex.csv
ex.csv: UTF-8 Unicode English text
$ cat ex.csv
"title","location","username","password","notes"
"Space, the final frontier","https://starfleet.org","jkirk","2.6U3\NTCTP"".g9h","These are the voyages of the starship Enterprise."
"åäö woho, the final frontier","https://starfleet.org","jkirk","2.6U3\NTCTP"".g9h","These are the voyages of the starship Enterprise."

dentarg

require 'csv'
require 'open-uri'

file = "Workbook3.csv"

content = CSV.read(open(file), encoding: 'ISO-8859-1:UTF-8', col_sep: ";")

File.open("output.csv", "w") do |f|
  rows = content.map { |row| "\"#{row.join('","')}\"" }.join("\n")
  f.puts(rows)

dentarg

require 'nokogiri'
require 'httparty'
require 'rest_client'
require 'faraday'
require 'uri'

def get_title(html)
  Nokogiri::HTML::Document.parse(html).title
end

dentarg

$ zpool status
  pool: bootdir
 state: ONLINE
  scan: resilvered 350M in 0h0m with 0 errors on Sat Apr 13 13:20:19 2013
config:

	NAME        STATE     READ WRITE CKSUM
	bootdir     ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    ada1p2  ONLINE       0     0     0

dentarg

# A sample Gemfile
source "https://rubygems.org"

gem "addressable"
gem "excon", "~> 0.33.0"

dentarg

require 'time'

def snapshot2date(snapshot)
  date = snapshot.split("@").last
  Time.parse(date)
end

def date2snapshot(date)
  "#{FILESYSTEM}@#{date.strftime('%y%m%d')}"
end

dentarg

irb(main):011:0> class ApiError < StandardError; end
=> nil
irb(main):012:0> begin
irb(main):013:1* raise ApiError, "lala"
irb(main):014:1> rescue StandardError => e
irb(main):015:1> puts e.name
irb(main):016:1> end
NoMethodError: undefined method `name' for #<ApiError: lala>
	from (irb):15:in `rescue in irb_binding'
	from (irb):12

dentarg

Stormpath OmniAuth Strategy

Stormpath is the first easy, secure user management and authentication service for developers. This is an OmniAuth strategy that will integrate with Stormpath.

Setup

Sign Up For A Stormpath Account

1. Create a Stormpath developer account and create your API Keys