joewiz

On Tue Oct 27, 2015, history.state.gov began buckling under load, intermittently issuing 500 errors. Nginx's error log was sprinkled with the following errors:

2015/10/27 21:48:36 [crit] 2475#0: accept4() failed (24: Too many open files)

2015/10/27 21:48:36 [alert] 2475#0: *7163915 socket() failed (24: Too many open files) while connecting to upstream...

An article at http://www.cyberciti.biz/faq/linux-unix-nginx-too-many-open-files/ provided directions that mostly worked. Below are the steps we followed. The steps that diverged from the article's directions are marked with an *.

1. * Instead of using su to run ulimit on the nginx account, use ps aux | grep nginx to locate nginx's process IDs. Then query each process's file handle limits using cat /proc/pid/limits (where pid is the process id retrieved from ps). (Note: sudo may be necessary on your system for the cat command here, depending on your system.)
2. Added fs.file-max = 70000 to /etc/sysctl.conf

grantslatton

import urllib2
import re
import sys
from collections import defaultdict
from random import random

"""
PLEASE DO NOT RUN THIS QUOTED CODE FOR THE SAKE OF daemonology's SERVER, IT IS 
NOT MY SERVER AND I FEEL BAD FOR ABUSING IT. JUST GET THE RESULTS OF THE 
CRAWL HERE: http://pastebin.com/raw.php?i=nqpsnTtW AND SAVE THEM TO "archive.txt"

happypeter

1. the default index.html does not work well in prodution mode, so do not borther to config that, just delete it and go on.

2. To put things in production mode, do

    rails g scaffold items name:string
    rake db:migrate RAILS_ENV=production
    rm public/index.html
    #change route.rb point root to items#index
    rake assets:precompile
    sudo service nginx restart
   

./config/unicorn_init.sh stop

woodie

Rails 3.0.pre on App Engine¶ ↑

You can Rails 3 on App Engine, but it won’t be especially useful until bundler 10. You should try these instead:

• Rails 2.3.5: DataMapper version: gist.github.com/268192

• Rails 2.3.5: TinyDS version: gist.github.com/269075

Install the Development Environment¶ ↑

The gems for the development environment include a pre-release appengine-tools gem that provides a pre-release version of jruby-rack.