Skip to content

Instantly share code, notes, and snippets.

blee@dev-104 ~ $ ps aux|grep joe |grep nailgun
joe 695 0.0 0.2 7820420 80648 ? Sl May13 78:08 java -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.awt.headless=true -XX:+AggressiveOpts -XX:+UseCompressedOops -Xss4096k -XX:+UseParallelOldGC -server -Xmx5g -XX:MaxPermSize=1g -Dzinc.compiler.cache.limit=5 -Dzinc.analysis.cache.limit=1000 -Dzinc.resident.cache.limit=0 -Dtwitter.pants.buildroot=/dev/shm/loko_build_joe.Kn7_Rr/SRCDIR -Dpidfile=.pants.d/ng/scala-compile-2.9.2/pid -cp /dev/shm/loko_build_joe.Kn7_Rr/SRCDIR/build-support/profiles/nailgun.libs/nailgun-server-0.9.1.jar com.martiansoftware.nailgun.NGServer :0
joe 919 0.0 0.0 7820420 29208 ? Sl May13 77:56 java -Duser.timezone=UTC -Dfile.encoding=UTF-8 -Djava.awt.headless=true -XX:+AggressiveOpts -XX:+UseCompressedOops -Xss4096k -XX:+UseParallelOldGC -server -Xmx5g -XX:MaxPermSize=1g -Dzinc.compiler.cache.limit=5 -Dzinc.analysis.cache.limit=1000 -Dzinc.resident.cache.limit=0 -Dtwitter.pants.buildroot=/dev/shm/loko_build_
2013-09-06 21:11:40,693 ERROR: [pid 32580] Error while running AdsModelTraining(context=PostCheckin, name=bleeTest, days=1, test=False, description=Default, chunk_length=7, click_weight=1, validation_days=1, min_feature_day_frequency=.3, min_feature_total_frequency=.1, use_pca=False, downsampling_percent_kept=20, include_quantile_scorers=False, include_normalized_scorers=False, include_campaign_scorers=False, include_count_scorers=False, include_distance_scorers=False, include_popularity_scorers=False, date=2013-08-19, base_dir=/user/datateam/adstraining, output_dir=/user/blee/adstraining)
Traceback (most recent call last):
File "/foursquare/blee/.pex/install/luigi-2013_08_07.001-py2.6.egg/luigi/worker.py", line 229, in _run_task
task.run()
File "fsluigi/task/ads/ad_model_trainer.py", line 304, in run
old_model_pcvr_feature))
File "foursquare/ads/ads_training_helpers.py", line 151, in data_sets_by_day_iter
sets = training_and_validation_sets(feature_dicts, training_features, old_model_pcvr_f
com.foursquare.common.exception.SoftException: RecException: java.util.regex.PatternSyntaxException: Unmatched closing ')' near index 6 \bWi-Fi)\b ^: java.util.regex.Pattern.error(Pattern.java:1924) java.util.regex.Pattern.compile(Pattern.java:1669) java.util.regex.Pattern.<init>(Pattern.java:1337) java.util.regex.Pattern.compile(Pattern.java:1022) [------------------------------- SNIP -------------------------------] com.foursquare.venue.rec.concrete.DisplayRecommendationHelper$.addEmphasis$1(DisplayRecommendationHelper.scala:113) com.foursquare.venue.rec.concrete.DisplayRecommendationHelper$$anonfun$getVenueTagMatches$2$$anonfun$19$$anonfun$apply$14$$anonfun$apply$15$$anonfun$apply$16$$anonfun$apply$18$$anonfun$apply$19$$anonfun$apply$20$$anonfun$apply$21$$anonfun$apply$22$$anonfun$apply$23.apply(DisplayRecommendationHelper.scala:146) com.foursquare.venue.rec.concrete.DisplayRecommendationHelper$$anonfun$getVenueTagMatches$2$$anonfun$19$$anonfun$apply$14$$anonfun$apply$15$$anonfun$apply$16$$anonfun$apply$18
{ "messages" : [ "java.util.regex.PatternSyntaxException: Unmatched closing ')' near index 6\n\\bwi-Fi)\\b\n ^:\njava.util.regex.Pattern.error(Pattern.java:1924)\n\tjava.util.regex.Pattern.compile(Pattern.java:1669)\n\tjava.util.regex.Pattern.<init>(Pattern.java:1337)\n\tjava.util.regex.Pattern.compile(Pattern.java:1022)\n\t[------------------------------- SNIP -------------------------------]\n\tcom.foursquare.venue.rec.concrete.DisplayRecommendationHelper$.addEmphasis$1(DisplayRecommendationHelper.scala:113)\n\tcom.foursquare.venue.rec.concrete.DisplayRecommendationHelper$$anonfun$getVenueTagMatches$2$$anonfun$19$$anonfun$apply$14$$anonfun$apply$15$$anonfun$apply$16$$anonfun$apply$18$$anonfun$apply$19$$anonfun$apply$20$$anonfun$apply$21$$anonfun$apply$22$$anonfun$apply$23.apply(DisplayRecommendationHelper.scala:146)\n\tcom.foursquare.venue.rec.concrete.DisplayRecommendationHelper$$anonfun$getVenueTagMatches$2$$anonfun$19$$anonfun$apply$14$$anonfun$apply$15$$anonfun$apply$16$$anonfun$apply$18$$anonfun$apply$
@benlee
benlee / gist:5173242
Created March 15, 2013 21:30
example log line
{"logtype":"private-web-logger","uri":"\/private\/logger","params":{"event":"autocompletesearch","si":"1","t":"shell","gl":"7","gi":"0","metrics":"ir,1;sid,1363039563805-971;c,wac;n,autocomplete-results;rid,513e5553e4b03fae39f7d7c9;ll,52.4667053,-1.9167023|n,commonquery","_cid":"1363039563805-971-0","type":"commonquery","href":"\/explore?q=shell%20petrol%20station&acrid=513e5553e4b03fae39f7d7c9","sl":"6","_p":"https:\/\/foursquare.com\/activity","_sid":"1363039563805-971","_ts":"1363039575786"},"ua":"Mozilla\/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident\/5.0)","ip":"90.200.184.90","reqLocale":"en_GB","locale":"en_GB","user":"50388370","ref":"https:\/\/foursquare.com\/activity","orig_ref":"du119w.dub119.mail.live.com","landing_page":"\/manage\/friends","sid":"0DPYKDUXUCLKKSYVKVJ4N1G2R3Z2FY","loc":"Birmingham","cc":"US","continent":"north_america","seoexperiments":[],"ts":1363039574,"tsMs":1363039574856,"host":"www-30","process":27393,"thread":15,"fslogger_event_id":"private-web-logger-www-30-27393-15-136
@benlee
benlee / gist:5173136
Created March 15, 2013 21:12
log actions from autocomplete
Request URL:https://api.foursquare.com/v2/private/logactions
Request Method:POST
locale:en
v:20130315
loglines:[{"name":{"action":"api-resp-s","view":"explore"},"details":{"l":30,"acrid":"51438e84e4b08e9c7ee087dd"},"sessionId":"1363381866387-237","ids":{"requestId":"51438e86e4b08e9c7ee09750"},"timestamp":"1363381897339","initiator":0}]
isMobile:false
logType:j
wsid:1OKTEWVERDI4F1NH3ULK1OFYQ55INA%3A%3A1350101738
@benlee
benlee / gist:5165118
Created March 14, 2013 20:50
Lots of output
[2013-03-14 20:43:38,588] [pool-VenueClientDriver-thread-1] WARN c.f.v.c.ConcreteVenueFinder$VenueClientVenueDriver - DRIVER-NEW: findAllById.256 => List(class com.foursquare.coremodel.VenueModel={gvi=, tts=27, aliases=List(bucca di beppo, buca di beppo, buca di beppo san francisco, buca di beppo - san francisco, buca di bepo), m=true, city=San Francisco, pvs=true, venuetip=4dde99f281300f5c069596f4, asll=, lu=513f3760e4b06157b277e315, partitionedPopularity=List(1, 3, 1, 6, 5, 39, 206, 108, 150, 598, 372, 54, 1, 1, 0, 0, 0, 10, 64, 31, 54, 240, 231, 36, 3, 1, 3, 0, 1, 13, 49, 43, 115, 294, 225, 53, 6, 1, 0, 1, 1, 10, 43, 34, 85, 207, 88, 10), zip=94103, keywordList=List(di, beppo, buca, francisco, san, , bucca, bepo), state=CA, url=http://www.bucadibeppo.com, allowSpecials=, pl=, uvs=3294, f=0, closed=false, oa=, twitter_name=bucadibeppo, description=Buca di Beppo serves vibrant Italian food in an eclectic, vintage setting. Our food is meant to be shared and family style portions make Buca perfect for celeb
@benlee
benlee / gist:5137572
Created March 11, 2013 20:43
Slow log lines
INFO: [] webapp=/solr path=/select/ params={hl.fragsize=0&mm=100%25&facet=true&qf=text&wt=json&hl=on&defType=edismax&rows=250&pf=text^100000.0&fl=id,score,text&start=0&q=(empresa+startup)&facet.field=venueid&fq=geo_s2_cell_ids:("94953787FC000000"+OR+"9495378C00000000"+OR+"9495383000000000"+OR+"9495385000000000"+OR+"949538F400000000"+OR+"949538FC00000000"+OR+"9495391000000000"+OR+"9495395C00000000"+OR+"9495397000000000"+OR+"9495399000000000"+OR+"949539B000000000"+OR+"949539D000000000"+OR+"949539E700000000"+OR+"949539EC00000000"+OR+"949539F400000000"+OR+"94953A17C0000000"+OR+"94953A1C00000000"+OR+"94953A3000000000"+OR+"94953BD000000000"+OR+"94953BE400000000"+OR+"94953BE900000000"+OR+"94953BEF40000000")} hits=0 status=0 QTime=18152
Mar 11, 2013 8:38:26 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/ params={hl.fragsize=0&mm=100%25&facet=true&qf=text&wt=json&hl=on&defType=edismax&rows=250&pf=text^100000.0&fl=id,score,text&start=0&q=(post+office)&facet.field=venueid&fq=geo_s2_cell_ids:
Cafe Du Soleil
name: "RecAuthorityScore",
score: 1.4990426894306124,
details: null,
children: 
{
count: 1,
items: 
[

{
name: "VenueQualityScore",
blee@dev-104 foursquare.web $ sudo su - produser sh -c "cd `pwd`; scripts/deploy-hiverc.py latest"
downloading file: http://build/job/foursquare-oozie/6985/artifact/target/hiverc.tgz
download complete! file saved to: /data/tmp/hiverc-deploy-cache-produser/6985/hiverc.tgz
found JARS: hadoop-hive-udf.jar
downloading file: http://build/job/foursquare-oozie/6985/artifact/dist/hadoop-hive-udf.jar
download complete! file saved to: /data/tmp/hiverc-deploy-cache-produser/6985/hadoop-hive-udf.jar
rmr: DEPRECATED: Please use 'rm -r' instead.
Deleted hdfs://datamining-nn:8020/user/produser/hiverc/.hiverc
rmr: DEPRECATED: Please use 'rm -r' instead.
Deleted hdfs://datamining-nn:8020/user/produser/hiverc/hive-query.sql