Skip to content

Instantly share code, notes, and snippets.

@Bekbolatov

Bekbolatov/Fask_CKY_200ms

Created November 23, 2015 08:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Bekbolatov/cfd109c7f6af4e796da4 to your computer and use it in GitHub Desktop.
Save Bekbolatov/cfd109c7f6af4e796da4 to your computer and use it in GitHub Desktop.
Download ZIP
about 0.2s per (20-max) sentence, v=2, h=2, beam threshold 1e6
Raw
Fask_CKY_200ms
/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/bin/java -Didea.launcher.port=7535 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA 14 CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/javafx-doclet.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/tools.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/htmlconverter.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Users/rbekbolatov/repos/gh/bekbolatov/Coursework/uw/csep517_15au/hw/proj3/out/production/proj3:/Applications/IntelliJ IDEA 14 CE.app/Contents/lib/idea_rt.jar" com.intellij.rt.execution.application.AppMain edu.berkeley.nlp.assignments.PCFGParserTester -quiet -validateklein -maxTestLength 20 -parv 2 -parh 2
Testing on Klein validation data.
Maximum length for training sentences: 1000
Maximum length for test sentences: 20
Loading training trees (sections 2-21) ... done. (39832 trees)
Loading Klein validation trees (section 22: 0-19) ... done. (175 trees)
PCFG parser training started.
Theta = 0.0769943732080714
Base tag probabilities = [NN : 0.13992745476975416, IN : 0.10373799509067101, NNP : 0.09627716235731999, DT : 0.08614693461666394, JJ : 0.06443704817121179, NNS : 0.06300445881595068, , : 0.05129006724012345, . : 0.041554564707566514, CD : 0.038491497092717264, RB : 0.03259903918621346, VBD : 0.031461177986333036, VB : 0.02782865347126611, CC : 0.025206625488932956, TO : 0.023532990606592648, VBZ : 0.022811959226464906, VBN : 0.021077273511938596, PRP : 0.018353143275777136, VBG : 0.015626907838505812, VBP : 0.013148033531643278, MD : 0.010318643239988715, POS : 0.009158677428454741, PRP$ : 0.008849212865305022, $ : 0.007759771290951425, `` : 0.0074650431355707415, '' : 0.007282943239567676, : : 0.005023009848130792, WDT : 0.0045198667828737675, JJR : 0.0034083205968666185, NNPS : 0.0028136012833305966, RP : 0.0028020226772263552, WP : 0.002487295111301983, WRB : 0.00225572298921716, JJS : 0.0020494132804506813, RBR : 0.0018609977811180302, -RRB- : 0.0014483783635850732, -LRB- : 0.0014378523580357632, EX : 9.083942789054638E-4, RBS : 4.747228502738867E-4, PDT : 3.8946220532447463E-4, FW : 2.4630852985385696E-4, WP$ : 1.768368932284101E-4, # : 1.494692788002038E-4, UH : 1.0210225382830822E-4, SYM : 6.105083218599873E-5, LS : 3.789361997751645E-5]
Grammar: 15364 states, 17945 unary and 19632 binary rules (total: 37577).
SIZE: 263285
Orig grammar states: 73
PCFG parser training completed.
Start time: Mon Nov 23 00:40:53 PST 2015
Total number of trees: 175
Par v/h: 2/2
[Current] P: 60.0 R: 64.28 F1: 62.06 EX: 0.0
[Current] P: 92.85 R: 92.85 F1: 92.85 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 47.36 R: 64.28 F1: 54.54 EX: 0.0
[Current] P: 54.54 R: 66.66 F1: 60.0 EX: 0.0
[Current] P: 66.66 R: 54.54 F1: 60.0 EX: 0.0
[Current] P: 50.0 R: 50.0 F1: 50.0 EX: 0.0
[Current] P: 85.71 R: 75.0 F1: 80.0 EX: 0.0
[Current] P: 71.42 R: 76.92 F1: 74.07 EX: 0.0
[Current] P: 87.5 R: 87.5 F1: 87.5 EX: 0.0
[Current] P: 88.88 R: 88.88 F1: 88.88 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 91.66 R: 84.61 F1: 87.99 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 58.33 R: 53.84 F1: 56.0 EX: 0.0
[Current] P: 81.81 R: 81.81 F1: 81.81 EX: 0.0
[Current] P: 81.81 R: 90.0 F1: 85.71 EX: 0.0
[Current] P: 63.63 R: 50.0 F1: 56.0 EX: 0.0
[Current] P: 90.0 R: 94.73 F1: 92.3 EX: 0.0
[Current] P: 100.0 R: 84.21 F1: 91.42 EX: 0.0
[Current] P: 72.72 R: 72.72 F1: 72.72 EX: 0.0
[Current] P: 100.0 R: 88.88 F1: 94.11 EX: 0.0
[Current] P: 85.71 R: 92.3 F1: 88.88 EX: 0.0
[Current] P: 88.88 R: 88.88 F1: 88.88 EX: 0.0
[Current] P: 69.23 R: 64.28 F1: 66.66 EX: 0.0
[Current] P: 61.53 R: 57.14 F1: 59.25 EX: 0.0
[Current] P: 66.66 R: 58.82 F1: 62.5 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 93.75 R: 88.23 F1: 90.9 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 77.77 R: 100.0 F1: 87.5 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 62.5 R: 62.5 F1: 62.5 EX: 0.0
[Current] P: 53.33 R: 57.14 F1: 55.17 EX: 0.0
[Current] P: 38.88 R: 33.33 F1: 35.89 EX: 0.0
[Current] P: 62.5 R: 50.0 F1: 55.55 EX: 0.0
[Current] P: 75.0 R: 64.28 F1: 69.23 EX: 0.0
[Current] P: 45.45 R: 41.66 F1: 43.47 EX: 0.0
[Current] P: 100.0 R: 66.66 F1: 80.0 EX: 0.0
[Current] P: 75.0 R: 85.71 F1: 80.0 EX: 0.0
[Current] P: 71.42 R: 66.66 F1: 68.96 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 77.77 R: 100.0 F1: 87.5 EX: 0.0
[Current] P: 92.85 R: 86.66 F1: 89.65 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 90.0 R: 81.81 F1: 85.71 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 81.25 R: 76.47 F1: 78.78 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 66.66 R: 66.66 F1: 66.66 EX: 0.0
[Current] P: 33.33 R: 40.0 F1: 36.36 EX: 0.0
[Current] P: 66.66 R: 40.0 F1: 50.0 EX: 0.0
[Current] P: 66.66 R: 72.72 F1: 69.56 EX: 0.0
[Current] P: 70.0 R: 87.5 F1: 77.77 EX: 0.0
[Current] P: 83.33 R: 83.33 F1: 83.33 EX: 0.0
[Current] P: 83.33 R: 83.33 F1: 83.33 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 84.61 R: 84.61 F1: 84.61 EX: 0.0
[Current] P: 80.0 R: 80.0 F1: 80.0 EX: 0.0
[Current] P: 75.0 R: 64.28 F1: 69.23 EX: 0.0
[Current] P: 68.75 R: 57.89 F1: 62.85 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 58.33 R: 63.63 F1: 60.86 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 92.3 R: 80.0 F1: 85.71 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 87.5 F1: 93.33 EX: 0.0
[Current] P: 88.88 R: 88.88 F1: 88.88 EX: 0.0
[Current] P: 75.0 R: 75.0 F1: 75.0 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 83.33 R: 90.9 F1: 86.95 EX: 0.0
[Current] P: 80.0 R: 80.0 F1: 80.0 EX: 0.0
[Current] P: 30.76 R: 23.52 F1: 26.66 EX: 0.0
[Current] P: 80.0 R: 66.66 F1: 72.72 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 72.72 R: 57.14 F1: 64.0 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 90.9 F1: 95.23 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 70.0 R: 70.0 F1: 70.0 EX: 0.0
[Current] P: 60.0 R: 75.0 F1: 66.66 EX: 0.0
[Current] P: 89.47 R: 100.0 F1: 94.44 EX: 0.0
[Current] P: 83.33 R: 100.0 F1: 90.9 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 69.23 R: 69.23 F1: 69.23 EX: 0.0
[Current] P: 78.57 R: 78.57 F1: 78.57 EX: 0.0
[Current] P: 93.33 R: 93.33 F1: 93.33 EX: 0.0
[Current] P: 85.71 R: 92.3 F1: 88.88 EX: 0.0
[Current] P: 93.75 R: 93.75 F1: 93.75 EX: 0.0
[Current] P: 92.3 R: 92.3 F1: 92.3 EX: 0.0
[Current] P: 91.66 R: 100.0 F1: 95.65 EX: 0.0
[Current] P: 81.25 R: 81.25 F1: 81.25 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 66.66 R: 66.66 F1: 66.66 EX: 0.0
[Current] P: 75.0 R: 60.0 F1: 66.66 EX: 0.0
[Current] P: 92.3 R: 92.3 F1: 92.3 EX: 0.0
[Current] P: 81.81 R: 75.0 F1: 78.26 EX: 0.0
[Current] P: 94.11 R: 88.88 F1: 91.42 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 92.3 R: 85.71 F1: 88.88 EX: 0.0
[Current] P: 50.0 R: 57.14 F1: 53.33 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 90.9 R: 83.33 F1: 86.95 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 80.95 R: 89.47 F1: 85.0 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 50.0 R: 57.14 F1: 53.33 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 62.5 R: 62.5 F1: 62.5 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 53.84 R: 63.63 F1: 58.33 EX: 0.0
[Current] P: 64.28 R: 64.28 F1: 64.28 EX: 0.0
[Current] P: 75.0 R: 80.0 F1: 77.41 EX: 0.0
[Current] P: 92.3 R: 85.71 F1: 88.88 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 90.0 R: 81.81 F1: 85.71 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 80.0 R: 72.72 F1: 76.19 EX: 0.0
[Current] P: 92.3 R: 100.0 F1: 96.0 EX: 0.0
[Current] P: 36.36 R: 40.0 F1: 38.09 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 70.0 R: 63.63 F1: 66.66 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 81.25 R: 81.25 F1: 81.25 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 72.22 R: 76.47 F1: 74.28 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 71.42 R: 71.42 F1: 71.42 EX: 0.0
[Current] P: 93.33 R: 100.0 F1: 96.55 EX: 0.0
[Current] P: 71.42 R: 71.42 F1: 71.42 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 75.0 R: 64.28 F1: 69.23 EX: 0.0
[Current] P: 84.61 R: 73.33 F1: 78.57 EX: 0.0
[Current] P: 76.92 R: 76.92 F1: 76.92 EX: 0.0
[Current] P: 77.77 R: 87.5 F1: 82.35 EX: 0.0
[Current] P: 81.81 R: 100.0 F1: 90.0 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 87.5 R: 87.5 F1: 87.5 EX: 0.0
[Current] P: 93.75 R: 100.0 F1: 96.77 EX: 0.0
[Current] P: 61.53 R: 72.72 F1: 66.66 EX: 0.0
[Current] P: 84.61 R: 68.75 F1: 75.86 EX: 0.0
[Current] P: 75.0 R: 69.23 F1: 72.0 EX: 0.0
[Current] P: 63.63 R: 70.0 F1: 66.66 EX: 0.0
[Current] P: 81.81 R: 90.0 F1: 85.71 EX: 0.0
[Current] P: 81.81 R: 90.0 F1: 85.71 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 80.0 R: 88.88 F1: 84.21 EX: 0.0
[Current] P: 100.0 R: 93.33 F1: 96.55 EX: 0.0
[Current] P: 66.66 R: 66.66 F1: 66.66 EX: 0.0
[Current] P: 70.0 R: 70.0 F1: 70.0 EX: 0.0
curMax: 20
[Average] P: 82.18 R: 81.36 F1: 81.77 EX: 34.28
Avg [s]: 0.20646857142857142
Total number of trees: 175
Par v/h: 2/2
End time: Mon Nov 23 00:41:29 PST 2015
Process finished with exit code 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment