Created
March 15, 2026 06:59
-
-
Save tayljordan/01530d73853c15616b1cf95f51f89d65 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /Users/jordantaylor/PycharmProjects/mira_requests/.venv/bin/python /Users/jordantaylor/PycharmProjects/mira_requests/print_results.py | |
| Test Voyage kn Truth MIRA MIRA Δ Gemini Gemini Δ Claude Claude Δ | |
| ------ ----------------------------- ---- --------- --------- -------- --------- ---------- --------- ---------- | |
| 4 SINGAPORE TO YOKOSUKA 14 92.2219h 92.3378h ±0.1159h 92.1492h ±0.0727h 89.5500h ±2.6719h | |
| 5 FUKUOKA TO SINGAPORE 14 64.0570h 63.5531h ±0.5039h 63.6492h ±0.4078h 89.8261h ±25.7691h | |
| 6 SINGAPORE TO BUSAN 18 51.1346h 51.3300h ±0.1954h 51.3108h ±0.1762h 81.5214h ±30.3868h | |
| 7 GUAM TO ONSAN 12 107.4881h 107.8222h ±0.3341h 107.4422h ±0.0459h 224.9431h ±117.4550h | |
| 8 DIEGO GARCIA TO DUQM 14 86.7429h 87.3231h ±0.5802h 87.4092h ±0.6663h 84.6783h ±2.0646h | |
| 9 FUJAIRAH TO DIEGO GARCIA 14 9.2686h 9.2572h ±0.0114h 9.2531h ±0.0155h 38.0392h ±28.7706h | |
| 10 GUAM TO YOKOSUKA 14 96.8006h 97.1372h ±0.3366h 97.1086h ±0.3080h 61.7736h ±35.0270h | |
| 11 GUAM TO ULSAN 12 147.1732h 147.5008h ±0.3276h 147.4178h ±0.2446h 230.2261h ±83.0529h | |
| 12 LOS ANGELES TO SAN FRANCISCO 12 7.6457h 7.6314h ±0.0143h 7.6314h ±0.0143h 22.3550h ±14.7093h | |
| 13 EVERGLADES TO SAN FRANCISCO 12 26.5706h 26.5689h ±0.0017h 26.5142h ±0.0564h 32.6242h ±6.0536h | |
| 14 SURIGAO TO BALABAC 10 0.0335h 0.0333h ±0.0002h 0.0333h ±0.0002h 0.9644h ±0.9309h | |
| 15 PORT EVERGLADES TO PASCAGOULA 12 5.6905h 5.7069h ±0.0164h 5.7069h ±0.0164h 5.2333h ±0.4572h | |
| 16 PASCAGOULA TO TAMPA 14 37.1803h 37.2206h ±0.0403h 37.2244h ±0.0441h 80.2000h ±43.0197h | |
| 17 DIEGO GARCIA TO SINGAPORE 10 7.0598h 7.0606h ±0.0008h 7.0358h ±0.0240h 3.4000h ±3.6598h | |
| 18 SINGAPORE TO YOKOSUKA 18 177.2309h 177.5961h ±0.3652h 177.3856h ±0.1547h 259.6175h ±82.3866h | |
| 19 FUKUOKA TO SINGAPORE 14 206.5058h 206.9550h ±0.4492h 206.6844h ±0.1786h 402.0000h ±195.4942h | |
| 20 SINGAPORE TO BUSAN 12 0.3024h 0.3022h ±0.0002h 0.3022h ±0.0002h 7.8411h ±7.5387h | |
| 21 GUAM TO ONSAN 10 0.4332h 0.4325h ±0.0007h 0.4322h ±0.0010h 0.0717h ±0.3615h | |
| 22 DIEGO GARCIA TO DUQM 18 106.0049h 106.3947h ±0.3898h 106.2956h ±0.2907h — (error) — | |
| 23 FUJAIRAH TO DIEGO GARCIA 10 0.1187h 0.1192h ±0.0005h 0.1192h ±0.0005h 0.1847h ±0.0660h | |
| 24 GUAM TO YOKOSUKA 18 75.1836h 75.4450h ±0.2614h 75.3400h ±0.1564h 60.6933h ±14.4903h | |
| 25 GUAM TO ULSAN 10 0.0345h 0.0344h ±0.0001h 0.0344h ±0.0001h 0.5592h ±0.5247h | |
| 26 LOS ANGELES TO SAN FRANCISCO 12 11.1191h 11.0961h ±0.0230h 11.0886h ±0.0305h 22.9747h ±11.8556h | |
| 27 EVERGLADES TO SAN FRANCISCO 16 26.0117h 26.0086h ±0.0031h 26.0000h ±0.0117h 26.3797h ±0.3680h | |
| 28 SURIGAO TO BALABAC 16 35.0808h 35.0706h ±0.0102h 35.0389h ±0.0419h 56.8583h ±21.7775h | |
| 29 PORT EVERGLADES TO PASCAGOULA 12 5.5822h 5.5983h ±0.0161h 5.5983h ±0.0161h 1.6608h ±3.9214h | |
| 30 PASCAGOULA TO TAMPA 14 36.8457h 36.8864h ±0.0407h 36.8739h ±0.0282h 58.9944h ±22.1487h | |
| 31 DIEGO GARCIA TO SINGAPORE 12 101.1377h 101.2164h ±0.0787h 101.1506h ±0.0129h 738.5000h ±637.3623h | |
| 32 SINGAPORE TO YOKOSUKA 14 29.5026h 29.5058h ±0.0032h 29.5044h ±0.0018h 78.0444h ±48.5418h | |
| 33 FUKUOKA TO SINGAPORE 12 1.0793h 1.0800h ±0.0007h 1.0506h ±0.0287h — (error) — | |
| 34 SINGAPORE TO BUSAN 18 141.8067h 142.1692h ±0.3625h 142.0975h ±0.2908h 170.8397h ±29.0330h | |
| 35 GUAM TO ONSAN 16 111.7114h 111.9672h ±0.2558h 111.8839h ±0.1725h 269.5886h ±157.8772h | |
| 36 DIEGO GARCIA TO DUQM 10 0.0085h 0.0083h ±0.0002h 0.0008h ±0.0077h 0.9486h ±0.9401h | |
| 37 FUJAIRAH TO DIEGO GARCIA 12 190.3979h 191.0819h ±0.6840h 191.0764h ±0.6785h 322.2925h ±131.8946h | |
| 38 GUAM TO YOKOSUKA 16 82.6223h 82.9139h ±0.2916h 82.9025h ±0.2802h 37.6092h ±45.0131h | |
| 39 GUAM TO ULSAN 16 110.0734h 110.3189h ±0.2455h 110.1933h ±0.1199h 213.0425h ±102.9691h | |
| 40 LOS ANGELES TO SAN FRANCISCO 14 30.1615h 30.1717h ±0.0102h 30.1667h ±0.0052h 34.5214h ±4.3599h | |
| 41 EVERGLADES TO SAN FRANCISCO 14 26.5151h 26.5131h ±0.0020h 26.5272h ±0.0121h 36.4519h ±9.9368h | |
| 42 SURIGAO TO BALABAC 10 1.2547h 1.2533h ±0.0014h 1.2528h ±0.0019h 1.8667h ±0.6120h | |
| 43 PORT EVERGLADES TO PASCAGOULA 10 1.6453h 1.6464h ±0.0011h 1.6464h ±0.0011h 1.2233h ±0.4220h | |
| 44 PASCAGOULA TO TAMPA 18 54.5937h 54.6750h ±0.0813h 54.6183h ±0.0246h 186.9903h ±132.3966h | |
| 45 DIEGO GARCIA TO SINGAPORE 16 83.6726h 83.7486h ±0.0760h 83.6886h ±0.0160h 553.1667h ±469.4941h | |
| 46 SINGAPORE TO YOKOSUKA 18 176.5807h 176.9447h ±0.3640h 176.7347h ±0.1540h 291.4203h ±114.8396h | |
| 47 FUKUOKA TO SINGAPORE 18 158.9667h 159.3169h ±0.3502h 159.0967h ±0.1300h 345.1228h ±186.1561h | |
| 48 SINGAPORE TO BUSAN 16 16.3205h 16.3708h ±0.0503h 16.3531h ±0.0326h 22.5478h ±6.2273h | |
| 49 GUAM TO ONSAN 14 122.5153h 122.8022h ±0.2869h 122.4244h ±0.0909h 443.7439h ±321.2286h | |
| 50 DIEGO GARCIA TO DUQM 14 132.5879h 133.1056h ±0.5177h 133.4025h ±0.8146h 485.3219h ±352.7340h | |
| 51 PORT EVERGLADES TO PASCAGOULA 18 4.9692h 4.9817h ±0.0125h 4.9786h ±0.0094h 1.7703h ±3.1989h | |
| 52 PASCAGOULA TO TAMPA 18 53.6408h 53.7222h ±0.0814h 53.7086h ±0.0678h 80.8003h ±27.1595h | |
| 53 DIEGO GARCIA TO SINGAPORE 10 96.4830h 96.5667h ±0.0837h — (error) — 268.0333h ±171.5503h | |
| Test Voyage MIRA $ Gemini $ Claude $ | |
| ------ ----------------------------- --------- ---------- ---------- | |
| 4 SINGAPORE TO YOKOSUKA $0.000235 $0.002350 $0.036120 | |
| 5 FUKUOKA TO SINGAPORE $0.000235 $0.002104 $0.037230 | |
| 6 SINGAPORE TO BUSAN $0.000235 $0.001688 $0.035680 | |
| 7 GUAM TO ONSAN $0.000235 $0.001886 $0.036145 | |
| 8 DIEGO GARCIA TO DUQM $0.000235 $0.001424 $0.034335 | |
| 9 FUJAIRAH TO DIEGO GARCIA $0.000235 $0.001752 $0.033385 | |
| 10 GUAM TO YOKOSUKA $0.000235 $0.001784 $0.036290 | |
| 11 GUAM TO ULSAN $0.000235 $0.001872 $0.033360 | |
| 12 LOS ANGELES TO SAN FRANCISCO $0.000235 $0.001340 $0.040245 | |
| 13 EVERGLADES TO SAN FRANCISCO $0.000235 $0.001278 $0.034785 | |
| 14 SURIGAO TO BALABAC $0.000235 $0.001312 $0.030845 | |
| 15 PORT EVERGLADES TO PASCAGOULA $0.000235 $0.001304 $0.036420 | |
| 16 PASCAGOULA TO TAMPA $0.000235 $0.001340 $0.036755 | |
| 17 DIEGO GARCIA TO SINGAPORE $0.000235 $0.001618 $0.035530 | |
| 18 SINGAPORE TO YOKOSUKA $0.000235 $0.002426 $0.034895 | |
| 19 FUKUOKA TO SINGAPORE $0.000235 $0.002088 $0.036005 | |
| 20 SINGAPORE TO BUSAN $0.000235 $0.001708 $0.035555 | |
| 21 GUAM TO ONSAN $0.000235 $0.001910 $0.038720 | |
| 22 DIEGO GARCIA TO DUQM $0.000235 $0.001438 — | |
| 23 FUJAIRAH TO DIEGO GARCIA $0.000235 $0.001776 $0.034010 | |
| 24 GUAM TO YOKOSUKA $0.000235 $0.001796 $0.035515 | |
| 25 GUAM TO ULSAN $0.000235 $0.001872 $0.035585 | |
| 26 LOS ANGELES TO SAN FRANCISCO $0.000235 $0.001340 $0.035145 | |
| 27 EVERGLADES TO SAN FRANCISCO $0.000235 $0.001278 $0.034935 | |
| 28 SURIGAO TO BALABAC $0.000235 $0.001310 $0.033820 | |
| 29 PORT EVERGLADES TO PASCAGOULA $0.000235 $0.001292 $0.033770 | |
| 30 PASCAGOULA TO TAMPA $0.000235 $0.001340 $0.035680 | |
| 31 DIEGO GARCIA TO SINGAPORE $0.000235 $0.001618 $0.037880 | |
| 32 SINGAPORE TO YOKOSUKA $0.000235 $0.002338 $0.034595 | |
| 33 FUKUOKA TO SINGAPORE $0.000235 $0.002068 — | |
| 34 SINGAPORE TO BUSAN $0.000235 $0.001724 $0.035155 | |
| 35 GUAM TO ONSAN $0.000235 $0.001910 $0.031795 | |
| 36 DIEGO GARCIA TO DUQM $0.000235 $0.001422 $0.035160 | |
| 37 FUJAIRAH TO DIEGO GARCIA $0.000235 $0.001712 $0.036810 | |
| 38 GUAM TO YOKOSUKA $0.000235 $0.001760 $0.032965 | |
| 39 GUAM TO ULSAN $0.000235 $0.001872 $0.035060 | |
| 40 LOS ANGELES TO SAN FRANCISCO $0.000235 $0.001304 $0.036295 | |
| 41 EVERGLADES TO SAN FRANCISCO $0.000235 $0.001290 $0.047935 | |
| 42 SURIGAO TO BALABAC $0.000235 $0.001312 $0.035995 | |
| 43 PORT EVERGLADES TO PASCAGOULA $0.000235 $0.001292 $0.033470 | |
| 44 PASCAGOULA TO TAMPA $0.000235 $0.001340 $0.033405 | |
| 45 DIEGO GARCIA TO SINGAPORE $0.000235 $0.001606 $0.032780 | |
| 46 SINGAPORE TO YOKOSUKA $0.000235 $0.002426 $0.036020 | |
| 47 FUKUOKA TO SINGAPORE $0.000235 $0.002052 $0.033530 | |
| 48 SINGAPORE TO BUSAN $0.000235 $0.001708 $0.032355 | |
| 49 GUAM TO ONSAN $0.000235 $0.001910 $0.038195 | |
| 50 DIEGO GARCIA TO DUQM $0.000235 $0.001438 $0.035810 | |
| 51 PORT EVERGLADES TO PASCAGOULA $0.000235 $0.001304 $0.037195 | |
| 52 PASCAGOULA TO TAMPA $0.000235 $0.001340 $0.036130 | |
| 53 DIEGO GARCIA TO SINGAPORE $0.000235 — $0.037180 | |
| TOTAL $0.011752 $0.081372 $1.706475 | |
| Test Voyage MIRA t Gemini t Claude t | |
| ------ ----------------------------- -------- ---------- ---------- | |
| 4 SINGAPORE TO YOKOSUKA 14.7s 192.1s 22.7s | |
| 5 FUKUOKA TO SINGAPORE 11.5s 219.9s 23.2s | |
| 6 SINGAPORE TO BUSAN 13.3s 165.9s 22.0s | |
| 7 GUAM TO ONSAN 12.6s 219.0s 23.9s | |
| 8 DIEGO GARCIA TO DUQM 11.6s 277.6s 21.7s | |
| 9 FUJAIRAH TO DIEGO GARCIA 13.2s 202.3s 20.2s | |
| 10 GUAM TO YOKOSUKA 11.6s 162.2s 21.7s | |
| 11 GUAM TO ULSAN 12.2s 225.5s 19.8s | |
| 12 LOS ANGELES TO SAN FRANCISCO 11.8s 104.9s 25.6s | |
| 13 EVERGLADES TO SAN FRANCISCO 12.9s 180.8s 20.5s | |
| 14 SURIGAO TO BALABAC 11.1s 106.0s 20.5s | |
| 15 PORT EVERGLADES TO PASCAGOULA 12.0s 212.0s 22.8s | |
| 16 PASCAGOULA TO TAMPA 13.9s 133.1s 21.0s | |
| 17 DIEGO GARCIA TO SINGAPORE 11.2s 153.5s 22.4s | |
| 18 SINGAPORE TO YOKOSUKA 13.9s 148.1s 20.9s | |
| 19 FUKUOKA TO SINGAPORE 11.6s 182.4s 21.0s | |
| 20 SINGAPORE TO BUSAN 16.9s 235.2s 20.6s | |
| 21 GUAM TO ONSAN 13.4s 78.1s 25.8s | |
| 22 DIEGO GARCIA TO DUQM 12.6s 165.2s — | |
| 23 FUJAIRAH TO DIEGO GARCIA 12.9s 89.4s 19.4s | |
| 24 GUAM TO YOKOSUKA 12.1s 193.7s 21.2s | |
| 25 GUAM TO ULSAN 16.6s 235.2s 21.0s | |
| 26 LOS ANGELES TO SAN FRANCISCO 11.7s 204.3s 23.5s | |
| 27 EVERGLADES TO SAN FRANCISCO 13.6s 178.4s 22.0s | |
| 28 SURIGAO TO BALABAC 12.4s 173.9s 21.1s | |
| 29 PORT EVERGLADES TO PASCAGOULA 12.2s 152.4s 23.3s | |
| 30 PASCAGOULA TO TAMPA 10.7s 242.2s 22.1s | |
| 31 DIEGO GARCIA TO SINGAPORE 12.2s 280.1s 24.8s | |
| 32 SINGAPORE TO YOKOSUKA 13.2s 153.5s 21.1s | |
| 33 FUKUOKA TO SINGAPORE 11.9s 295.9s — | |
| 34 SINGAPORE TO BUSAN 12.9s 256.3s 20.8s | |
| 35 GUAM TO ONSAN 12.2s 273.6s 18.9s | |
| 36 DIEGO GARCIA TO DUQM 13.4s 273.8s 24.1s | |
| 37 FUJAIRAH TO DIEGO GARCIA 11.8s 132.1s 22.2s | |
| 38 GUAM TO YOKOSUKA 12.2s 177.0s 21.5s | |
| 39 GUAM TO ULSAN 13.3s 228.5s 22.4s | |
| 40 LOS ANGELES TO SAN FRANCISCO 11.6s 117.2s 25.6s | |
| 41 EVERGLADES TO SAN FRANCISCO 13.9s 169.8s 31.6s | |
| 42 SURIGAO TO BALABAC 10.5s 156.4s 20.5s | |
| 43 PORT EVERGLADES TO PASCAGOULA 11.8s 167.4s 19.4s | |
| 44 PASCAGOULA TO TAMPA 13.4s 261.9s 22.2s | |
| 45 DIEGO GARCIA TO SINGAPORE 17.7s 254.4s 18.4s | |
| 46 SINGAPORE TO YOKOSUKA 11.8s 232.3s 21.7s | |
| 47 FUKUOKA TO SINGAPORE 12.5s 234.7s 21.1s | |
| 48 SINGAPORE TO BUSAN 17.0s 177.3s 19.8s | |
| 49 GUAM TO ONSAN 13.9s 192.2s 23.4s | |
| 50 DIEGO GARCIA TO DUQM 13.0s 275.6s 19.6s | |
| 51 PORT EVERGLADES TO PASCAGOULA 11.7s 137.3s 22.6s | |
| 52 PASCAGOULA TO TAMPA 10.7s 197.5s 21.3s | |
| 53 DIEGO GARCIA TO SINGAPORE 10.7s — 23.1s | |
| Penalty for vague/partial/error: 206.51h (max ground truth in run) | |
| MIRA specific: 50/50 | |
| avg Δ: 0.1576h min: 0.0001h max: 0.6840h | |
| penalized avg Δ: 0.1576h avg t: 12.7s min t: 10.5s max t: 17.7s total $: 0.011752 | |
| Gemini specific: 13/50 | |
| avg Δ: 0.1216h min: 0.0001h max: 0.8146h | |
| penalized avg Δ: 152.8506h avg t: 193.4s min t: 78.1s max t: 295.9s total $: 0.081372 | |
| Claude specific: 47/50 | |
| avg Δ: 77.2689h min: 0.0660h max: 637.3623h | |
| penalized avg Δ: 86.5613h avg t: 22.0s min t: 18.4s max t: 31.6s total $: 1.706475 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment