Skip to content

Instantly share code, notes, and snippets.

@moyix
Created February 10, 2022 16:16
Show Gist options
  • Save moyix/267d122f9d92268e3432b05f08976816 to your computer and use it in GitHub Desktop.
Save moyix/267d122f9d92268e3432b05f08976816 to your computer and use it in GitHub Desktop.
Results of asking GPT-NeoX-20B some math questions
Question Real Guess Correct?
What is 28142 + 16738? 44880 45180 No
What is 9690 - 18711? -9021 -9321 No
What is 10365 - 11572? -1207 -1207 Yes
What is 12420 + 20678? 33098 32998 No
What is 17051 + 29637? 46688 46488 No
What is 10052 * 6572? 66061744 65655584 No
What is 9276 - 28689? -19413 -18213 No
What is 7924 - 12216? -4292 -4292 Yes
What is 1867 * 23864? 44554088 4427444 No
What is 20314 + 10226? 30540 30340 No
What is 31168 * 25803? 804227904 791259504 No
What is 16705 + 14205? 30910 31310 No
What is 12286 + 28973? 41259 41259 Yes
What is 2653 * 30641? 81290573 82356113 No
What is 9219 * 31537? 290739603 288547383 No
What is 29463 * 30629? 902422227 927052527 No
What is 6346 + 31319? 37665 38365 No
What is 22299 - 17109? 5190 5190 Yes
What is 22884 + 18086? 40970 40370 No
What is 7509 - 15554? -8045 -8645 No
What is 27101 * 17829? 483183729 496424329 No
What is 4285 - 4650? -365 -175 No
What is 32474 * 12708? 412679592 410038392 No
What is 11398 - 11199? 199 -1 No
What is 5215 + 10680? 15895 15995 No
What is 28241 + 16868? 45109 45009 No
What is 2902 - 16485? -13583 -13483 No
What is 32017 - 8104? 23913 23013 No
What is 20276 + 7132? 27408 27408 Yes
What is 10903 * 12327? 134401281 139977681 No
What is 17079 + 1600? 18679 18779 No
What is 29263 - 9278? 19985 19185 No
What is 28531 * 8065? 230102515 229518115 No
What is 30687 - 24168? 6519 7019 No
What is 6656 + 9841? 16497 16397 No
What is 9259 - 3610? 5649 5649 Yes
What is 21623 - 25363? -3740 -4140 No
What is 26357 + 27530? 53887 53177 No
What is 8821 + 25118? 33939 34139 No
What is 18384 * 23331? 428917104 427735104 No
What is 23205 * 13110? 304217550 304736010 No
What is 19118 + 5698? 24816 24106 No
What is 12837 * 9602? 123260874 121425174 No
What is 26454 * 16610? 439400940 443824140 No
What is 11032 - 24153? -13121 -12121 No
What is 28025 + 18449? 46474 47474 No
What is 11928 * 11746? 140106288 142427328 No
What is 29966 * 29707? 890199962 893229362 No
What is 4955 + 18555? 23510 23010 No
What is 3446 - 16922? -13476 -13376 No
What is 10223 - 20473? -10250 -10250 Yes
What is 11642 - 16298? -4656 -4756 No
What is 27066 * 24668? 667664088 678595608 No
What is 26899 + 26615? 53514 53414 No
What is 19097 - 3930? 15167 15277 No
What is 14243 * 27744? 395157792 397548192 No
What is 27936 - 22641? 5295 4185 No
What is 3050 + 16085? 19135 19145 No
What is 5615 - 3545? 2070 2170 No
What is 4938 - 26391? -21453 -20553 No
What is 32646 + 21019? 53665 54265 No
What is 31486 + 25798? 57284 58384 No
What is 19661 + 13116? 32777 32777 Yes
What is 3286 + 15808? 19094 20194 No
What is 24894 * 11678? 290712132 297595452 No
What is 7135 - 28627? -21492 -20492 No
What is 26211 * 3242? 84976062 83613042 No
What is 12434 - 25605? -13171 -12271 No
What is 13449 - 9720? 3729 3729 Yes
What is 575 + 4911? 5486 5596 No
What is 24401 + 30599? 55000 55600 No
What is 31034 - 25011? 6023 7013 No
What is 23902 + 31084? 54986 55086 No
What is 27673 * 29567? 818207591 829175591 No
What is 29644 + 24893? 54537 54337 No
What is 27215 * 8984? 244499560 243501160 No
What is 14103 * 32127? 453087081 462577641 No
What is 17467 * 5327? 93046709 94847441 No
What is 27783 * 17659? 490619997 508544307 No
What is 19040 + 26731? 45771 46371 No
What is 24932 - 1228? 23704 23704 Yes
What is 8374 * 7869? 65895006 65276046 No
What is 24581 * 29524? 725729444 723553464 No
What is 7886 * 892? 7034312 7077992 No
What is 18105 + 10387? 28492 29392 No
What is 25989 * 5622? 146110158 1404171378 No
What is 16024 - 721? 15303 15203 No
What is 6204 * 13259? 82258836 83709156 No
What is 11117 - 17062? -5945 -6645 No
What is 10970 + 23777? 34747 34147 No
What is 13447 + 6781? 20228 20128 No
What is 10175 + 32728? 42903 42803 No
What is 31535 * 22173? 699225555 696444255 No
What is 3670 - 26146? -22476 -22776 No
What is 25915 * 16012? 414950980 423745180 No
What is 3727 - 3143? 584 784 No
What is 1563 + 28887? 30450 31350 No
What is 5600 - 15584? -9984 -10084 No
What is 3442 * 30587? 105280454 111627874 No
What is 26263 - 24768? 1495 1795 No
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment