Created
July 21, 2020 11:49
-
-
Save ErnWong/47879361172c008ea21210d4bca5987b to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /home/ernwong/anaconda3/envs/NL2code/bin/python /home/ernwong/Downloads/Software/PyCharm/pycharm-professional-2020.1.1/pycharm-2020.1.1/plugins/python/helpers/pydev/pydevconsole.py --mode=client --port=35069 | |
| import sys; print('Python %s on %s' % (sys.version, sys.platform)) | |
| sys.path.extend(['/home/ernwong/uni/se700/part4project/NL2code']) | |
| PyDev console: starting. | |
| Python 2.7.17 |Anaconda, Inc.| (default, Oct 21 2019, 19:04:46) | |
| [GCC 7.3.0] on linux2 | |
| >>> import os | |
| ... os.environ['THEANO_FLAGS'] = 'mode=FAST_RUN,device=cpu,floatX=float32' | |
| ... runfile('/home/ernwong/uni/se700/part4project/NL2code/code_gen.py', args=['-data_type', 'cpp', '-data', 'data/cpp-line-by-line.100.bin', '-output_dir', 'runs', '-batch_size', '10', '-max_epoch', '200', '-valid_per_batch', '280', '-save_per_batch', '280', '-decode_max_time_step', '1000', '-optimizer', 'adadelta', '-rule_embed_dim', '128', '-node_embed_dim', '64', '-valid_metric', 'bleu', 'train'], wdir='/home/ernwong/uni/se700/part4project/NL2code') | |
| ... | |
| 07/21/2020 16:20:55 [INFO] generic_utils: init logging file [runs/parser.log] | |
| 07/21/2020 16:20:55 [INFO] code_gen: command line: /home/ernwong/uni/se700/part4project/NL2code/code_gen.py -data_type cpp -data data/cpp-line-by-line.100.bin -output_dir runs -batch_size 10 -max_epoch 200 -valid_per_batch 280 -save_per_batch 280 -decode_max_time_step 1000 -optimizer adadelta -rule_embed_dim 128 -node_embed_dim 64 -valid_metric bleu train | |
| 07/21/2020 16:20:55 [INFO] code_gen: loading dataset [data/cpp-line-by-line.100.bin] | |
| 07/21/2020 16:21:00 [INFO] code_gen: current config: Namespace(attention_hidden_dim=50, batch_size=10, beam_size=15, clip_grad=0.0, data='data/cpp-line-by-line.100.bin', data_type='cpp', decode_max_time_step=1000, decoder_hidden_dim=256, dropout=0.2, enable_copy=True, encoder='bilstm', encoder_hidden_dim=256, frontier_node_type_feed=True, head_nt_constraint=True, ifttt_test_split='data/ifff.test_data.gold.id', max_epoch=200, max_query_length=70, model=None, node_embed_dim=64, node_num=175, operation='train', optimizer='adadelta', output_dir='runs', parent_action_feed=True, parent_hidden_state_feed=True, ptrnet_hidden_dim=50, random_seed=181783, rule_embed_dim=128, rule_num=251, save_per_batch=280, source_vocab_size=305, target_vocab_size=188, train_patience=10, tree_attention=False, valid_metric='bleu', valid_per_batch=280, word_embed_dim=128) | |
| 07/21/2020 16:21:00 [INFO] code_gen: avg_action_num: 66 | |
| 07/21/2020 16:21:00 [INFO] code_gen: grammar rule num.: 251 | |
| 07/21/2020 16:21:00 [INFO] code_gen: grammar node type num.: 175 | |
| 07/21/2020 16:21:00 [INFO] code_gen: source vocab size: 305 | |
| 07/21/2020 16:21:00 [INFO] code_gen: target vocab size: 188 | |
| 07/21/2020 16:21:00 [INFO] recurrent: applying dropout with p = 0.200000 | |
| 07/21/2020 16:21:02 [INFO] recurrent: applying dropout with p = 0.200000 | |
| 07/21/2020 16:21:02 [INFO] components: applying dropout with p = 0.200000 | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p4 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p10 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p16 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p22 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p29 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p30 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p31 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p32 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:589: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: decoder_lstm_p33 | |
| handle_disconnected(elem) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/gradient.py:615: UserWarning: grad method was asked to compute the gradient with respect to a variable that is not part of the computational graph of the cost, or is used only by a non-differentiable operator: <DisconnectedType> | |
| handle_disconnected(rval[i]) | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| 07/21/2020 16:22:18 [INFO] model: building decoder ... | |
| 07/21/2020 16:22:18 [INFO] recurrent: applying dropout with p = 0.200000 | |
| 07/21/2020 16:22:18 [INFO] recurrent: applying dropout with p = 0.200000 | |
| 07/21/2020 16:22:18 [INFO] components: applying dropout with p = 0.200000 | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| /home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/scan_module/scan_perform_ext.py:76: UserWarning: The file scan_perform.c is not available. This donot happen normally. You are probably in a strangesetup. This mean Theano can not use the cython code for scan. If youwant to remove this warning, use the Theano flag'cxx=' (set to an empty string) to disable all ccode generation. | |
| "The file scan_perform.c is not available. This do" | |
| 07/21/2020 16:22:26 [INFO] learner: initial learner with training set [cpp.train_data] (1458 examples) | |
| 07/21/2020 16:22:26 [INFO] learner: validation set [cpp.dev_data] (179 examples) | |
| 07/21/2020 16:22:26 [INFO] learner: begin training | |
| Epoch 0/home/ernwong/anaconda3/envs/NL2code/lib/python2.7/site-packages/theano/tensor/subtensor.py:2197: FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use `arr[tuple(seq)]` instead of `arr[seq]`. In the future this will be interpreted as an array index, `arr[np.array(seq)]`, which will result either in an error or a different result. | |
| rval = inputs[0].__getitem__(inputs[1:]) | |
| , eta 252s | |
| 07/21/2020 16:25:29 [INFO] learner: [Epoch 0] cumulative loss = 81.782858, (took 183s) | |
| Epoch 1, eta 187s | |
| 07/21/2020 16:28:14 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: y ; | |
| -- Bleu score: 0.223130160148 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> y ; | |
| -- Bleu score: 0.460863639691 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout >> x ; | |
| -- Bleu score: 0.0953406181665 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn = maxn ; | |
| -- Bleu score: 0.154252172849 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 = maxn ; | |
| -- Bleu score: 0.183437781457 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis = maxn ; | |
| -- Bleu score: 0.334245430294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: ssum ; | |
| -- Bleu score: 0.223130160148 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0139168760332 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: int i = 1 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: vis ; | |
| -- Bleu score: 0.000154602527676 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis = 1 ; | |
| -- Bleu score: 0.334013592649 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.00054220826074 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0253928714699 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: lsum = 1 ; | |
| -- Bleu score: 0.00474672987489 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: cin >> N ; | |
| -- Bleu score: 0.315890552541 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 0.0623711112111 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = num ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = ssum ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> y ; | |
| -- Bleu score: 0.218742424452 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: v = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: v = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum = ssum ; | |
| -- Bleu score: 0.397635364384 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num ; | |
| -- Bleu score: 0.00208437381966 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis = vis ; | |
| -- Bleu score: 0.201836090242 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0690249810889 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 0.00343655145257 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ; | |
| -- Bleu score: 0.00934151536607 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int j = n ; | |
| -- Bleu score: 0.252676245128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.125599994069 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 0.0956964965104 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: int j = 0 ; | |
| -- Bleu score: 0.125599994069 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: a ; | |
| -- Bleu score: 2.09231768721e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans ; | |
| -- Bleu score: 0.510029457494 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: stop ; | |
| -- Bleu score: 0.759835685652 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << ans ; | |
| -- Bleu score: 0.643458884161 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd = b ; | |
| -- Bleu score: 0.142037293946 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: int a = 0 ; | |
| -- Bleu score: 0.0977880969347 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: gcd ; | |
| -- Bleu score: 0.0154015550846 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.13218059592 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: int n = 0 ; | |
| -- Bleu score: 0.202528849545 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum ; | |
| -- Bleu score: 0.113802954531 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n ; | |
| -- Bleu score: 0.309348503327 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: int i = 2 ; | |
| -- Bleu score: 0.0407622039784 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int gcd = 2 ; | |
| -- Bleu score: 0.0886033031418 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 0.000282089321255 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.0551201895886 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: int p = 0 ; | |
| -- Bleu score: 0.145882698143 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: int p = 1 ; | |
| -- Bleu score: 0.145882698143 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: int res = 1e9 ; | |
| -- Bleu score: 0.00158004911748 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res ; | |
| -- Bleu score: 0.0154015550846 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 0.42888194248 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr ; | |
| -- Bleu score: 0.334013592649 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == i ) { | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr == i ) { | |
| -- Bleu score: 0.136264628199 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = 1 ; | |
| -- Bleu score: 0.0162246001227 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans ; | |
| -- Bleu score: 0.309348503327 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr ; | |
| -- Bleu score: 0.0253928714699 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr == i ) { | |
| -- Bleu score: 0.0337313042919 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout >> ans ; | |
| -- Bleu score: 0.259162669876 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 5.6875091485e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: c ; | |
| -- Bleu score: 0.000766798275969 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: int result = 0 ; | |
| -- Bleu score: 0.622100843129 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0139168760332 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: int i = 1 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == i ) { | |
| -- Bleu score: 0.40049701494 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b == 1 ) { | |
| -- Bleu score: 0.146281875639 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0154015550846 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.0378299912299 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: c = c ; | |
| -- Bleu score: 0.187829646322 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a == 1 ) { | |
| -- Bleu score: 0.146281875639 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0154015550846 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 0.622100843129 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: int i = 1 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 0.0274175052929 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum = i ; | |
| -- Bleu score: 0.201836090242 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0154015550846 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result ; | |
| -- Bleu score: 0.00934151536607 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout >> a ; | |
| -- Bleu score: 0.241178039885 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v ; | |
| -- Bleu score: 0.0253928714699 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.110803158362 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.510029457494 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = 1 ; | |
| -- Bleu score: 0.0785112417385 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = 2 ; | |
| -- Bleu score: 0.0785112417385 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = v ; | |
| -- Bleu score: 0.0742513480866 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v = _STR : 0_ ; | |
| -- Bleu score: 0.365452075609 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x ; | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: n ; | |
| -- Bleu score: 0.187629351804 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: v ; | |
| -- Bleu score: 0.0139168760332 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: i = z ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout >> v ; | |
| -- Bleu score: 0.0742513480866 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph = 105 ; | |
| -- Bleu score: 0.183437781457 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis = 105 ; | |
| -- Bleu score: 0.334245430294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m = 105 ; | |
| -- Bleu score: 0.183437781457 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.0623711112111 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k = k ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis = u ; | |
| -- Bleu score: 0.213415681748 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == 1 ) { | |
| -- Bleu score: 0.127721124253 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.0018586714343 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t = u ; | |
| -- Bleu score: 0.0953406181665 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: int k = n ; | |
| -- Bleu score: 0.119438651311 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.187629351804 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 0.315890552541 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = t ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = k ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: sum = 0 ; | |
| -- Bleu score: 0.778800783071 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ; | |
| -- Bleu score: 0.0056659154777 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.135335283237 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: cout ; | |
| -- Bleu score: 0.0623711112111 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> y ; | |
| -- Bleu score: 0.218742424452 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph = 1 ; | |
| -- Bleu score: 0.021352774592 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum = sum ; | |
| -- Bleu score: 0.397635364384 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ; | |
| -- Bleu score: 0.187629351804 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.00780341579467 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << t ; | |
| -- Bleu score: 0.643458884161 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: j ; | |
| -- Bleu score: 0.0418657673165 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s = 10 ; | |
| -- Bleu score: 0.265815606937 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: cin >> s ; | |
| -- Bleu score: 0.00785524678437 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: int i = 0 ; | |
| -- Bleu score: 0.125599994069 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s == 0 ) { | |
| -- Bleu score: 0.187484452989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: int j = 0 ; | |
| -- Bleu score: 0.125599994069 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s == j ) { | |
| -- Bleu score: 0.181329002825 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = f ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: stop ; | |
| -- Bleu score: 0.759835685652 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s == 0 ) { | |
| -- Bleu score: 0.187484452989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: int j = 0 ; | |
| -- Bleu score: 0.125599994069 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: s ; | |
| -- Bleu score: 0.00310527477805 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = flag ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: stop ; | |
| -- Bleu score: 0.759835685652 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) { | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout >> a ; | |
| -- Bleu score: 0.146281875639 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: int else = else ; | |
| -- Bleu score: 0.759835685652 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << cnt ; | |
| -- Bleu score: 0.643458884161 | |
| 07/21/2020 16:31:59 [INFO] evaluation: sentence level bleu: 0.270869 | |
| 07/21/2020 16:31:59 [INFO] evaluation: accuracy: 0.055866 | |
| 07/21/2020 16:31:59 [INFO] evaluation: oracle bleu: 0.408163 | |
| 07/21/2020 16:31:59 [INFO] evaluation: oracle accuracy: 0.134078 | |
| 07/21/2020 16:31:59 [INFO] learner: avg. example bleu: 0.270869 | |
| 07/21/2020 16:31:59 [INFO] learner: accuracy: 0.055866 | |
| 07/21/2020 16:31:59 [INFO] learner: save current best model | |
| 07/21/2020 16:31:59 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 16:31:59 [INFO] model: save model to [runs/model.iter280] | |
| 07/21/2020 16:32:16 [INFO] learner: [Epoch 1] cumulative loss = 17.532334, (took 406s) | |
| Epoch 2, eta 175s | |
| 07/21/2020 16:35:26 [INFO] learner: [Epoch 2] cumulative loss = 11.778854, (took 190s) | |
| Epoch 3, eta 242s | |
| 07/21/2020 16:37:55 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 13/15 | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 3/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 0.42888194248 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x << endl ; | |
| -- Bleu score: 0.305279645459 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: void vis ( int maxn ) { | |
| -- Bleu score: 0.220895911342 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.169542258226 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < num ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.26905482715e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.446831071844 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 3.44964867596e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , vis ) ; | |
| -- Bleu score: 0.314999930009 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , G ) ; | |
| -- Bleu score: 0.314999930009 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , G1 ) ; | |
| -- Bleu score: 0.314999930009 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0623711112111 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 0.260130047511 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G = x ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 = x ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ; | |
| -- Bleu score: 0.0441030356875 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min << endl ; | |
| -- Bleu score: 0.185161464757 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.00844101200154 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i [ n ] = n ; | |
| -- Bleu score: 0.313240603771 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] ; | |
| -- Bleu score: 0.489541659557 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans ++ ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: void gcd ( int a ) { | |
| -- Bleu score: 0.387347981103 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return a ; | |
| -- Bleu score: 0.433264810887 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0139168760332 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: void add ( int n ) { | |
| -- Bleu score: 0.498484999405 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n == 0 ) { | |
| -- Bleu score: 0.5 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += x ; | |
| -- Bleu score: 0.360645287999 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n = x ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = 2 ; | |
| -- Bleu score: 0.138671663491 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum << endl ; | |
| -- Bleu score: 0.0804708408679 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long fp ( int n ) { | |
| -- Bleu score: 0.181329002825 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: else if ( p == 0 ) | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 9.37711731043e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.40979256817e-07 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 5.6875091485e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ; | |
| -- Bleu score: 0.0736827616912 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.000420253241614 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 0.42888194248 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == true ) { | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] [ i ] == - 1 ) { | |
| -- Bleu score: 0.490335263414 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = i ; | |
| -- Bleu score: 0.0162246001227 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr += m ; | |
| -- Bleu score: 0.153934720015 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] [ i ] == - 1 ) { | |
| -- Bleu score: 0.26488231195 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 0.643458884161 | |
| line 1:11 token recognition error at: ''\n;' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 5.6875091485e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << a << endl ; | |
| -- Bleu score: 0.186931591432 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.00069288045853 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result [ 0 ] = 0 ; | |
| -- Bleu score: 0.379917842826 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: int dfs [ start ] = start ; | |
| -- Bleu score: 0.148523758439 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == i ) { | |
| -- Bleu score: 0.40049701494 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] [ i ] == - 1 ) { | |
| -- Bleu score: 0.526640387848 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ++ ; | |
| -- Bleu score: 0.0576598770701 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.0378299912299 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += i ; | |
| -- Bleu score: 0.253795447187 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] [ i ] == - 1 ) { | |
| -- Bleu score: 0.526640387848 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ++ ; | |
| -- Bleu score: 0.0576598770701 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum [ 0 ] = 0 ; | |
| -- Bleu score: 0.379917842826 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: a ++ ; | |
| -- Bleu score: 0.00559139174631 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += i ; | |
| -- Bleu score: 0.253795447187 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 0.22230037855 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ; | |
| -- Bleu score: 0.122876733807 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.570674577706 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 ] = 1 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 2 ] = 2 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 3 ] = 3 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 4 ] = 4 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 5 ] = 5 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 6 ] = 6 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 7 ] = 7 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 ] = 8 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 9 ] = 9 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 10 ] = 10 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 11 ] = 11 ; | |
| -- Bleu score: 0.24129671581 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v == i ) { | |
| -- Bleu score: 0.287800448594 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: i = z ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z ] << endl ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: int dfs = u ; | |
| -- Bleu score: 0.217631412048 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k += k ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) k ++ ; | |
| -- Bleu score: 0.243033248682 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += i ; | |
| -- Bleu score: 0.119884480489 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: else if ( k == n ) | |
| -- Bleu score: 0.547792768234 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ++ ; | |
| -- Bleu score: 0.305279645459 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 ) ; | |
| -- Bleu score: 0.374600157992 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 ) ; | |
| -- Bleu score: 0.374600157992 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 ) ; | |
| -- Bleu score: 0.374600157992 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: x ( z , z ) ; | |
| -- Bleu score: 0.277761903401 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 0.260130047511 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.418147717343 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m = y ; | |
| -- Bleu score: 0.100810429888 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( dfs , 1 ) ; | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: return sum ; | |
| -- Bleu score: 0.00780341579467 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0378299912299 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s ( s , s ) ; | |
| -- Bleu score: 0.027402118999 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 0 ; i ++ ) { | |
| -- Bleu score: 0.641386525898 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: long long f [ 0 ] = 0 ; | |
| -- Bleu score: 0.290715368484 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 0 ) { | |
| -- Bleu score: 0.80910671157 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 0 ; j ++ ) { | |
| -- Bleu score: 0.641386525898 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.0191671002995 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) { | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.584706532697 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 0 ; j ++ ) { | |
| -- Bleu score: 0.641386525898 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.0191671002995 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( cnt == 0 ) { | |
| -- Bleu score: 0.321096482933 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 16:48:39 [INFO] evaluation: sentence level bleu: 0.459157 | |
| 07/21/2020 16:48:39 [INFO] evaluation: accuracy: 0.212291 | |
| 07/21/2020 16:48:39 [INFO] evaluation: oracle bleu: 0.700983 | |
| 07/21/2020 16:48:39 [INFO] evaluation: oracle accuracy: 0.385475 | |
| 07/21/2020 16:48:39 [INFO] learner: avg. example bleu: 0.459157 | |
| 07/21/2020 16:48:39 [INFO] learner: accuracy: 0.212291 | |
| 07/21/2020 16:48:39 [INFO] learner: save current best model | |
| 07/21/2020 16:48:39 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 16:48:39 [INFO] model: save model to [runs/model.iter560] | |
| 07/21/2020 16:49:14 [INFO] learner: [Epoch 3] cumulative loss = 9.010813, (took 828s) | |
| Epoch 4, eta 153s | |
| 07/21/2020 16:52:20 [INFO] learner: [Epoch 4] cumulative loss = 7.344814, (took 186s) | |
| Epoch 5, eta 218s | |
| 07/21/2020 16:54:40 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 5/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y << endl ; | |
| -- Bleu score: 0.58228940089 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G ( int G ) { | |
| -- Bleu score: 0.183707274711 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 = G1 ; | |
| -- Bleu score: 0.173484742587 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: int dfs ( int cur ) { | |
| -- Bleu score: 0.40049701494 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] == G1 [ i ] && G1 [ i ] [ i ] == G1 [ i ] ) { | |
| -- Bleu score: 0.384603760157 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] [ i ] = 1 ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.26905482715e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 0.271518295501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis ) ; | |
| -- Bleu score: 0.174370385423 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , G , G ) ; | |
| -- Bleu score: 0.360797725575 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , G1 , G1 ) ; | |
| -- Bleu score: 0.360797725575 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = v , v = v ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 0.602528610479 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ y ] [ y ] = x ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ y ] = G1 [ y ] [ y ] ; | |
| -- Bleu score: 0.326359832661 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ x ] = G1 [ x ] [ x ] ; | |
| -- Bleu score: 0.326359832661 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num % num ; | |
| -- Bleu score: 0.0870704660954 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] [ 1 ] = 1 ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 0.473987850117 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min << endl ; | |
| -- Bleu score: 0.185161464757 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a ( int b ) { | |
| -- Bleu score: 0.116087302015 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n [ n ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = j , j = j ; | |
| -- Bleu score: 0.273012086271 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> a [ i ] ; | |
| -- Bleu score: 0.761160600335 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == b [ i ] && b [ i ] == b [ i ] ) { | |
| -- Bleu score: 0.681399751605 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans ++ ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a ) { | |
| -- Bleu score: 0.498484999405 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == i ) break ; | |
| -- Bleu score: 0.235942645802 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ; | |
| -- Bleu score: 0.0736827616912 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int x ) { | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n [ n ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: int i { | |
| -- Bleu score: 0.001752742473 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = 2 ; | |
| -- Bleu score: 0.138671663491 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum * div << endl ; | |
| -- Bleu score: 0.171028803323 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: int fp ( int n ) { | |
| -- Bleu score: 0.136533238874 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return p ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: return p ; | |
| -- Bleu score: 0.0864715459852 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: int res ( int res ) { | |
| -- Bleu score: 0.0364643339879 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = res ; | |
| -- Bleu score: 0.000381566022301 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % res == res ) break ; | |
| -- Bleu score: 0.135272093806 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ; | |
| -- Bleu score: 0.0736827616912 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: int n [ 0 ] = 0 ; | |
| -- Bleu score: 0.111451414242 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == true ) { | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] == arr [ i ] && arr [ i ] == arr [ i ] ) { | |
| -- Bleu score: 0.345644843773 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr % i ; | |
| -- Bleu score: 0.0467882203103 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr += arr [ i ] ; | |
| -- Bleu score: 0.422586736838 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] == arr [ i ] && arr [ i ] == arr [ i ] ) { | |
| -- Bleu score: 0.398852825444 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 0.643458884161 | |
| line 1:11 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i { | |
| -- Bleu score: 0.001752742473 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a [ a ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b [ b ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << a * b << endl ; | |
| -- Bleu score: 0.291800523016 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a ( int c ) { | |
| -- Bleu score: 0.0726217243535 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: int dfs ( int start ) { | |
| -- Bleu score: 0.40049701494 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) break ; | |
| -- Bleu score: 0.75062385375 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start [ i ] == a [ i ] && a [ i ] == a [ i ] ) { | |
| -- Bleu score: 0.341413387303 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ i ] && b [ i ] == b [ i ] ) { | |
| -- Bleu score: 0.318974318629 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b , i ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: else | |
| -- Bleu score: 1.67017007902e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ i ] && a [ i ] == a [ i ] ) { | |
| -- Bleu score: 0.402899802911 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 0.22230037855 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n [ n ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.6592406302 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 0.22230037855 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min % sum ; | |
| -- Bleu score: 0.197739638301 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: int v ( int a ) { | |
| -- Bleu score: 0.197406313661 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.61153805769 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 2 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.578356986647 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.578356986647 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 ] [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.61153805769 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.578356986647 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n [ n ] ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z [ i ] = i ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ endl ] << v [ endl ] ; | |
| -- Bleu score: 0.354169876614 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] = 105 ; | |
| -- Bleu score: 0.557029316074 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] = 105 ; | |
| -- Bleu score: 0.557029316074 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: int dfs ( int u ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] [ u ] = 1 ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k [ u ] == m [ u ] && m [ u ] [ u ] == m [ u ] ) { | |
| -- Bleu score: 0.210818510678 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ u ] == vis [ u ] && vis [ u ] [ u ] == 1 ) { | |
| -- Bleu score: 0.386097395096 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ u ] [ u ] ; | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: int k ( int n ) { | |
| -- Bleu score: 0.249242499703 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ++ ; | |
| -- Bleu score: 0.305279645459 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n [ cin ] ) { | |
| -- Bleu score: 0.519307177868 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph ) ; | |
| -- Bleu score: 0.174370385423 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis ) ; | |
| -- Bleu score: 0.174370385423 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: cout << m << 0 ; | |
| -- Bleu score: 0.0966386143968 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> z ; | |
| -- Bleu score: 0.569836377544 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ x ] = x ; | |
| -- Bleu score: 0.346475577181 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ x ] [ x ] = m [ x ] [ x ] ; | |
| -- Bleu score: 0.326359832661 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum < t && sum % t ) { | |
| -- Bleu score: 0.222693444848 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: int i { | |
| -- Bleu score: 0.101480021832 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getchar ( i ) ; | |
| -- Bleu score: 0.0136245804085 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] == s [ i ] && s [ i ] == 0 ) { | |
| -- Bleu score: 0.346894156899 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] == s [ j ] ) { | |
| -- Bleu score: 0.573122448409 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) return f ; | |
| -- Bleu score: 0.660632863603 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ i ] == s [ i ] ) { | |
| -- Bleu score: 0.461542501563 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] == s [ j ] ) { | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) { | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 0 ) { | |
| -- Bleu score: 0.541082269054 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 17:03:53 [INFO] evaluation: sentence level bleu: 0.557861 | |
| 07/21/2020 17:03:53 [INFO] evaluation: accuracy: 0.240223 | |
| 07/21/2020 17:03:53 [INFO] evaluation: oracle bleu: 0.732262 | |
| 07/21/2020 17:03:53 [INFO] evaluation: oracle accuracy: 0.435754 | |
| 07/21/2020 17:03:53 [INFO] learner: avg. example bleu: 0.557861 | |
| 07/21/2020 17:03:53 [INFO] learner: accuracy: 0.240223 | |
| 07/21/2020 17:03:53 [INFO] learner: save current best model | |
| 07/21/2020 17:03:53 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 17:03:53 [INFO] model: save model to [runs/model.iter840] | |
| 07/21/2020 17:04:39 [INFO] learner: [Epoch 5] cumulative loss = 6.124581, (took 738s) | |
| Epoch 6, eta 316s | |
| 07/21/2020 17:07:45 [INFO] learner: [Epoch 6] cumulative loss = 5.224981, (took 186s) | |
| Epoch 7, eta 303s | |
| 07/21/2020 17:09:55 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 4/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y >> y ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << ( x - 2 ) * x << y ; | |
| -- Bleu score: 0.179965312718 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn = G ; | |
| -- Bleu score: 0.154252172849 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn = G1 ; | |
| -- Bleu score: 0.154252172849 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis ( int maxn ) = maxn ; | |
| -- Bleu score: 0.211053406319 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur ) { | |
| -- Bleu score: 0.498484999405 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < num ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] ) { | |
| -- Bleu score: 0.293646014776 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: G [ cur ] [ cur ] = 0 ; | |
| -- Bleu score: 0.14880028215 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , 1 ) ; | |
| -- Bleu score: 0.519602638805 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ 1 ] [ 1 ] ) { | |
| -- Bleu score: 0.30037230591 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) , 0 ) ; | |
| -- Bleu score: 0.748740215683 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x ( int y , int v ) { | |
| -- Bleu score: 0.218341772142 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v >> v ; | |
| -- Bleu score: 0.751049981571 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ v ] [ v ] = v ; | |
| -- Bleu score: 0.449733208401 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ v ] [ v ] = v ; | |
| -- Bleu score: 0.449733208401 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , sizeof ( invoke ) ) ; | |
| -- Bleu score: 0.403527863746 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min / lsum << endl << endl << endl ; | |
| -- Bleu score: 0.266057057613 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a = 105 ; | |
| -- Bleu score: 0.0977880969347 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = j ; | |
| -- Bleu score: 0.191992427965 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( ! a [ i ] ) { | |
| -- Bleu score: 0.118694557559 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans . ans ( ans ) ; | |
| -- Bleu score: 0.307394076476 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: return b ; | |
| -- Bleu score: 0.0694834512228 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return b ; | |
| -- Bleu score: 0.0619595701722 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n ) { | |
| -- Bleu score: 0.40049701494 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n = x ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i <= n ; i ++ ) { | |
| -- Bleu score: 0.499242290442 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = 2 ; | |
| -- Bleu score: 0.138671663491 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << ( n - 2 ) * div << '/' ; | |
| -- Bleu score: 0.378122209941 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long p ) { | |
| -- Bleu score: 0.616940857631 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: return p ; | |
| -- Bleu score: 0.0864715459852 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = p / 2 ; | |
| -- Bleu score: 0.137177779025 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.40979256817e-07 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % n ) break ; | |
| -- Bleu score: 0.104515049511 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ; | |
| -- Bleu score: 0.0736827616912 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 ; | |
| -- Bleu score: 0.0950650657914 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m >> m ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == true ) { | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a [ i ] = i + 1 ; | |
| -- Bleu score: 0.118357647361 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ m ] += m ; | |
| -- Bleu score: 0.270008881449 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.375146156164 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a - 2 ) * a << '/' ; | |
| -- Bleu score: 0.343893121766 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start ) { | |
| -- Bleu score: 0.498484999405 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self ) break ; | |
| -- Bleu score: 0.326017547728 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start [ i ] <= a [ i ] ) { | |
| -- Bleu score: 0.531696715333 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: return b [ i ] ; | |
| -- Bleu score: 0.176278030534 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b , i ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start [ i ] == b [ i ] ) { | |
| -- Bleu score: 0.673904706256 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] [ 1 ] ) return i ; | |
| -- Bleu score: 0.661039710855 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a , i ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 0.6592406302 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( dfs [ 1 ] , 1 ) ; | |
| -- Bleu score: 0.741944662737 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min - min ; | |
| -- Bleu score: 0.197739638301 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 2 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 3 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 4 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 5 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 7 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 10 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] ) { | |
| -- Bleu score: 0.625710681816 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v << endl ; | |
| -- Bleu score: 0.258413640862 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.433618909035 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: k [ u ] . push_back ( n ) ; | |
| -- Bleu score: 0.138744649197 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] ) { | |
| -- Bleu score: 0.382654089668 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: return n ; | |
| -- Bleu score: 0.0619595701722 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs [ i ] . push_back ( i ) ; | |
| -- Bleu score: 0.367205626989 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = z , z ( z ) ; | |
| -- Bleu score: 0.218341772142 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z >> z ; | |
| -- Bleu score: 0.751049981571 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = 1 ; | |
| -- Bleu score: 0.434576689987 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ z ] = z ; | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum <= t ) { | |
| -- Bleu score: 0.138226523315 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = k , k ( k ) , k ( k ) ; | |
| -- Bleu score: 0.182956542245 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] [ 10 ] = 10 ; | |
| -- Bleu score: 0.331807740284 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getchar ( cin , s ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 0 ) { | |
| -- Bleu score: 0.493938273712 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] ) { | |
| -- Bleu score: 0.723062061481 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) { return f ; } | |
| -- Bleu score: 0.533167536341 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] ) { | |
| -- Bleu score: 0.470033236367 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] ) { | |
| -- Bleu score: 0.723062061481 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) { | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << a << _STR : 0_ ; | |
| -- Bleu score: 0.530771217107 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: else | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 17:18:34 [INFO] evaluation: sentence level bleu: 0.636910 | |
| 07/21/2020 17:18:34 [INFO] evaluation: accuracy: 0.351955 | |
| 07/21/2020 17:18:34 [INFO] evaluation: oracle bleu: 0.800173 | |
| 07/21/2020 17:18:34 [INFO] evaluation: oracle accuracy: 0.581006 | |
| 07/21/2020 17:18:34 [INFO] learner: avg. example bleu: 0.636910 | |
| 07/21/2020 17:18:34 [INFO] learner: accuracy: 0.351955 | |
| 07/21/2020 17:18:34 [INFO] learner: save current best model | |
| 07/21/2020 17:18:34 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 17:18:34 [INFO] model: save model to [runs/model.iter1120] | |
| 07/21/2020 17:19:35 [INFO] learner: [Epoch 7] cumulative loss = 4.559444, (took 710s) | |
| Epoch 8, eta 143s | |
| 07/21/2020 17:22:38 [INFO] learner: [Epoch 8] cumulative loss = 3.929973, (took 182s) | |
| Epoch 9, eta 236s | |
| 07/21/2020 17:24:23 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 2/15 | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 ; | |
| -- Bleu score: 0.284694693815 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] <= G1 [ i ] ) { | |
| -- Bleu score: 0.280036103001 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: G [ cur ] [ i ] = 0 ; | |
| -- Bleu score: 0.176954354247 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n ) ; | |
| -- Bleu score: 0.575034845794 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n % N == 0 ) { | |
| -- Bleu score: 0.335689192504 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] < 1 ) lsum += G [ cur ] [ 1 ] ; | |
| -- Bleu score: 0.794483720649 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min << endl ; | |
| -- Bleu score: 0.185161464757 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: memset ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.130651132984 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a <= i ) { | |
| -- Bleu score: 0.043455683464 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a % b != 0 ) { | |
| -- Bleu score: 0.465573338296 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.623803091994 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << "\n" ; | |
| -- Bleu score: 0.89795421444 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 1 ) return 1 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p % 2 == 1 ) return n ; | |
| -- Bleu score: 0.634046627705 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n ) ; | |
| -- Bleu score: 0.339379153632 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.40979256817e-07 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % n ) res ++ ; | |
| -- Bleu score: 0.132730065661 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res % casted ; | |
| -- Bleu score: 0.197656093009 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 ; | |
| -- Bleu score: 0.0950650657914 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i % 2 == 0 ) { | |
| -- Bleu score: 0.312393993692 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr - i ) % m ; | |
| -- Bleu score: 0.198227285009 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr += arr % m ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) i ++ ; | |
| -- Bleu score: 0.444047178152 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a - 2 ) * b << "\n" ; | |
| -- Bleu score: 0.372390989494 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.332113972392 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self % i == 0 ) return start ; | |
| -- Bleu score: 0.252119361843 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start <= i ) { | |
| -- Bleu score: 0.278351444742 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == 1 ) { | |
| -- Bleu score: 0.481011805618 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b , i ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b ) { | |
| -- Bleu score: 0.595223883443 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == 1 ) { | |
| -- Bleu score: 0.481011805618 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a , i ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b , 1 ) ; | |
| -- Bleu score: 0.450432044232 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - sum ) ; | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: bool v [ vector ] = false ; | |
| -- Bleu score: 0.168299467119 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x ; | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= x ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v << endl ; | |
| -- Bleu score: 0.258413640862 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u , int u ) { | |
| -- Bleu score: 0.641827796559 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k <= n ) { | |
| -- Bleu score: 0.103874093572 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 ) { | |
| -- Bleu score: 0.583645478144 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k % n == 0 ) return n ; | |
| -- Bleu score: 0.259653588934 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = z , z = z , z = z ; | |
| -- Bleu score: 0.184768604205 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = y ; | |
| -- Bleu score: 0.371377945828 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: sum = sum % t ; | |
| -- Bleu score: 0.0722643612474 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: i -- ; | |
| -- Bleu score: 0.112306105372 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getchar ( s , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 0 ) { | |
| -- Bleu score: 0.80910671157 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == i ) { | |
| -- Bleu score: 0.7272454093 | |
| line 1:12 token recognition error at: ''B){' | |
| line 1:9 token recognition error at: ''B){' | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 0 ) { | |
| -- Bleu score: 0.493938273712 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == j ) { | |
| -- Bleu score: 0.7272454093 | |
| line 1:12 token recognition error at: ''B){' | |
| line 1:9 token recognition error at: ''B){' | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( cnt == 0 ) cnt ++ ; | |
| -- Bleu score: 0.707106781187 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt % 2 == 0 ) return cnt ; | |
| -- Bleu score: 0.234623503205 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << a << _STR : 0_ ; | |
| -- Bleu score: 0.530771217107 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 17:33:10 [INFO] evaluation: sentence level bleu: 0.706488 | |
| 07/21/2020 17:33:10 [INFO] evaluation: accuracy: 0.435754 | |
| 07/21/2020 17:33:10 [INFO] evaluation: oracle bleu: 0.815299 | |
| 07/21/2020 17:33:10 [INFO] evaluation: oracle accuracy: 0.592179 | |
| 07/21/2020 17:33:10 [INFO] learner: avg. example bleu: 0.706488 | |
| 07/21/2020 17:33:10 [INFO] learner: accuracy: 0.435754 | |
| 07/21/2020 17:33:11 [INFO] learner: save current best model | |
| 07/21/2020 17:33:11 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 17:33:11 [INFO] model: save model to [runs/model.iter1400] | |
| 07/21/2020 17:34:37 [INFO] learner: [Epoch 9] cumulative loss = 3.317879, (took 719s) | |
| Epoch 10, eta 197s | |
| 07/21/2020 17:37:41 [INFO] learner: [Epoch 10] cumulative loss = 3.116011, (took 184s) | |
| Epoch 11, eta 163s | |
| 07/21/2020 17:39:11 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 2/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << x << endl ; | |
| -- Bleu score: 0.320028610127 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.433618909035 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: int dfs ( int cur , int n ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( ! vis [ i ] ) { | |
| -- Bleu score: 0.273461223137 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , sizeof ( i ) ) ; | |
| -- Bleu score: 0.403527863746 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( ! n ) { | |
| -- Bleu score: 0.323866397977 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( ! G [ cur ] ) lsum += G [ G [ cur ] [ 1 ] ] [ cur ] ; | |
| -- Bleu score: 0.521178585409 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , sizeof ( vis ) , sizeof ( vis ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , sizeof ( G ) , sizeof ( G ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , sizeof ( G1 ) , sizeof ( G1 ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = v , v = v , v = v ; | |
| -- Bleu score: 0.184768604205 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ++ ; | |
| -- Bleu score: 0.826516818379 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ++ ; | |
| -- Bleu score: 0.826516818379 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ++ ; | |
| -- Bleu score: 0.826516818379 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , sizeof ( num ) ) ; | |
| -- Bleu score: 0.270898369915 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ vis ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( and ) ; | |
| -- Bleu score: 0.302851268329 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - ssum ) << endl ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: memset ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.130651132984 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( ! a [ i ] && a [ i ] ) { | |
| -- Bleu score: 0.24482451179 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.623803091994 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 0.913100716282 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 1 ) return p ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = - 1 ; | |
| -- Bleu score: 0.0844727061998 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.40979256817e-07 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % n ) res ++ ; | |
| -- Bleu score: 0.132730065661 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! res ; | |
| -- Bleu score: 0.0953406181665 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] >> arr [ i ] ; | |
| -- Bleu score: 0.559368491593 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == true ) { | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( ! arr [ i ] ) { | |
| -- Bleu score: 0.288715663092 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr [ i - 1 ] + m - 1 ; | |
| -- Bleu score: 0.35004965297 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( ! arr [ i ] ) arr [ i ] ++ ; | |
| -- Bleu score: 0.31178188169 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 0.643458884161 | |
| line 1:6 token recognition error at: ''<<endl;' | |
| line 1:6 token recognition error at: ''\n<<endl;' | |
| line 1:6 token recognition error at: ''ans<<endl;' | |
| line 1:6 token recognition error at: ''\nans<<endl;' | |
| line 1:6 token recognition error at: ''<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a / b ) << endl ; | |
| -- Bleu score: 0.432369435977 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: int dfs ( int start , int self ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( ! start [ i ] ) { | |
| -- Bleu score: 0.535835119938 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( ! b [ i ] ) break ; | |
| -- Bleu score: 0.301465184959 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( ! a [ i ] ) break ; | |
| -- Bleu score: 0.301465184959 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ b ] , 1 ) ; | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - sum ) ; | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z , z = z ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( ! v [ i ] ) { | |
| -- Bleu score: 0.450581831523 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ v % n ] << endl ; | |
| -- Bleu score: 0.634046627705 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.433618909035 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ u ] ) n ++ ; | |
| -- Bleu score: 0.269814792751 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( ! graph [ u ] ) { | |
| -- Bleu score: 0.148328379371 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) continue ; | |
| -- Bleu score: 0.584586445093 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs . clear ( i ) ; | |
| -- Bleu score: 0.541082269054 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , sizeof ( graph ) , sizeof ( graph ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , sizeof ( vis ) , sizeof ( vis ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , sizeof ( m ) , sizeof ( m ) ) ; | |
| -- Bleu score: 0.602608097856 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = z , z = z , z = z , z = z ; | |
| -- Bleu score: 0.139735367287 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = - 1 ; | |
| -- Bleu score: 0.407050033978 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( an ) ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: sum = sum - t ; | |
| -- Bleu score: 0.158824817355 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = k ; | |
| -- Bleu score: 0.275600167872 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] [ 10 ] = sizeof ( s ) ; | |
| -- Bleu score: 0.257486610163 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getchar ( s , s ) ; | |
| -- Bleu score: 0.027402118999 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( ! s [ i ] ) { | |
| -- Bleu score: 0.322855990262 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( ! s [ i ] ) { | |
| -- Bleu score: 0.322855990262 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( ! s [ i ] ) { | |
| -- Bleu score: 0.245317502727 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( ! s [ j ] ) { | |
| -- Bleu score: 0.322855990262 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) flag ++ ; | |
| -- Bleu score: 0.707106781187 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( ! cnt ) { | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 17:50:42 [INFO] evaluation: sentence level bleu: 0.686825 | |
| 07/21/2020 17:50:42 [INFO] evaluation: accuracy: 0.391061 | |
| 07/21/2020 17:50:42 [INFO] evaluation: oracle bleu: 0.810170 | |
| 07/21/2020 17:50:42 [INFO] evaluation: oracle accuracy: 0.581006 | |
| 07/21/2020 17:50:42 [INFO] learner: avg. example bleu: 0.686825 | |
| 07/21/2020 17:50:42 [INFO] learner: accuracy: 0.391061 | |
| 07/21/2020 17:50:42 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 17:50:42 [INFO] model: save model to [runs/model.iter1680] | |
| 07/21/2020 17:52:18 [INFO] learner: [Epoch 11] cumulative loss = 2.706473, (took 877s) | |
| Epoch 12, eta 194s | |
| 07/21/2020 17:55:29 [INFO] learner: [Epoch 12] cumulative loss = 2.442426, (took 190s) | |
| Epoch 13, eta 241s | |
| 07/21/2020 17:56:45 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y << 2 ; | |
| -- Bleu score: 0.506266712158 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ cur ] == 0 ) { | |
| -- Bleu score: 0.304005122286 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , 1 ) ; | |
| -- Bleu score: 0.519602638805 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur [ cur ] [ 1 ] ] [ cur ] == 1 ) lsum += G [ cur [ cur ] [ 1 ] ] [ cur ] ; | |
| -- Bleu score: 0.471999149543 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = y , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ i ] && b [ j ] == b [ j ] ) { | |
| -- Bleu score: 0.843613401913 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int b , int b ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , b ) ; | |
| -- Bleu score: 0.58228940089 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int x , int x ) { | |
| -- Bleu score: 0.587728372511 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.623803091994 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = n ; | |
| -- Bleu score: 0.0648490633638 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 && res % 2 ) | |
| -- Bleu score: 0.188241783635 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! res ; | |
| -- Bleu score: 0.0953406181665 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 , m = 0 , m [ 0 ] = 0 ; | |
| -- Bleu score: 0.232878969541 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == i ) { | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr [ i ] + m / 1 ; | |
| -- Bleu score: 0.216050441958 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < arr [ i ] ) is ++ ; | |
| -- Bleu score: 0.325274370256 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a / 2 ) * b << "\n" ; | |
| -- Bleu score: 0.398328715516 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.519424734679 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ i ] ) continue ; | |
| -- Bleu score: 0.686589047969 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( ! a [ i ] ) continue ; | |
| -- Bleu score: 0.301465184959 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int , int > :: string v = vector ; | |
| -- Bleu score: 0.169006219856 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = 2 ; | |
| -- Bleu score: 0.249487848424 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 3 ] = 3 ; | |
| -- Bleu score: 0.317456751554 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = 4 ; | |
| -- Bleu score: 0.249487848424 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = 5 ; | |
| -- Bleu score: 0.249487848424 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 7 ] = 7 ; | |
| -- Bleu score: 0.317456751554 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 8 ] = 8 ; | |
| -- Bleu score: 0.317456751554 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 9 ] = 9 ; | |
| -- Bleu score: 0.317456751554 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 10 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 11 ] = 11 ; | |
| -- Bleu score: 0.317456751554 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.433618909035 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ u ] [ 1 ] ) n += m [ m [ u ] [ 1 ] ] [ u ] ; | |
| -- Bleu score: 0.322210372075 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 ) { | |
| -- Bleu score: 0.583645478144 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) continue ; | |
| -- Bleu score: 0.584586445093 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs . push_back ( i ) ; | |
| -- Bleu score: 0.541082269054 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = 1 ; | |
| -- Bleu score: 0.434576689987 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( dfs [ 1 ] [ 1 ] ) ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: sum = sum % t ; | |
| -- Bleu score: 0.0722643612474 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , k = j , k = k ; | |
| -- Bleu score: 0.265181229805 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: while ( cin >> 8 ) { | |
| -- Bleu score: 0.0392280274567 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == '*' ) { | |
| -- Bleu score: 0.7272454093 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) f ++ ; | |
| -- Bleu score: 0.707106781187 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == '*' ) { | |
| -- Bleu score: 0.7272454093 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == cnt ) { | |
| -- Bleu score: 0.541082269054 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 18:03:32 [INFO] evaluation: sentence level bleu: 0.744094 | |
| 07/21/2020 18:03:32 [INFO] evaluation: accuracy: 0.508380 | |
| 07/21/2020 18:03:32 [INFO] evaluation: oracle bleu: 0.837259 | |
| 07/21/2020 18:03:32 [INFO] evaluation: oracle accuracy: 0.636872 | |
| 07/21/2020 18:03:32 [INFO] learner: avg. example bleu: 0.744094 | |
| 07/21/2020 18:03:32 [INFO] learner: accuracy: 0.508380 | |
| 07/21/2020 18:03:32 [INFO] learner: save current best model | |
| 07/21/2020 18:03:32 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 18:03:32 [INFO] model: save model to [runs/model.iter1960] | |
| 07/21/2020 18:05:30 [INFO] learner: [Epoch 13] cumulative loss = 2.212316, (took 601s) | |
| Epoch 14, eta 304s | |
| 07/21/2020 18:08:44 [INFO] learner: [Epoch 14] cumulative loss = 2.008491, (took 194s) | |
| Epoch 15, eta 162s | |
| 07/21/2020 18:09:47 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 2/15 | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << ( x - 2 ) / y << endl ; | |
| -- Bleu score: 0.209734257913 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: int dfs ( int cur , int n ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] == 0 ) { | |
| -- Bleu score: 0.415569357098 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ cur [ 1 ] [ 1 ] ] [ cur ] ; } | |
| -- Bleu score: 0.581281623314 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = y , v = y ; | |
| -- Bleu score: 0.227187097805 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: memset ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.130651132984 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ i ] && b [ i ] == b [ i ] ) { | |
| -- Bleu score: 0.76412540831 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: return a ; | |
| -- Bleu score: 0.044395972018 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { add ++ ; } | |
| -- Bleu score: 0.555718389406 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p [ 0 ] == 0 ) return p ; | |
| -- Bleu score: 0.40335820726 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 && n [ 1 ] == 0 ) return n ; | |
| -- Bleu score: 0.428181853195 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = ( fp % n ) % p / 2 ; | |
| -- Bleu score: 0.256222247207 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.40979256817e-07 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 == 2 ) res = ( res % int ( res + 2 ) ) % int ( n + 2 ) ; | |
| -- Bleu score: 0.425129883573 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ; | |
| -- Bleu score: 0.0576598770701 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 ; | |
| -- Bleu score: 0.0950650657914 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == true ) { | |
| -- Bleu score: 0.411133616901 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr [ i ] + 1 - 1 ; | |
| -- Bleu score: 0.220801642283 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < arr [ i ] ) ans += arr [ i ] [ i ] ; | |
| -- Bleu score: 0.415592250992 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''<<endl;' | |
| line 1:6 token recognition error at: ''\n<<endl;' | |
| line 1:11 token recognition error at: ''\n;' | |
| line 1:13 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a / 2 ) * b << "\n" ; | |
| -- Bleu score: 0.398328715516 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , b = 105 ; | |
| -- Bleu score: 0.149244103091 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: int dfs ( int start , int self ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] ) ; | |
| -- Bleu score: 0.625710681816 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - sum ) ; | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v ( a ) ; | |
| -- Bleu score: 0.203007276128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: long x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ 1 ] [ 1 ] ) { n += m [ m [ 1 ] [ 1 ] ] [ u ] ; } | |
| -- Bleu score: 0.400371423393 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) continue ; | |
| -- Bleu score: 0.584586445093 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum ( t , t ) ; } | |
| -- Bleu score: 0.666020733667 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , j = j ; | |
| -- Bleu score: 0.222298495521 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getchar ( cin , 0 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << a << _STR : 0_ << a << endl ; | |
| -- Bleu score: 0.500871842892 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 18:19:59 [INFO] evaluation: sentence level bleu: 0.761790 | |
| 07/21/2020 18:19:59 [INFO] evaluation: accuracy: 0.508380 | |
| 07/21/2020 18:19:59 [INFO] evaluation: oracle bleu: 0.858272 | |
| 07/21/2020 18:19:59 [INFO] evaluation: oracle accuracy: 0.692737 | |
| 07/21/2020 18:19:59 [INFO] learner: avg. example bleu: 0.761790 | |
| 07/21/2020 18:19:59 [INFO] learner: accuracy: 0.508380 | |
| 07/21/2020 18:19:59 [INFO] learner: save current best model | |
| 07/21/2020 18:19:59 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 18:19:59 [INFO] model: save model to [runs/model.iter2240] | |
| 07/21/2020 18:22:09 [INFO] learner: [Epoch 15] cumulative loss = 1.752392, (took 804s) | |
| Epoch 16, eta 122s | |
| 07/21/2020 18:25:15 [INFO] learner: [Epoch 16] cumulative loss = 1.604595, (took 186s) | |
| Epoch 17, eta 189s | |
| 07/21/2020 18:26:04 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 2/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y >> y ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << ( x / 2 ) * y << endl ; | |
| -- Bleu score: 0.296151653601 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn [ 100 ] = 100 ; | |
| -- Bleu score: 0.354948105601 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: int dfs ( int cur , int n ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.352126757432 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] == - 1 ) { lsum += G [ cur [ i ] [ i ] ] [ i ] ; } | |
| -- Bleu score: 0.59679608569 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ cur [ cur ] [ 1 ] ] [ 1 ] ; } | |
| -- Bleu score: 0.642240142838 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = min ( x , y ) ; | |
| -- Bleu score: 0.357065674557 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a < int > :: string a [ 105 ] = 105 ; | |
| -- Bleu score: 0.375966352947 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = n , ans = n , ans = n ; | |
| -- Bleu score: 0.263004650884 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ j ] == b [ j ] ) { | |
| -- Bleu score: 0.88438659249 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int n ( int n , int x ) { | |
| -- Bleu score: 0.786075302152 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { cin >> n [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.519431488392 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p ) break ; | |
| -- Bleu score: 0.275967896145 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = 1 ; | |
| -- Bleu score: 0.0890021138937 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 2 ; | |
| -- Bleu score: 0.0336079015425 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n [ 100005 ] = 100005 ; | |
| -- Bleu score: 0.166316856729 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr [ i - 1 ] + 1 ; | |
| -- Bleu score: 0.310069238733 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] [ i ] == - 1 ) { ans += arr [ i ] [ i ] ; } | |
| -- Bleu score: 0.382745041166 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 0.643458884161 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a / 2 ) << endl ; | |
| -- Bleu score: 0.432369435977 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 , c [ 105 ] = 105 , c [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.240712989609 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: int dfs ( int start , int self ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] ) break ; | |
| -- Bleu score: 0.405704934532 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] ) break ; | |
| -- Bleu score: 0.405704934532 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: int v ( int v ) { | |
| -- Bleu score: 0.197406313661 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 2 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 3 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 4 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 5 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 7 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 10 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ 1 ] [ 1 ] ) { n += m [ 1 ] [ 1 ] ; } | |
| -- Bleu score: 0.404899367064 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == false ) { | |
| -- Bleu score: 0.794105493801 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , y = z , z = z , z = z , z = z , z = z , z = z ; | |
| -- Bleu score: 0.0924272533424 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = - 1 ; | |
| -- Bleu score: 0.407050033978 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum ( t , t - t ) ; } | |
| -- Bleu score: 0.62142113165 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = false ; | |
| -- Bleu score: 0.265181229805 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) { | |
| -- Bleu score: 0.631914561892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt ) { | |
| -- Bleu score: 0.439891724758 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 18:35:48 [INFO] evaluation: sentence level bleu: 0.780104 | |
| 07/21/2020 18:35:48 [INFO] evaluation: accuracy: 0.519553 | |
| 07/21/2020 18:35:48 [INFO] evaluation: oracle bleu: 0.840793 | |
| 07/21/2020 18:35:48 [INFO] evaluation: oracle accuracy: 0.642458 | |
| 07/21/2020 18:35:48 [INFO] learner: avg. example bleu: 0.780104 | |
| 07/21/2020 18:35:48 [INFO] learner: accuracy: 0.519553 | |
| 07/21/2020 18:35:48 [INFO] learner: save current best model | |
| 07/21/2020 18:35:48 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 18:35:48 [INFO] model: save model to [runs/model.iter2520] | |
| 07/21/2020 18:38:11 [INFO] learner: [Epoch 17] cumulative loss = 1.513198, (took 775s) | |
| Epoch 18, eta 194s | |
| 07/21/2020 18:41:18 [INFO] learner: [Epoch 18] cumulative loss = 1.397409, (took 187s) | |
| Epoch 19, eta 143s | |
| 07/21/2020 18:41:42 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 7/15 | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << x / y << endl ; | |
| -- Bleu score: 0.272258942307 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = false ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ cur ] == 0 ) { | |
| -- Bleu score: 0.304005122286 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ G [ cur ] [ 1 ] ] [ cur ] ; } | |
| -- Bleu score: 0.612814717251 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = min ( num , & num ) ; | |
| -- Bleu score: 0.212507082336 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = false , b [ 105 ] = false ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n ; | |
| -- Bleu score: 0.581430736968 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ j ] == b [ j ] ) { | |
| -- Bleu score: 0.88438659249 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a % b == 0 ) { return b ; } | |
| -- Bleu score: 0.699752229822 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp % n ; | |
| -- Bleu score: 0.145047841524 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res -- ; | |
| -- Bleu score: 2.69949597471e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 ; | |
| -- Bleu score: 0.0950650657914 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i == i ) { | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] < arr [ i ] ) { | |
| -- Bleu score: 0.534933110982 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr [ i ] + m * m ; | |
| -- Bleu score: 0.215061626801 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.349692064893 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << '\n' ; | |
| -- Bleu score: 0.460863639691 | |
| line 1:6 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( ( a * b ) / 2 ) << endl ; | |
| -- Bleu score: 0.646417393809 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ i ] ) continue ; | |
| -- Bleu score: 0.544517884614 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ i ] ) continue ; | |
| -- Bleu score: 0.686589047969 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 2 ] [ 2 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 3 ] [ 3 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] [ 4 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 5 ] [ 5 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 7 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 9 ] [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 10 ] [ 10 ] = _STR : 0_ ; | |
| -- Bleu score: 0.75349436063 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x < int > :: x x = string ; | |
| -- Bleu score: 0.252119361843 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.837528928128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ n ] [ 1 ] ) { n += m [ m [ 1 ] [ u ] ] [ 1 ] ; } | |
| -- Bleu score: 0.376164843109 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = y ; | |
| -- Bleu score: 0.371377945828 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = x ; | |
| -- Bleu score: 0.807055727493 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = k , j = k ; | |
| -- Bleu score: 0.239618290571 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''B){' | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''B){' | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 18:49:48 [INFO] evaluation: sentence level bleu: 0.806016 | |
| 07/21/2020 18:49:48 [INFO] evaluation: accuracy: 0.569832 | |
| 07/21/2020 18:49:48 [INFO] evaluation: oracle bleu: 0.860840 | |
| 07/21/2020 18:49:48 [INFO] evaluation: oracle accuracy: 0.703911 | |
| 07/21/2020 18:49:48 [INFO] learner: avg. example bleu: 0.806016 | |
| 07/21/2020 18:49:48 [INFO] learner: accuracy: 0.569832 | |
| 07/21/2020 18:49:48 [INFO] learner: save current best model | |
| 07/21/2020 18:49:48 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 18:49:48 [INFO] model: save model to [runs/model.iter2800] | |
| 07/21/2020 18:52:40 [INFO] learner: [Epoch 19] cumulative loss = 1.318225, (took 681s) | |
| Epoch 20, eta 158s | |
| 07/21/2020 18:55:49 [INFO] learner: [Epoch 20] cumulative loss = 1.219207, (took 189s) | |
| Epoch 21, eta 133s | |
| 07/21/2020 18:56:08 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y >> y ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 ; | |
| -- Bleu score: 0.284694693815 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string vis [ maxn ] = false ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ vis [ i ] ] [ vis [ i ] ] == 0 ) { | |
| -- Bleu score: 0.337012926467 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] != - 1 ) lsum += G [ cur ] [ 1 ] ; | |
| -- Bleu score: 0.759083744418 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( x , y ) ; | |
| -- Bleu score: 0.366595791718 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = false ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] != a [ j ] ) b ++ ; | |
| -- Bleu score: 0.360663145728 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { n ++ ; } | |
| -- Bleu score: 0.555718389406 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = ( fp % n ) % p / 2 ; | |
| -- Bleu score: 0.202874174395 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res % 2 ) % int ( n ) ; | |
| -- Bleu score: 0.623244242629 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted ) ; | |
| -- Bleu score: 0.169590110785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , m = 100005 , a = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.31243257276 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] != arr [ i ] ) { | |
| -- Bleu score: 0.534933110982 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] != arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.349692064893 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , c [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.346697783111 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start [ b ] == b [ i ] ) { | |
| -- Bleu score: 0.673904706256 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z , z = z ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z [ i ] = i ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k != m [ 1 ] [ u ] ) k ++ ; | |
| -- Bleu score: 0.453037260767 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) continue ; | |
| -- Bleu score: 0.584586445093 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = k ; | |
| -- Bleu score: 0.275600167872 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 , s [ 10 ] = 10 ; | |
| -- Bleu score: 0.239618290571 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 19:04:11 [INFO] evaluation: sentence level bleu: 0.805479 | |
| 07/21/2020 19:04:11 [INFO] evaluation: accuracy: 0.564246 | |
| 07/21/2020 19:04:11 [INFO] evaluation: oracle bleu: 0.871405 | |
| 07/21/2020 19:04:11 [INFO] evaluation: oracle accuracy: 0.726257 | |
| 07/21/2020 19:04:11 [INFO] learner: avg. example bleu: 0.805479 | |
| 07/21/2020 19:04:11 [INFO] learner: accuracy: 0.564246 | |
| 07/21/2020 19:04:11 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 19:04:11 [INFO] model: save model to [runs/model.iter3080] | |
| 07/21/2020 19:07:47 [INFO] learner: [Epoch 21] cumulative loss = 1.072650, (took 717s) | |
| Epoch 22, eta 177s | |
| 07/21/2020 19:11:26 [INFO] learner: [Epoch 22] cumulative loss = 1.066046, (took 219s) | |
| Epoch 2307/21/2020 19:11:29 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y >> y ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y + y / y << endl ; | |
| -- Bleu score: 0.514240160503 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = false ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( ! vis [ i ] ) { | |
| -- Bleu score: 0.273461223137 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] != - 1 ) { lsum += G [ 1 ] [ cur ] ; } | |
| -- Bleu score: 0.670342089635 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.315696117068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ j ] == b [ j ] ) { | |
| -- Bleu score: 0.88438659249 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: return ! a ? b : 0 ; | |
| -- Bleu score: 0.145054743415 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < 2 ; i -- ) { cin >> n >> n ; } | |
| -- Bleu score: 0.464061160649 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n % 2 ) % int ( n ) ; | |
| -- Bleu score: 0.581948610443 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( ( res * res ) % int ( 1e9 + 1e9 ) ) % int ( 1e9 + 1e9 ) ) % 1e9 ; | |
| -- Bleu score: 0.4344230632 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 && res % 2 ) | |
| -- Bleu score: 0.188241783635 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! res ; | |
| -- Bleu score: 0.0953406181665 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , a = 0 , a = 0 , a = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.251307372678 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m >> m ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] < '*' ) { | |
| -- Bleu score: 0.383057614651 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr + b ; | |
| -- Bleu score: 0.0447034678555 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < ans ) arr [ i ] += ans ; | |
| -- Bleu score: 0.396151981702 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( ( a * b ) / 2 ) << endl ; | |
| -- Bleu score: 0.646417393809 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , c = 105 , c = 105 , c = 105 , c = 105 , c = 105 , c = 105 ; | |
| -- Bleu score: 0.0821807407727 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ 1 ] == 1 ) return i ; | |
| -- Bleu score: 0.389339592938 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ 1 ] == 1 ) return i ; | |
| -- Bleu score: 0.455594936319 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> c [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = v . begin ( a ) ; | |
| -- Bleu score: 0.157677702625 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] < v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == 1 ) { n += m [ 1 ] [ 1 ] ; } | |
| -- Bleu score: 0.544219109256 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < exclusive ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n >> n ) { | |
| -- Bleu score: 0.718608223926 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z , z = z ; | |
| -- Bleu score: 0.181672557364 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = 1 ; | |
| -- Bleu score: 0.434576689987 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , j = j , k = k , k = k ; | |
| -- Bleu score: 0.172689327893 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: let < int > :: string s [ 10 ] = 10 ; | |
| -- Bleu score: 0.36362270465 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( cin ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] == '*' ) { | |
| -- Bleu score: 0.496661339729 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == '*' ) { | |
| -- Bleu score: 0.7272454093 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == '*' ) { | |
| -- Bleu score: 0.80910671157 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == '*' ) { | |
| -- Bleu score: 0.7272454093 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 19:20:51 [INFO] evaluation: sentence level bleu: 0.784729 | |
| 07/21/2020 19:20:51 [INFO] evaluation: accuracy: 0.541899 | |
| 07/21/2020 19:20:51 [INFO] evaluation: oracle bleu: 0.876190 | |
| 07/21/2020 19:20:51 [INFO] evaluation: oracle accuracy: 0.737430 | |
| 07/21/2020 19:20:51 [INFO] learner: avg. example bleu: 0.784729 | |
| 07/21/2020 19:20:51 [INFO] learner: accuracy: 0.541899 | |
| 07/21/2020 19:20:51 [INFO] learner: hitting patience_counter: 2 | |
| 07/21/2020 19:20:51 [INFO] model: save model to [runs/model.iter3360] | |
| , eta 16556s | |
| 07/21/2020 19:24:05 [INFO] learner: [Epoch 23] cumulative loss = 1.053586, (took 758s) | |
| Epoch 24, eta 125s | |
| 07/21/2020 19:27:03 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << ( x - 2 ) / y << endl ; | |
| -- Bleu score: 0.209734257913 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.352126757432 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: getchar ( i , n + 1 ) ; | |
| -- Bleu score: 0.880111736793 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) lsum += G [ cur ] [ 1 ] ; | |
| -- Bleu score: 0.759083744418 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = y , v = v ; | |
| -- Bleu score: 0.25142385353 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 0.473987850117 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = false , b [ 105 ] = false ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = n ; | |
| -- Bleu score: 0.432422707546 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && a [ i ] == b [ j ] ) { | |
| -- Bleu score: 0.88438659249 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp . size ( n ) ; | |
| -- Bleu score: 0.227527483009 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res % int ( casted + 1e9 ) ) % int ( casted + 1e9 ) ; | |
| -- Bleu score: 0.262052584459 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p & 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.528892092986 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted , casted ) ; | |
| -- Bleu score: 0.186758738964 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , m = 0 , m = 0 , a = 0 , a = 0 ; | |
| -- Bleu score: 0.192857654565 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i + 1 ] ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i + 1 ] ) / m ; | |
| -- Bleu score: 0.813748937097 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.349692064893 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( ( a * b ) / 2 ) << endl ; | |
| -- Bleu score: 0.646417393809 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.519424734679 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: v v = vector ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x ; | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = graph ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = of ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = m ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { k += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < i ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs . clear ( i ) ; | |
| -- Bleu score: 0.541082269054 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ x ] = 1 ; | |
| -- Bleu score: 0.434576689987 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , i = j , k = 0 ; | |
| -- Bleu score: 0.253365494645 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 19:33:48 [INFO] evaluation: sentence level bleu: 0.811120 | |
| 07/21/2020 19:33:48 [INFO] evaluation: accuracy: 0.547486 | |
| 07/21/2020 19:33:48 [INFO] evaluation: oracle bleu: 0.878598 | |
| 07/21/2020 19:33:48 [INFO] evaluation: oracle accuracy: 0.726257 | |
| 07/21/2020 19:33:48 [INFO] learner: avg. example bleu: 0.811120 | |
| 07/21/2020 19:33:48 [INFO] learner: accuracy: 0.547486 | |
| 07/21/2020 19:33:48 [INFO] learner: save current best model | |
| 07/21/2020 19:33:48 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 19:33:48 [INFO] model: save model to [runs/model.iter3640] | |
| 07/21/2020 19:33:58 [INFO] learner: [Epoch 24] cumulative loss = 0.875938, (took 593s) | |
| Epoch 25, eta 283s | |
| 07/21/2020 19:37:15 [INFO] learner: [Epoch 25] cumulative loss = 0.907380, (took 197s) | |
| Epoch 26, eta 126s | |
| 07/21/2020 19:39:57 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << ( x - 2 ) / y << endl ; | |
| -- Bleu score: 0.209734257913 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: const int G1 = maxn ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = lsum , ssum = ssum ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] == G1 [ i ] ) { | |
| -- Bleu score: 0.338948147458 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] < 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.743917553889 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) lsum += G [ cur ] [ 1 ] ; | |
| -- Bleu score: 0.759083744418 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| line 1:14 token recognition error at: '';' | |
| line 1:10 token recognition error at: '',v=v;' | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a < int > :: string a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.402767204637 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = ans ; | |
| -- Bleu score: 0.32559641262 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> b [ i ] ; | |
| -- Bleu score: 0.695258254617 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ j ] == b [ j ] ) | |
| -- Bleu score: 0.839693286591 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) { return b ; } | |
| -- Bleu score: 0.335211341908 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << | |
| -- Bleu score: 0.135335283237 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<"\n";' | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: bool res [ n ] = fp ( n ) ; | |
| -- Bleu score: 0.166347719514 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( result % casted ) ; | |
| -- Bleu score: 0.224820420876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.377543239992 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] * m ) ; | |
| -- Bleu score: 0.49192149873 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: arr [ i ] += ans ; | |
| -- Bleu score: 0.0644566631146 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| line 1:6 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = v . begin ( a ) ; | |
| -- Bleu score: 0.157677702625 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x < int > :: string x = x ; | |
| -- Bleu score: 0.331807740284 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { by += m [ 1 ] [ n ] ; } | |
| -- Bleu score: 0.688836505347 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < exclusive ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = z , z = z , z = z ; | |
| -- Bleu score: 0.184768604205 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , k = false , k = k ; | |
| -- Bleu score: 0.265181229805 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 19:46:28 [INFO] evaluation: sentence level bleu: 0.784401 | |
| 07/21/2020 19:46:28 [INFO] evaluation: accuracy: 0.547486 | |
| 07/21/2020 19:46:28 [INFO] evaluation: oracle bleu: 0.859649 | |
| 07/21/2020 19:46:28 [INFO] evaluation: oracle accuracy: 0.692737 | |
| 07/21/2020 19:46:28 [INFO] learner: avg. example bleu: 0.784401 | |
| 07/21/2020 19:46:28 [INFO] learner: accuracy: 0.547486 | |
| 07/21/2020 19:46:28 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 19:46:28 [INFO] model: save model to [runs/model.iter3920] | |
| 07/21/2020 19:46:55 [INFO] learner: [Epoch 26] cumulative loss = 0.797639, (took 579s) | |
| Epoch 27, eta 176s | |
| 07/21/2020 19:50:03 [INFO] learner: [Epoch 27] cumulative loss = 0.857875, (took 188s) | |
| Epoch 28, eta 192s | |
| 07/21/2020 19:52:32 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 13/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = false , lsum = false ; | |
| -- Bleu score: 0.211053406319 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] ) { | |
| -- Bleu score: 0.412574426045 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 0.812034170286 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v ; | |
| -- Bleu score: 0.343294523985 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( a ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n ; | |
| -- Bleu score: 0.271518295501 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += ( n % x ) ; | |
| -- Bleu score: 0.368893973233 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && 0 == 0 ) return 1 ; | |
| -- Bleu score: 0.65119282524 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: create < int , int > :: string res [ n ] = n ; | |
| -- Bleu score: 0.0806193004326 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % int ( n + 2 ) ; | |
| -- Bleu score: 0.798579504581 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! result ; | |
| -- Bleu score: 0.0887244425356 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , arr = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| line 1:7 token recognition error at: '')<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( ( a * b ) / 2 ) << endl ; | |
| -- Bleu score: 0.646417393809 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long result = 0 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ 1 ] ) return a ; | |
| -- Bleu score: 0.698450232079 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return a ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long sum = 0 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> a [ i ] >> c [ i ] ; | |
| -- Bleu score: 0.839432708373 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 2 + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.282955962833 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 3 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 7 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = v ++ ; | |
| -- Bleu score: 0.435277137794 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.665174039918 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: string :: x x = string ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == false ) { | |
| -- Bleu score: 0.794105493801 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , j = j ; | |
| -- Bleu score: 0.222298495521 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 19:59:20 [INFO] evaluation: sentence level bleu: 0.810115 | |
| 07/21/2020 19:59:20 [INFO] evaluation: accuracy: 0.564246 | |
| 07/21/2020 19:59:20 [INFO] evaluation: oracle bleu: 0.877065 | |
| 07/21/2020 19:59:20 [INFO] evaluation: oracle accuracy: 0.731844 | |
| 07/21/2020 19:59:20 [INFO] learner: avg. example bleu: 0.810115 | |
| 07/21/2020 19:59:20 [INFO] learner: accuracy: 0.564246 | |
| 07/21/2020 19:59:20 [INFO] learner: hitting patience_counter: 2 | |
| 07/21/2020 19:59:20 [INFO] model: save model to [runs/model.iter4200] | |
| 07/21/2020 20:00:05 [INFO] learner: [Epoch 28] cumulative loss = 0.712092, (took 601s) | |
| Epoch 29, eta 210s | |
| 07/21/2020 20:03:17 [INFO] learner: [Epoch 29] cumulative loss = 0.744700, (took 191s) | |
| Epoch 30, eta 193s | |
| 07/21/2020 20:05:31 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 3/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / 2 << endl ; | |
| -- Bleu score: 0.58228940089 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: bool maxn = 100 ; | |
| -- Bleu score: 0.622100843129 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = false ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ vis [ i ] ] [ i ] != 0 ) { | |
| -- Bleu score: 0.562384288921 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ G [ cur ] [ i ] ] [ i ] ; } | |
| -- Bleu score: 0.787072703431 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur [ cur ] [ 1 ] ] [ cur ] != - 1 ) { lsum += G [ cur [ cur ] [ 1 ] ] [ cur ] ; } | |
| -- Bleu score: 0.502576040647 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 0 ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num -- ; | |
| -- Bleu score: 0.0151989785798 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a < int > :: string a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.402767204637 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 0 ; j ++ ) | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: return b ; | |
| -- Bleu score: 0.0694834512228 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i <= n ; i ++ ) { add ++ ; } | |
| -- Bleu score: 0.542633172252 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: continue ; | |
| -- Bleu score: 9.37711731043e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( ( ( res % int ( casted + 1e9 ) ) % int ( casted + 1e9 ) ) % int ( casted + 1e9 ) ) % int ( casted + 1e9 ) ) % int ( casted ) ; | |
| -- Bleu score: 0.313770089598 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 , arr = 0 , arr = 0 , arr = 0 , ans = 0 ; | |
| -- Bleu score: 0.292705712156 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i + 1 ] ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i ] - arr [ i ] ) / m ; | |
| -- Bleu score: 0.788833225188 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = sizeof ( c ) ; | |
| -- Bleu score: 0.396451325342 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ 1 ] ) return i ; | |
| -- Bleu score: 0.686506510365 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: if ( start == b [ i ] ) { | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v ( a , a , a ) ; | |
| -- Bleu score: 0.233568988864 | |
| line 1:4 token recognition error at: '',a);' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 0 ; i ++ ) { | |
| -- Bleu score: 0.623596349341 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: string :: x x = string ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 0 ; i ++ ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , j = j ; | |
| -- Bleu score: 0.222298495521 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: 10 < int > :: s s [ 10 ] = 10 ; | |
| -- Bleu score: 0.278246232884 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt % 2 == 0 ) | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 20:14:11 [INFO] evaluation: sentence level bleu: 0.812338 | |
| 07/21/2020 20:14:11 [INFO] evaluation: accuracy: 0.586592 | |
| 07/21/2020 20:14:11 [INFO] evaluation: oracle bleu: 0.878531 | |
| 07/21/2020 20:14:11 [INFO] evaluation: oracle accuracy: 0.737430 | |
| 07/21/2020 20:14:11 [INFO] learner: avg. example bleu: 0.812338 | |
| 07/21/2020 20:14:11 [INFO] learner: accuracy: 0.586592 | |
| 07/21/2020 20:14:11 [INFO] learner: save current best model | |
| 07/21/2020 20:14:11 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 20:14:11 [INFO] model: save model to [runs/model.iter4480] | |
| 07/21/2020 20:15:06 [INFO] learner: [Epoch 30] cumulative loss = 0.652104, (took 708s) | |
| Epoch 31, eta 220s | |
| 07/21/2020 20:18:17 [INFO] learner: [Epoch 31] cumulative loss = 0.612194, (took 191s) | |
| Epoch 32, eta 153s | |
| 07/21/2020 20:20:15 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y << 2 ; | |
| -- Bleu score: 0.506266712158 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string maxn [ maxn ] = 105 ; | |
| -- Bleu score: 0.204480073602 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] == false ) { | |
| -- Bleu score: 0.39125480017 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x ( int y , int v ) { | |
| -- Bleu score: 0.218341772142 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = max ( num , y ) ; | |
| -- Bleu score: 0.464227743505 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 0.473987850117 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = ans ; | |
| -- Bleu score: 0.32559641262 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( n - 2 , n ) ; | |
| -- Bleu score: 0.554305812616 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && 0 == 0 ) return 0 ; | |
| -- Bleu score: 0.500871842892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp . begin ( n ) ; | |
| -- Bleu score: 0.227527483009 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted ) ; | |
| -- Bleu score: 0.196434900024 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.359859023442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = arr + i ; | |
| -- Bleu score: 0.0467882203103 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] < i ) ans += arr [ i ] ; | |
| -- Bleu score: 0.330569928209 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: long int i = k , l = k , l = n , b = 0 , a = 0 , a = 0 ; | |
| -- Bleu score: 0.146872986957 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c = 105 ; | |
| -- Bleu score: 0.371842143508 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 0.22230037855 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: a v = vector ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 3 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 4 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 5 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 6 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 7 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 10 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = 11 ; | |
| -- Bleu score: 0.487683663869 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.385385691803 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ n ] << endl ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k += one ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ n ] [ 1 ] ; } | |
| -- Bleu score: 0.582503601937 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == false ) { | |
| -- Bleu score: 0.880662667728 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ x ] = graph [ x ] [ x ] = 1 ; | |
| -- Bleu score: 0.688836505347 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = 0 , k = k ; | |
| -- Bleu score: 0.249032863885 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( s ) ; | |
| -- Bleu score: 0.027402118999 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: else | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 20:26:24 [INFO] evaluation: sentence level bleu: 0.792467 | |
| 07/21/2020 20:26:24 [INFO] evaluation: accuracy: 0.558659 | |
| 07/21/2020 20:26:24 [INFO] evaluation: oracle bleu: 0.877443 | |
| 07/21/2020 20:26:24 [INFO] evaluation: oracle accuracy: 0.731844 | |
| 07/21/2020 20:26:24 [INFO] learner: avg. example bleu: 0.792467 | |
| 07/21/2020 20:26:24 [INFO] learner: accuracy: 0.558659 | |
| 07/21/2020 20:26:24 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 20:26:24 [INFO] model: save model to [runs/model.iter4760] | |
| 07/21/2020 20:27:40 [INFO] learner: [Epoch 32] cumulative loss = 0.668495, (took 562s) | |
| Epoch 33, eta 114s | |
| 07/21/2020 20:30:46 [INFO] learner: [Epoch 33] cumulative loss = 0.600628, (took 186s) | |
| Epoch 34, eta 182s | |
| 07/21/2020 20:32:32 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x / y << 2 << ( x - 2 ) / y << endl ; | |
| -- Bleu score: 0.209734257913 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] != 0 && G1 [ cur ] [ i ] == false ) { | |
| -- Bleu score: 0.576732931446 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = max ( num , y ) ; | |
| -- Bleu score: 0.464227743505 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = j ; | |
| -- Bleu score: 0.265848357667 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { cin >> add [ i ] ; } | |
| -- Bleu score: 0.62659369632 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 1 ) return 1 ; | |
| -- Bleu score: 0.531696715333 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = - 1 ; | |
| -- Bleu score: 0.0992742341294 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( ( prev + casted - 1e9 ) % casted ) * casted ) % 1e9 ; | |
| -- Bleu score: 0.131369745483 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! res [ casted ] ; | |
| -- Bleu score: 0.143900224297 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , m = 0 , arr = 0 , a = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.274745583422 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i + 1 ] ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| line 1:6 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , k = 0 , l = 0 , l = 0 , l = 0 , a = 0 , a = 0 , a = 0 ; | |
| -- Bleu score: 0.0932059611377 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.519424734679 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start != a [ i ] ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: string :: x x = string ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { by += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] != 1 && vis [ i ] == 1 ) { | |
| -- Bleu score: 0.783987434308 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j ; | |
| -- Bleu score: 0.326017547728 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( i , 8 ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] != 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] != 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt ) | |
| -- Bleu score: 0.42888194248 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 20:38:28 [INFO] evaluation: sentence level bleu: 0.816418 | |
| 07/21/2020 20:38:28 [INFO] evaluation: accuracy: 0.586592 | |
| 07/21/2020 20:38:28 [INFO] evaluation: oracle bleu: 0.890239 | |
| 07/21/2020 20:38:28 [INFO] evaluation: oracle accuracy: 0.748603 | |
| 07/21/2020 20:38:28 [INFO] learner: avg. example bleu: 0.816418 | |
| 07/21/2020 20:38:28 [INFO] learner: accuracy: 0.586592 | |
| 07/21/2020 20:38:28 [INFO] learner: save current best model | |
| 07/21/2020 20:38:28 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 20:38:28 [INFO] model: save model to [runs/model.iter5040] | |
| 07/21/2020 20:39:50 [INFO] learner: [Epoch 34] cumulative loss = 0.507013, (took 543s) | |
| Epoch 35, eta 270s | |
| 07/21/2020 20:42:57 [INFO] learner: [Epoch 35] cumulative loss = 0.548815, (took 187s) | |
| Epoch 36, eta 205s | |
| 07/21/2020 20:44:20 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y >> y ; | |
| -- Bleu score: 0.675600077404 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] = maxn ; | |
| -- Bleu score: 0.302956354091 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 = maxn ; | |
| -- Bleu score: 0.183437781457 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] == G1 [ cur ] ) { | |
| -- Bleu score: 0.327690871486 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 0.812034170286 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( sizeof ( sizeof ( G ) ) ) ) ; | |
| -- Bleu score: 0.619802131013 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = n ; | |
| -- Bleu score: 0.432422707546 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: continue ; | |
| -- Bleu score: 9.37711731043e-05 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 2 ; | |
| -- Bleu score: 0.0336079015425 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( res % casted , casted ) ; | |
| -- Bleu score: 0.243841831934 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , a = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) arr [ i ] = ans ; | |
| -- Bleu score: 0.591399491864 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = j , m = k , n = n , b = b , b = b , b = b ; | |
| -- Bleu score: 0.136892459911 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 0.6592406302 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v ( a ) ; | |
| -- Bleu score: 0.203007276128 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ n ] << endl ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] ; } | |
| -- Bleu score: 0.612144016882 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 1 ) { | |
| -- Bleu score: 0.880662667728 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , k = j , k = k ; | |
| -- Bleu score: 0.265181229805 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( cin ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << '\n' ; | |
| -- Bleu score: 0.75062385375 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 20:50:21 [INFO] evaluation: sentence level bleu: 0.800149 | |
| 07/21/2020 20:50:21 [INFO] evaluation: accuracy: 0.564246 | |
| 07/21/2020 20:50:21 [INFO] evaluation: oracle bleu: 0.882584 | |
| 07/21/2020 20:50:21 [INFO] evaluation: oracle accuracy: 0.759777 | |
| 07/21/2020 20:50:21 [INFO] learner: avg. example bleu: 0.800149 | |
| 07/21/2020 20:50:21 [INFO] learner: accuracy: 0.564246 | |
| 07/21/2020 20:50:21 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 20:50:21 [INFO] model: save model to [runs/model.iter5320] | |
| 07/21/2020 20:52:17 [INFO] learner: [Epoch 36] cumulative loss = 0.546076, (took 559s) | |
| Epoch 37, eta 186s | |
| 07/21/2020 20:55:25 [INFO] learner: [Epoch 37] cumulative loss = 0.560912, (took 187s) | |
| Epoch 38, eta 216s | |
| 07/21/2020 20:56:33 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] = maxn ; | |
| -- Bleu score: 0.302956354091 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: const int G1 = maxn ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum ; | |
| -- Bleu score: 0.451801001805 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( ! vis [ vis [ i ] ] && G1 [ cur ] != 0 ) { | |
| -- Bleu score: 0.743684287016 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] != - 1 ) { lsum += G [ G [ cur ] [ 1 ] ] [ cur ] ; } | |
| -- Bleu score: 0.612814717251 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: string :: string a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.476310091477 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = n ; | |
| -- Bleu score: 0.432422707546 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i <= n - 2 ; i ++ ) { cin >> n >> n ; } | |
| -- Bleu score: 0.446771028312 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n ) ; | |
| -- Bleu score: 0.244703854087 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( res * res ) % 1e9 ) % int ( casted + 1e9 ) ; | |
| -- Bleu score: 0.207452714498 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return ! result ; | |
| -- Bleu score: 0.0887244425356 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , m = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.377543239992 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( i - 1 ) / m ; | |
| -- Bleu score: 0.259420198388 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans = arr ( i ) ; | |
| -- Bleu score: 0.484511279432 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return is ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v . size ( a ) ; | |
| -- Bleu score: 0.208731763287 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = 1 ; | |
| -- Bleu score: 0.249487848424 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] >= x ) { | |
| -- Bleu score: 0.701687939128 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { k += m [ u ] [ 1 ] ; } | |
| -- Bleu score: 0.627251733901 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = 1 ; | |
| -- Bleu score: 0.434576689987 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:20 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = | |
| -- Bleu score: 0.302664372669 | |
| line 1:20 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 21:02:13 [INFO] evaluation: sentence level bleu: 0.810068 | |
| 07/21/2020 21:02:13 [INFO] evaluation: accuracy: 0.575419 | |
| 07/21/2020 21:02:13 [INFO] evaluation: oracle bleu: 0.885413 | |
| 07/21/2020 21:02:13 [INFO] evaluation: oracle accuracy: 0.748603 | |
| 07/21/2020 21:02:13 [INFO] learner: avg. example bleu: 0.810068 | |
| 07/21/2020 21:02:13 [INFO] learner: accuracy: 0.575419 | |
| 07/21/2020 21:02:13 [INFO] learner: hitting patience_counter: 2 | |
| 07/21/2020 21:02:13 [INFO] model: save model to [runs/model.iter5600] | |
| 07/21/2020 21:04:17 [INFO] learner: [Epoch 38] cumulative loss = 0.473774, (took 532s) | |
| Epoch 39, eta 248s | |
| 07/21/2020 21:07:27 [INFO] learner: [Epoch 39] cumulative loss = 0.481285, (took 190s) | |
| Epoch 40, eta 129s | |
| 07/21/2020 21:08:20 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ vis [ i ] ] == 0 && G1 [ cur ] == 0 ) { | |
| -- Bleu score: 0.421689091381 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] != - 1 ) { lsum += G [ G [ cur ] ] [ 1 ] ; } | |
| -- Bleu score: 0.679772564481 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num . clear ( x ) ; | |
| -- Bleu score: 0.118357647361 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: bool res [ n ] = n ; | |
| -- Bleu score: 0.0449940753748 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * casted ) % 1e9 ; | |
| -- Bleu score: 0.0336079015425 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = res % n ; | |
| -- Bleu score: 0.335521593027 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , arr = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: ''\n;' | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: continue ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x = string ; | |
| -- Bleu score: 0.508132748155 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] [ i ] >= x ) { | |
| -- Bleu score: 0.531696715333 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 1 ) { | |
| -- Bleu score: 0.880662667728 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ y ] = 1 ; | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = j ; | |
| -- Bleu score: 0.265181229805 | |
| line 1:20 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 21:14:45 [INFO] evaluation: sentence level bleu: 0.821918 | |
| 07/21/2020 21:14:45 [INFO] evaluation: accuracy: 0.597765 | |
| 07/21/2020 21:14:45 [INFO] evaluation: oracle bleu: 0.884712 | |
| 07/21/2020 21:14:45 [INFO] evaluation: oracle accuracy: 0.759777 | |
| 07/21/2020 21:14:45 [INFO] learner: avg. example bleu: 0.821918 | |
| 07/21/2020 21:14:45 [INFO] learner: accuracy: 0.597765 | |
| 07/21/2020 21:14:45 [INFO] learner: save current best model | |
| 07/21/2020 21:14:45 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 21:14:45 [INFO] model: save model to [runs/model.iter5880] | |
| 07/21/2020 21:17:06 [INFO] learner: [Epoch 40] cumulative loss = 0.402153, (took 578s) | |
| Epoch 41, eta 188s | |
| 07/21/2020 21:20:18 [INFO] learner: [Epoch 41] cumulative loss = 0.439662, (took 191s) | |
| Epoch 42, eta 237s | |
| 07/21/2020 21:20:55 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 13/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: vis vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] != 0 ) { | |
| -- Bleu score: 0.513520187164 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] != - 1 ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 0.812034170286 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , - 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , - 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , num ( num , y ) ) ; | |
| -- Bleu score: 0.457883137213 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( n - 2 , n ) ; | |
| -- Bleu score: 0.554305812616 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| line 1:24 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 1 ) return from ; | |
| -- Bleu score: 0.416075165222 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n ) ; | |
| -- Bleu score: 0.339379153632 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( res % casted , casted ) ; | |
| -- Bleu score: 0.22692039365 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 , arr = 0 , arr = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.292705712156 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , l = m , l = m , a = b , b = b , b = b ; | |
| -- Bleu score: 0.158069797159 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ 1 ] ) return a ; | |
| -- Bleu score: 0.698450232079 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: continue ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] <= v [ i ] ) { | |
| -- Bleu score: 0.478554392109 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = k ; | |
| -- Bleu score: 0.275600167872 | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: string :: s s [ 10 ] = 10 ; | |
| -- Bleu score: 0.381633091137 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 8 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: else | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 21:27:13 [INFO] evaluation: sentence level bleu: 0.817414 | |
| 07/21/2020 21:27:13 [INFO] evaluation: accuracy: 0.620112 | |
| 07/21/2020 21:27:13 [INFO] evaluation: oracle bleu: 0.889673 | |
| 07/21/2020 21:27:13 [INFO] evaluation: oracle accuracy: 0.754190 | |
| 07/21/2020 21:27:13 [INFO] learner: avg. example bleu: 0.817414 | |
| 07/21/2020 21:27:13 [INFO] learner: accuracy: 0.620112 | |
| 07/21/2020 21:27:13 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 21:27:13 [INFO] model: save model to [runs/model.iter6160] | |
| 07/21/2020 21:29:44 [INFO] learner: [Epoch 42] cumulative loss = 0.417788, (took 565s) | |
| Epoch 43, eta 266s | |
| 07/21/2020 21:32:59 [INFO] learner: [Epoch 43] cumulative loss = 0.411286, (took 195s) | |
| Epoch 44, eta 136s | |
| 07/21/2020 21:33:16 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << ( x * y ) * y / 2 << endl ; | |
| -- Bleu score: 0.570282226441 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( x , y ) ; | |
| -- Bleu score: 0.366595791718 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , b ) ; | |
| -- Bleu score: 0.58228940089 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: void add ( int n , int x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < 2 ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.32672940262 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << / div << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 0.803154665668 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( ! res ) res . size ( n ) ; | |
| -- Bleu score: 0.0992873306835 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.164005635128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % int ( 2 + 2 ) ; | |
| -- Bleu score: 0.798579504581 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , a = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.31243257276 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: '';' | |
| line 1:6 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v . clear ( a ) ; | |
| -- Bleu score: 0.208731763287 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 2 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 3 + _STR : 0_ ] = 3 ; | |
| -- Bleu score: 0.310201619701 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 4 + _STR : 0_ ] = 4 ; | |
| -- Bleu score: 0.310201619701 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 5 + _STR : 0_ ] = 5 ; | |
| -- Bleu score: 0.310201619701 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 6 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 7 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 9 + _STR : 0_ ] = 9 ; | |
| -- Bleu score: 0.310201619701 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 10 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 11 + _STR : 0_ ] = 11 ; | |
| -- Bleu score: 0.310201619701 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { m += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 1 ) { | |
| -- Bleu score: 0.880662667728 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return the ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = k = 0 ; | |
| -- Bleu score: 0.614788152951 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , k = k . k ( j ) , k = j , k = j ; | |
| -- Bleu score: 0.151683443288 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 21:39:43 [INFO] evaluation: sentence level bleu: 0.807114 | |
| 07/21/2020 21:39:43 [INFO] evaluation: accuracy: 0.597765 | |
| 07/21/2020 21:39:43 [INFO] evaluation: oracle bleu: 0.881629 | |
| 07/21/2020 21:39:43 [INFO] evaluation: oracle accuracy: 0.743017 | |
| 07/21/2020 21:39:43 [INFO] learner: avg. example bleu: 0.807114 | |
| 07/21/2020 21:39:43 [INFO] learner: accuracy: 0.597765 | |
| 07/21/2020 21:39:43 [INFO] learner: hitting patience_counter: 2 | |
| 07/21/2020 21:39:43 [INFO] model: save model to [runs/model.iter6440] | |
| 07/21/2020 21:42:36 [INFO] learner: [Epoch 44] cumulative loss = 0.393301, (took 576s) | |
| Epoch 45, eta 235s | |
| 07/21/2020 21:45:45 [INFO] learner: [Epoch 45] cumulative loss = 0.407518, (took 189s) | |
| Epoch 4607/21/2020 21:45:50 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] != 0 ) { | |
| -- Bleu score: 0.346078637375 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , - 1 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 0.699752229822 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: string :: string a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.476310091477 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p -> n == 1 ) return n ; | |
| -- Bleu score: 0.634046627705 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = - fp ; | |
| -- Bleu score: 0.102644227849 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( res % int ( 1e9 + 1e9 ) ) * ( res % int ( 1e9 + 1e9 ) ) ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.766910511098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted , casted ) ; | |
| -- Bleu score: 0.186758738964 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , arr = 0 , arr = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i + 1 ] ) { | |
| -- Bleu score: 0.815355103817 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i - 1 ] ) / m ; | |
| -- Bleu score: 0.813748937097 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.182502172653 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''\n;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: v . size ( a ) ; | |
| -- Bleu score: 0.208731763287 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 7 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 8 + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.503174762653 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: string :: x x = string ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , y = z , z = z ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , j = k , k = 0 ; | |
| -- Bleu score: 0.184589581997 | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 0 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] ) { | |
| -- Bleu score: 0.430044243237 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] == 'B' ) { | |
| -- Bleu score: 0.669404828519 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] ) { | |
| -- Bleu score: 0.723062061481 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 21:52:42 [INFO] evaluation: sentence level bleu: 0.833069 | |
| 07/21/2020 21:52:42 [INFO] evaluation: accuracy: 0.625698 | |
| 07/21/2020 21:52:42 [INFO] evaluation: oracle bleu: 0.892456 | |
| 07/21/2020 21:52:42 [INFO] evaluation: oracle accuracy: 0.759777 | |
| 07/21/2020 21:52:42 [INFO] learner: avg. example bleu: 0.833069 | |
| 07/21/2020 21:52:42 [INFO] learner: accuracy: 0.625698 | |
| 07/21/2020 21:52:42 [INFO] learner: save current best model | |
| 07/21/2020 21:52:42 [INFO] model: save model to [runs/model.npz] | |
| 07/21/2020 21:52:42 [INFO] model: save model to [runs/model.iter6720] | |
| , eta 12176s | |
| 07/21/2020 21:55:54 [INFO] learner: [Epoch 46] cumulative loss = 0.385314, (took 609s) | |
| Epoch 47, eta 150s | |
| 07/21/2020 21:58:53 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: const int G1 = maxn ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string maxn [ maxn ] = maxn ; | |
| -- Bleu score: 0.204480073602 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: int dfs ( int cur , int n ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] != 0 && G1 [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.530071451292 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( arguments , 1 ) ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: long a [ 105 ] = 105 , b [ 105 ] = 105 ; | |
| -- Bleu score: 0.468924388821 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i <= n - 2 ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.353415664212 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 0 ) return 0 ; | |
| -- Bleu score: 0.529607493341 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = - 1 ; | |
| -- Bleu score: 0.0992742341294 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.164005635128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted % casted , casted ) ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , a = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , c [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.426621966239 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ i ] ) break ; | |
| -- Bleu score: 0.686589047969 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ i ] ) break ; | |
| -- Bleu score: 0.686589047969 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z + 1 ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ u ] [ 1 ] ; } | |
| -- Bleu score: 0.627251733901 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| line 1:20 token recognition error at: '';}' | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = 0 , k = k ; | |
| -- Bleu score: 0.249032863885 | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = 10 ; | |
| -- Bleu score: 0.467137977728 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( i , 0 ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 && cnt == 0 ) | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 22:05:11 [INFO] evaluation: sentence level bleu: 0.823085 | |
| 07/21/2020 22:05:11 [INFO] evaluation: accuracy: 0.614525 | |
| 07/21/2020 22:05:11 [INFO] evaluation: oracle bleu: 0.887653 | |
| 07/21/2020 22:05:11 [INFO] evaluation: oracle accuracy: 0.748603 | |
| 07/21/2020 22:05:11 [INFO] learner: avg. example bleu: 0.823085 | |
| 07/21/2020 22:05:11 [INFO] learner: accuracy: 0.614525 | |
| 07/21/2020 22:05:11 [INFO] learner: hitting patience_counter: 1 | |
| 07/21/2020 22:05:11 [INFO] model: save model to [runs/model.iter7000] | |
| 07/21/2020 22:05:23 [INFO] learner: [Epoch 47] cumulative loss = 0.419827, (took 568s) | |
| Epoch 48, eta 188s | |
| 07/21/2020 22:08:36 [INFO] learner: [Epoch 48] cumulative loss = 0.352663, (took 193s) | |
| Epoch 49, eta 316s | |
| 07/21/2020 22:11:14 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 13/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string vis [ maxn ] = size ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ cur ] [ i ] == 0 ) { | |
| -- Bleu score: 0.512837036485 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y ( v ) , v = v ; | |
| -- Bleu score: 0.195647514979 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) cin >> add [ i ] >> add [ i ] ; | |
| -- Bleu score: 0.552725109191 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 1 ) return 0 ; | |
| -- Bleu score: 0.416075165222 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n ) ; | |
| -- Bleu score: 0.339379153632 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( res % casted , casted ) ; | |
| -- Bleu score: 0.22692039365 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , m = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.31243257276 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += ans , ans ++ ; | |
| -- Bleu score: 0.889526035636 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| line 1:26 token recognition error at: '',a=n,a=p,a=p,a=p,a=p;' | |
| line 1:26 token recognition error at: '',a=n,a=p,a=p,p=p,a=p;' | |
| line 1:26 token recognition error at: '',a=n,a=p,a=p,a=p,a=p;' | |
| line 1:26 token recognition error at: '',a=n,a=p,a=p,p=p,a=p;' | |
| line 1:26 token recognition error at: '',a=n,a=p,p=p,a=p,a=p;' | |
| line 1:26 token recognition error at: '',a=n,a=p,p=p,p=p,a=p;' | |
| line 1:30 token recognition error at: '',a=n,a=p,a=p,p=p,p=p,a=p;' | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = sizeof ( 105 ) ; | |
| -- Bleu score: 0.396451325342 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) { | |
| -- Bleu score: 0.728954518363 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == b [ 1 ] ) return a ; | |
| -- Bleu score: 0.698450232079 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: if ( v -> v == a ) v ++ ; | |
| -- Bleu score: 0.143231450794 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i + 1 ] << endl ; | |
| -- Bleu score: 0.545246911963 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , y = z , z = z ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , k = k , k = k ; | |
| -- Bleu score: 0.265181229805 | |
| line 1:20 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.367205626989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( i , 0 ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 22:17:46 [INFO] evaluation: sentence level bleu: 0.825046 | |
| 07/21/2020 22:17:46 [INFO] evaluation: accuracy: 0.608939 | |
| 07/21/2020 22:17:46 [INFO] evaluation: oracle bleu: 0.887748 | |
| 07/21/2020 22:17:46 [INFO] evaluation: oracle accuracy: 0.748603 | |
| 07/21/2020 22:17:46 [INFO] learner: avg. example bleu: 0.825046 | |
| 07/21/2020 22:17:46 [INFO] learner: accuracy: 0.608939 | |
| 07/21/2020 22:17:46 [INFO] learner: hitting patience_counter: 2 | |
| 07/21/2020 22:17:46 [INFO] model: save model to [runs/model.iter7280] | |
| 07/21/2020 22:18:15 [INFO] learner: [Epoch 49] cumulative loss = 0.387536, (took 578s) | |
| Epoch 50, eta 163s | |
| 07/21/2020 22:21:24 [INFO] learner: [Epoch 50] cumulative loss = 0.349801, (took 188s) | |
| Epoch 51, eta 176s | |
| 07/21/2020 22:23:44 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 10/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ cur ] [ i ] == 0 ) { | |
| -- Bleu score: 0.512837036485 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) lsum += G [ cur ] [ 1 ] ; | |
| -- Bleu score: 0.759083744418 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , y = v , v = v ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , num ( num , false ) ) ; | |
| -- Bleu score: 0.278824109792 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: string :: string b [ 105 ] = 105 , b [ 105 ] = sizeof ( b ) ; | |
| -- Bleu score: 0.299451606232 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , j = n , ans = n ; | |
| -- Bleu score: 0.432422707546 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:31 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long p , long long p ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = ( fp % n ) % int ( n ) ; | |
| -- Bleu score: 0.326798433675 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( ( res % int ( 1e9 + 1e9 ) ) * ( res % int ( 1e9 + 1e9 ) ) ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.766910511098 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( res % casted , res . size ( casted ) ) ; | |
| -- Bleu score: 0.15911783111 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , a = 0 , a = 0 , ans = 0 , ans = 0 ; | |
| -- Bleu score: 0.298179216068 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] [ i ] ; | |
| -- Bleu score: 0.678650268159 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] == false ) ans += ans ; | |
| -- Bleu score: 0.207731428099 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , m = k , l = k , m = k , l = m , p = k , a = 0 , a = 0 , a = 0 , a = 0 , a = 0 , a = 0 , a = 0 ; | |
| -- Bleu score: 0.0784851214504 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return is ++ ; | |
| -- Bleu score: 0.819322885719 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: string v = vector ; | |
| -- Bleu score: 0.205045722362 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ z % n ] << endl ; | |
| -- Bleu score: 0.734888920087 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { n += m [ 1 ] [ n ] ; } | |
| -- Bleu score: 0.688836505347 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z ; | |
| -- Bleu score: 0.343294523985 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = k , j = k , k = k ; | |
| -- Bleu score: 0.239618290571 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: bool s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.367205626989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 ; | |
| -- Bleu score: 0.406014552256 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 22:30:48 [INFO] evaluation: sentence level bleu: 0.830597 | |
| 07/21/2020 22:30:48 [INFO] evaluation: accuracy: 0.625698 | |
| 07/21/2020 22:30:48 [INFO] evaluation: oracle bleu: 0.895309 | |
| 07/21/2020 22:30:48 [INFO] evaluation: oracle accuracy: 0.765363 | |
| 07/21/2020 22:30:48 [INFO] learner: avg. example bleu: 0.830597 | |
| 07/21/2020 22:30:48 [INFO] learner: accuracy: 0.625698 | |
| 07/21/2020 22:30:48 [INFO] learner: hitting patience_counter: 3 | |
| 07/21/2020 22:30:48 [INFO] model: save model to [runs/model.iter7560] | |
| 07/21/2020 22:31:36 [INFO] learner: [Epoch 51] cumulative loss = 0.316062, (took 612s) | |
| Epoch 52, eta 140s | |
| 07/21/2020 22:34:43 [INFO] learner: [Epoch 52] cumulative loss = 0.348067, (took 186s) | |
| Epoch 53, eta 170s | |
| 07/21/2020 22:36:49 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 14/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn = 100 ; | |
| -- Bleu score: 0.818730753078 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] = maxn ; | |
| -- Bleu score: 0.302956354091 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 = maxn ; | |
| -- Bleu score: 0.183437781457 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string maxn [ maxn ] = 105 ; | |
| -- Bleu score: 0.204480073602 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ cur ] == G1 [ i ] ) { | |
| -- Bleu score: 0.437697129929 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y ( y , y ) , v = v , v = v ; | |
| -- Bleu score: 0.150716762575 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , num ( num , y ) ) ; | |
| -- Bleu score: 0.457883137213 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.499924859897 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ fp . begin ( n ) ] = fp ( n , n ) ; | |
| -- Bleu score: 0.322884568546 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( res % casted , casted ) ; | |
| -- Bleu score: 0.243841831934 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , a = 0 , a = 0 , ans [ 0 ] = 0 ; | |
| -- Bleu score: 0.183633508608 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] == arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.349692064893 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = 105 , c [ 105 ] = 105 ; | |
| -- Bleu score: 0.46096034935 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x ; | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == m [ 1 ] [ u ] ) { n += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.53540631839 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 0 && vis [ i ] == 0 ) { | |
| -- Bleu score: 0.865603055254 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , y = z , z = z ; | |
| -- Bleu score: 0.211421417143 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = 0 , j = k , k = k . k ( j ) ; | |
| -- Bleu score: 0.143453343714 | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.367205626989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( cin ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] == 'B' ) { | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 22:43:10 [INFO] evaluation: sentence level bleu: 0.804699 | |
| 07/21/2020 22:43:10 [INFO] evaluation: accuracy: 0.575419 | |
| 07/21/2020 22:43:10 [INFO] evaluation: oracle bleu: 0.876509 | |
| 07/21/2020 22:43:10 [INFO] evaluation: oracle accuracy: 0.731844 | |
| 07/21/2020 22:43:10 [INFO] learner: avg. example bleu: 0.804699 | |
| 07/21/2020 22:43:10 [INFO] learner: accuracy: 0.575419 | |
| 07/21/2020 22:43:10 [INFO] learner: hitting patience_counter: 4 | |
| 07/21/2020 22:43:10 [INFO] model: save model to [runs/model.iter7840] | |
| 07/21/2020 22:44:11 [INFO] learner: [Epoch 53] cumulative loss = 0.323964, (took 567s) | |
| Epoch 54, eta 156s | |
| 07/21/2020 22:47:18 [INFO] learner: [Epoch 54] cumulative loss = 0.403668, (took 187s) | |
| Epoch 55, eta 222s | |
| 07/21/2020 22:49:17 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 7/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: int maxn ( int maxn ) = 100 ; | |
| -- Bleu score: 0.312393993692 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string maxn [ maxn ] = maxn ; | |
| -- Bleu score: 0.204480073602 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ( num ) ; | |
| -- Bleu score: 0.354948105601 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.352126757432 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y ( y , v ) , v = v , v = v ; | |
| -- Bleu score: 0.171247304489 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: x = min ( num , y ) ; | |
| -- Bleu score: 0.242938534517 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: string :: string a [ 105 ] = 105 , b [ 105 ] = sizeof ( b ) ; | |
| -- Bleu score: 0.402767204637 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == 0 ) return b ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.512457672125 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 ) return 0 ; | |
| -- Bleu score: 0.782542290037 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res [ n ] = - fp ; | |
| -- Bleu score: 0.102644227849 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.164005635128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted , 0 ) ; | |
| -- Bleu score: 0.186758738964 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 , arr = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.307089876126 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:42 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , l = n , l = n , l = n , l = 0 , a = ',a=' , a = ',a=' , a = | |
| -- Bleu score: 0.118118953134 | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:46 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b [ 105 ] = - 105 , c [ 105 ] = - 105 ; | |
| -- Bleu score: 0.415846866005 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: if ( v -> v == v [ a ] ) v ++ ; | |
| -- Bleu score: 0.11114924776 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = x ; | |
| -- Bleu score: 0.472870804502 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ i ] ) { | |
| -- Bleu score: 0.562200827659 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z [ i ] = i ; | |
| -- Bleu score: 0.365555222855 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { u += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = j ; | |
| -- Bleu score: 0.265181229805 | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: s :: s s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.302664372669 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: i . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''B){' | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''B){' | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 22:56:48 [INFO] evaluation: sentence level bleu: 0.816665 | |
| 07/21/2020 22:56:48 [INFO] evaluation: accuracy: 0.608939 | |
| 07/21/2020 22:56:48 [INFO] evaluation: oracle bleu: 0.871963 | |
| 07/21/2020 22:56:48 [INFO] evaluation: oracle accuracy: 0.715084 | |
| 07/21/2020 22:56:48 [INFO] learner: avg. example bleu: 0.816665 | |
| 07/21/2020 22:56:48 [INFO] learner: accuracy: 0.608939 | |
| 07/21/2020 22:56:48 [INFO] learner: hitting patience_counter: 5 | |
| 07/21/2020 22:56:48 [INFO] model: save model to [runs/model.iter8120] | |
| 07/21/2020 22:57:55 [INFO] learner: [Epoch 55] cumulative loss = 0.325934, (took 636s) | |
| Epoch 56, eta 156s | |
| 07/21/2020 23:01:06 [INFO] learner: [Epoch 56] cumulative loss = 0.307885, (took 190s) | |
| Epoch 57, eta 196s | |
| 07/21/2020 23:02:50 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 13/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: const int G = maxn ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: const int G1 = maxn ; | |
| -- Bleu score: 0.200347043294 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: int vis [ maxn ] = maxn ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.360012103794 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ i ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v ( v ) , v = v ; | |
| -- Bleu score: 0.222298495521 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = num ( num , ) ) ; | |
| -- Bleu score: 0.242938534517 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: return a -- ; | |
| -- Bleu score: 0.0742513480866 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| line 1:15 token recognition error at: ''<<(n-2)<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && 0 == 0 ) return 0 ; | |
| -- Bleu score: 0.500871842892 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n ) % p / 2 ; | |
| -- Bleu score: 0.467569108862 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % 1e9 ; | |
| -- Bleu score: 0.0344183120311 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = ( res * n ) % 2 ; | |
| -- Bleu score: 0.647036944757 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( casted , res [ casted ] ) ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , a = 0 , a = 0 , a = 0 , a = 0 ; | |
| -- Bleu score: 0.182160417315 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += ans , ans ++ ; | |
| -- Bleu score: 0.889526035636 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| line 1:6 token recognition error at: ''<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: else | |
| -- Bleu score: 0 | |
| line 1:42 token recognition error at: '';' | |
| line 1:42 token recognition error at: '';' | |
| line 1:38 token recognition error at: '',a=b;' | |
| line 1:38 token recognition error at: '',a=b;' | |
| line 1:38 token recognition error at: '',a=b;' | |
| line 1:42 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a [ 105 ] = 105 , c [ 105 ] = sizeof ( 105 ) , c [ 105 ] = sizeof ( 105 ) ; | |
| -- Bleu score: 0.333364906465 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ 1 ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.698450232079 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ 1 ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.698450232079 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ 1 + _STR : 0_ ] [ 1 ] = _STR : 0_ ; | |
| -- Bleu score: 0.463664591999 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 3 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 4 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 5 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 6 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 7 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 8 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 9 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 10 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] [ 11 ] = _STR : 0_ ; | |
| -- Bleu score: 0.563519009808 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: int x = string ; | |
| -- Bleu score: 0.427287006396 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ n + i ] << endl ; | |
| -- Bleu score: 0.558394826472 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { u += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = 0 , k = k ; | |
| -- Bleu score: 0.249032863885 | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: int s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.367205626989 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: s . clear ( i ) ; | |
| -- Bleu score: 0.0341064846013 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) | |
| -- Bleu score: 0.606530659713 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: else | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 23:09:23 [INFO] evaluation: sentence level bleu: 0.814636 | |
| 07/21/2020 23:09:23 [INFO] evaluation: accuracy: 0.631285 | |
| 07/21/2020 23:09:23 [INFO] evaluation: oracle bleu: 0.860501 | |
| 07/21/2020 23:09:23 [INFO] evaluation: oracle accuracy: 0.692737 | |
| 07/21/2020 23:09:23 [INFO] learner: avg. example bleu: 0.814636 | |
| 07/21/2020 23:09:23 [INFO] learner: accuracy: 0.631285 | |
| 07/21/2020 23:09:23 [INFO] learner: hitting patience_counter: 6 | |
| 07/21/2020 23:09:23 [INFO] model: save model to [runs/model.iter8400] | |
| 07/21/2020 23:10:52 [INFO] learner: [Epoch 57] cumulative loss = 0.305733, (took 586s) | |
| Epoch 58, eta 147s | |
| 07/21/2020 23:14:00 [INFO] learner: [Epoch 58] cumulative loss = 0.278183, (took 188s) | |
| Epoch 59, eta 182s | |
| 07/21/2020 23:15:25 [INFO] learner: begin validation | |
| Decoder hit the max time step before completing desired number of ASTs. Generated: 6/15 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = false ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: string maxn [ maxn ] = false ; | |
| -- Bleu score: 0.204480073602 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] [ i ] == 0 ) { | |
| -- Bleu score: 0.360012103794 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] == - 1 ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 0.812034170286 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v = v , v = v ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num . push_back ( num ) ; | |
| -- Bleu score: 0.118357647361 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = n ; | |
| -- Bleu score: 0.405258769721 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| line 1:32 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( int i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.512457672125 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| line 1:54 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 0 ) return 0 ; | |
| -- Bleu score: 0.529607493341 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp ( n , n ) ; | |
| -- Bleu score: 0.339379153632 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % int ( 1e9 + 1 ) ; | |
| -- Bleu score: 0.161380697981 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 == 0 ) res ++ ; | |
| -- Bleu score: 0.194704718295 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return res ( result , casted ) ; | |
| -- Bleu score: 0.216321187876 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 0 , arr = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.307089876126 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , l = k , l = l , m = o , p = 0 , p = 0 , o = o , p = o ; | |
| -- Bleu score: 0.15082713743 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return is ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 0.0229450495376 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 0.629082766779 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: string :: x x = string ; | |
| -- Bleu score: 0.330316431801 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == x ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ i ] << endl ; | |
| -- Bleu score: 0.526914843589 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { u += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; ++ i ) { | |
| -- Bleu score: 0.793076857583 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = k ; | |
| -- Bleu score: 0.275600167872 | |
| line 1:20 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| line 1:20 token recognition error at: '';' | |
| line 1:24 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: s :: s s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.302664372669 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , 0 ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , flag = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << '\n' ; | |
| -- Bleu score: 0.75062385375 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 23:24:10 [INFO] evaluation: sentence level bleu: 0.818338 | |
| 07/21/2020 23:24:10 [INFO] evaluation: accuracy: 0.620112 | |
| 07/21/2020 23:24:10 [INFO] evaluation: oracle bleu: 0.874718 | |
| 07/21/2020 23:24:10 [INFO] evaluation: oracle accuracy: 0.743017 | |
| 07/21/2020 23:24:10 [INFO] learner: avg. example bleu: 0.818338 | |
| 07/21/2020 23:24:10 [INFO] learner: accuracy: 0.620112 | |
| 07/21/2020 23:24:10 [INFO] learner: hitting patience_counter: 7 | |
| 07/21/2020 23:24:10 [INFO] model: save model to [runs/model.iter8680] | |
| 07/21/2020 23:26:22 [INFO] learner: [Epoch 59] cumulative loss = 0.311943, (took 741s) | |
| Epoch 60, eta 189s | |
| 07/21/2020 23:30:08 [INFO] learner: [Epoch 60] cumulative loss = 0.348496, (took 225s) | |
| Epoch 61, eta 111s | |
| 07/21/2020 23:31:23 [INFO] learner: begin validation | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y ; | |
| -- Predicted tokens: int x = y , y = y , y = y ; | |
| -- Bleu score: 0.177783511783 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y ; | |
| -- Predicted tokens: cin >> x >> y ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << x * y / 2 << endl ; | |
| -- Predicted tokens: cout << x * y / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: const int maxn = 100 ; | |
| -- Predicted tokens: const int maxn = 100 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int maxn [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.549100486776 | |
| Calculating bleu score..... | |
| -- Reference tokens: int G1 [ maxn ] [ maxn ] ; | |
| -- Predicted tokens: int G1 [ maxn ] [ maxn ] = maxn ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ maxn ] ; | |
| -- Predicted tokens: vis < int > :: vis vis [ maxn ] = 105 ; | |
| -- Bleu score: 0.289178493323 | |
| Calculating bleu score..... | |
| -- Reference tokens: int num ; | |
| -- Predicted tokens: int num = num ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int N ; | |
| -- Predicted tokens: int N = N ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int lsum , ssum ; | |
| -- Predicted tokens: int lsum = ssum , ssum = ssum ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int cur , int n ) { | |
| -- Predicted tokens: void dfs ( int cur , int n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= num ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( ! vis [ i ] && G1 [ cur ] [ i ] != 0 ) { | |
| -- Predicted tokens: if ( vis [ i ] [ i ] == 0 && G1 [ i ] == G1 [ i ] ) { | |
| -- Bleu score: 0.338948147458 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ i ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 0.594603557501 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ i ] != 0 ) { lsum += G [ cur ] [ i ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ i ] != 0 ) lsum += G [ cur ] [ i ] ; | |
| -- Bleu score: 0.845193493176 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i , n + 1 ) ; | |
| -- Predicted tokens: dfs ( i , n + 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( n == N ) { | |
| -- Predicted tokens: if ( n == N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Predicted tokens: if ( G [ cur ] [ 1 ] ) { lsum += G [ cur ] [ 1 ] ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> N ) { | |
| -- Predicted tokens: while ( cin >> N ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Predicted tokens: memset ( G , 0 , sizeof ( G ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Predicted tokens: memset ( G1 , 0 , sizeof ( G1 ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , v ; | |
| -- Predicted tokens: int x = y , v ( v ) , v = v ; | |
| -- Bleu score: 0.222298495521 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = 0 ; | |
| -- Predicted tokens: num = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: lsum = 0 ; | |
| -- Predicted tokens: lsum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum = 0 ; | |
| -- Predicted tokens: ssum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < N ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> v ; | |
| -- Predicted tokens: cin >> x >> y >> v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G [ x ] [ y ] = v ; | |
| -- Predicted tokens: G [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ x ] [ y ] = v ; | |
| -- Predicted tokens: G1 [ x ] [ y ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: G1 [ y ] [ x ] = v ; | |
| -- Predicted tokens: G1 [ y ] [ x ] = v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ssum += v ; | |
| -- Predicted tokens: ssum += v ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: num = max ( num , max ( x , y ) ) ; | |
| -- Predicted tokens: num = min ( num , y ) ; | |
| -- Bleu score: 0.252483559808 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ 1 ] = 1 ; | |
| -- Predicted tokens: vis [ 1 ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 , 1 ) ; | |
| -- Predicted tokens: dfs ( 1 , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Predicted tokens: cout << min ( lsum , ssum - lsum ) << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: string a [ 105 ] , b [ 105 ] ; | |
| -- Predicted tokens: a ( b , 105 , sizeof ( b ) ) ; | |
| -- Bleu score: 0.136744066782 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , ans = n ; | |
| -- Predicted tokens: int i = n , ans = n , ans = ans ; | |
| -- Bleu score: 0.32559641262 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; ++ i ) { | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < i ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < i ; j ++ ) | |
| -- Bleu score: 0.824236750265 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Predicted tokens: if ( a [ i ] == a [ j ] && b [ i ] == b [ j ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans -- ; | |
| -- Predicted tokens: ans -- ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << endl ; | |
| -- Predicted tokens: cout << ans << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum ; | |
| -- Predicted tokens: int sum = sum ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int gcd ( int a , int b ) { | |
| -- Predicted tokens: int gcd ( int a , int b ) { | |
| -- Bleu score: 1.0 | |
| line 1:17 token recognition error at: '';' | |
| line 1:17 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a % b == 0 ) return b ; | |
| -- Predicted tokens: if ( a == b ) continue ; | |
| -- Bleu score: 0.243952027507 | |
| Calculating bleu score..... | |
| -- Reference tokens: return gcd ( b , a % b ) ; | |
| -- Predicted tokens: return gcd ( b , a % b ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: void add ( int n , int x ) { | |
| -- Predicted tokens: int add ( int n , int x ) { | |
| -- Bleu score: 0.893153981807 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( n != 0 ) { | |
| -- Predicted tokens: while ( n != 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += n % x ; | |
| -- Predicted tokens: sum += n % x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: n /= x ; | |
| -- Predicted tokens: n /= x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 2 ; i < n ; i ++ ) add ( n , i ) ; | |
| -- Predicted tokens: for ( i = 2 ; i < n ; i ++ ) { cin >> add [ i ] >> add [ i ] ; } | |
| -- Bleu score: 0.4396523321 | |
| Calculating bleu score..... | |
| -- Reference tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Predicted tokens: int div = gcd ( sum , n - 2 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Predicted tokens: cout << sum / div << '/' << ( n - 2 ) / div << endl ; | |
| -- Bleu score: 1.0 | |
| line 1:15 token recognition error at: ''<<(n-2)/div<<endl;' | |
| Calculating bleu score..... | |
| -- Reference tokens: long long fp ( long long n , long long p ) { | |
| -- Predicted tokens: long long fp ( long long n , long long p ) { | |
| -- Bleu score: 1.0 | |
| line 1:51 token recognition error at: '',p=p;' | |
| line 1:51 token recognition error at: '',p=p(n,p);' | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 0 ) return 1 ; | |
| -- Predicted tokens: if ( p == 0 && p == 0 ) return 0 ; | |
| -- Bleu score: 0.529607493341 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p == 1 ) return n ; | |
| -- Predicted tokens: if ( p == 1 ) return n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long res = fp ( n , p / 2 ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: long long res = fp . size ( n ) ; | |
| -- Bleu score: 0.227527483009 | |
| Calculating bleu score..... | |
| -- Reference tokens: res = ( ( res % int ( 1e9 + 7 ) ) * ( res % int ( 1e9 + 7 ) ) ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: res = ( res * res ) % int ( 1e9 + 1e9 ) ; | |
| -- Bleu score: 0.164005635128 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( p % 2 ) res = ( res * n ) % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: if ( p % 2 ) res = res % n ; | |
| -- Bleu score: 0.335521593027 | |
| Calculating bleu score..... | |
| -- Reference tokens: return res % int ( 1e9 + 7 ) ; | |
| -- Predicted tokens: return result ( casted , casted ) ; | |
| -- Bleu score: 0.186758738964 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long n , m , arr [ 100005 ] , a , ans = 0 ; | |
| -- Predicted tokens: long long n = 100005 , arr = 0 , a = 0 , a = 0 , ans = 0 ; | |
| -- Bleu score: 0.31243257276 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n >> m ; | |
| -- Predicted tokens: cin >> n >> m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; ++ i ) { | |
| -- Bleu score: 0.793076857583 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> arr [ i ] ; | |
| -- Predicted tokens: cin >> arr [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( i ) { | |
| -- Predicted tokens: if ( i ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) { | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) { | |
| -- Bleu score: 0.741521848368 | |
| Calculating bleu score..... | |
| -- Reference tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Predicted tokens: a = ( arr [ i - 1 ] - arr [ i ] ) / m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: ans += a ; | |
| -- Predicted tokens: ans += a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: arr [ i ] += a * m ; | |
| -- Predicted tokens: arr [ i ] += a * m ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( arr [ i ] <= arr [ i - 1 ] ) arr [ i ] += m , ans ++ ; | |
| -- Predicted tokens: if ( arr [ i ] <= arr [ i ] ) ans ++ ; | |
| -- Bleu score: 0.463258564047 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ans << '\n' ; | |
| -- Predicted tokens: cout << ans << '\n' ; | |
| -- Bleu score: 1.0 | |
| line 1:11 token recognition error at: '';' | |
| Calculating bleu score..... | |
| -- Reference tokens: int i , j , k , l , m , n , o , p , a , b ; | |
| -- Predicted tokens: int i = k , l = k , l = l , o = p , a = p , a = p , a = p , a = p ; | |
| -- Bleu score: 0.13628770358 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a ; | |
| -- Predicted tokens: cin >> a ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> b ; | |
| -- Predicted tokens: cin >> b ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Predicted tokens: cout << ( a * b ) / 2 << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int a [ 105 ] , b [ 105 ] , c [ 105 ] ; | |
| -- Predicted tokens: int a = 105 , b = 105 , c = 105 ; | |
| -- Bleu score: 0.164240415785 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long result = 0 ; | |
| -- Predicted tokens: long long result = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int start , int self ) { | |
| -- Predicted tokens: void dfs ( int start , int self ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( self == i ) continue ; | |
| -- Predicted tokens: if ( self == i ) continue ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( start == a [ i ] ) { | |
| -- Predicted tokens: if ( start == a [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( b [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( b [ i ] == a [ 1 ] ) return a ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( b [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: } else if ( start == b [ i ] ) { | |
| -- Predicted tokens: } else if ( start == b [ i ] ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result += c [ i ] ; | |
| -- Predicted tokens: result += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( a [ i ] == a [ 1 ] ) return ; | |
| -- Predicted tokens: if ( a [ i ] == a [ 1 ] ) return i ; | |
| -- Bleu score: 0.876156078321 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( a [ i ] , i ) ; | |
| -- Predicted tokens: dfs ( a [ i ] , i ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long sum = 0 ; | |
| -- Predicted tokens: long long sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 1 ; i <= n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 1 ; i <= n ; i ++ ) | |
| -- Bleu score: 0.931062779704 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Predicted tokens: cin >> a [ i ] >> b [ i ] >> c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += c [ i ] ; | |
| -- Predicted tokens: sum += c [ i ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Predicted tokens: dfs ( b [ 1 ] , 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: result = min ( result , sum - result ) ; | |
| -- Predicted tokens: result = min ( result , sum - result ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << result << endl ; | |
| -- Predicted tokens: cout << result << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vector < string > v ( 120 ) ; | |
| -- Predicted tokens: vector < int > :: v v = vector ; | |
| -- Bleu score: 0.19729406278 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i += 12 ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 0.783128810029 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 1 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 2 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 3 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + 4 ] = _STR : 0_ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 5 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 6 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 7 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 8 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = _STR : 0_ ; | |
| -- Bleu score: 0.616260709973 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 9 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 10 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: v [ i + 11 ] = _STR : 0_ ; | |
| -- Predicted tokens: v [ i + _STR : 0_ ] = i ; | |
| -- Bleu score: 0.477189707581 | |
| Calculating bleu score..... | |
| -- Reference tokens: string x ; | |
| -- Predicted tokens: x < int , long > :: string x = string ; | |
| -- Bleu score: 0.261302265968 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x ; | |
| -- Predicted tokens: cin >> x ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n , z ; | |
| -- Predicted tokens: int n = z , z = z ; | |
| -- Bleu score: 0.262690989442 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> n ; | |
| -- Predicted tokens: cin >> n ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 120 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( v [ i ] == x ) { | |
| -- Predicted tokens: if ( v [ i ] == v [ x ] ) { | |
| -- Bleu score: 0.57575756362 | |
| Calculating bleu score..... | |
| -- Reference tokens: z = i ; | |
| -- Predicted tokens: z = i ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << v [ z + n ] << endl ; | |
| -- Predicted tokens: cout << v [ n ] << v [ n + n ] ; | |
| -- Bleu score: 0.382330140783 | |
| Calculating bleu score..... | |
| -- Reference tokens: int graph [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int graph [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int vis [ 105 ] ; | |
| -- Predicted tokens: int vis [ 105 ] = 105 ; | |
| -- Bleu score: 0.610473583581 | |
| Calculating bleu score..... | |
| -- Reference tokens: int m [ 105 ] [ 105 ] ; | |
| -- Predicted tokens: int m [ 105 ] [ 105 ] = 105 ; | |
| -- Bleu score: 0.729257172387 | |
| Calculating bleu score..... | |
| -- Reference tokens: int t ; | |
| -- Predicted tokens: int t = t ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int k ; | |
| -- Predicted tokens: int k = k ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: int n ; | |
| -- Predicted tokens: int n = n ; | |
| -- Bleu score: 0.56234132519 | |
| Calculating bleu score..... | |
| -- Reference tokens: void dfs ( int u ) { | |
| -- Predicted tokens: void dfs ( int u ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k ++ ; | |
| -- Predicted tokens: k ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: vis [ u ] = 1 ; | |
| -- Predicted tokens: vis [ u ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { t += m [ 1 ] [ u ] ; } | |
| -- Predicted tokens: if ( k == n ) { u += m [ 1 ] [ u ] ; } | |
| -- Bleu score: 0.849232663576 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 105 ; i ++ ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Predicted tokens: if ( graph [ u ] [ i ] == 1 && vis [ i ] == 0 ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t += m [ i ] [ u ] ; | |
| -- Predicted tokens: t += m [ i ] [ u ] ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( k == n ) { return ; } | |
| -- Predicted tokens: if ( k == n ) { return n ; } | |
| -- Bleu score: 0.769160567313 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( i ) ; | |
| -- Predicted tokens: dfs ( i , i ) ; | |
| -- Bleu score: 0.481097729098 | |
| Calculating bleu score..... | |
| -- Reference tokens: while ( cin >> n ) { | |
| -- Predicted tokens: while ( cin >> n ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: t = 0 ; | |
| -- Predicted tokens: t = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: k = 0 ; | |
| -- Predicted tokens: k = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: int sum = 0 ; | |
| -- Predicted tokens: int sum = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Predicted tokens: memset ( graph , 0 , sizeof ( graph ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Predicted tokens: memset ( vis , 0 , sizeof ( vis ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Predicted tokens: memset ( m , 0 , sizeof ( m ) ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( int i = 0 ; i < n ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < n ; ++ i ) { | |
| -- Bleu score: 0.793076857583 | |
| Calculating bleu score..... | |
| -- Reference tokens: int x , y , z ; | |
| -- Predicted tokens: int x = y , z = z , z = z ; | |
| -- Bleu score: 0.240221108644 | |
| Calculating bleu score..... | |
| -- Reference tokens: cin >> x >> y >> z ; | |
| -- Predicted tokens: cin >> x >> y >> z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Predicted tokens: graph [ x ] [ y ] = graph [ y ] [ x ] = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: m [ y ] [ x ] = z ; | |
| -- Predicted tokens: m [ y ] [ x ] = z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: sum += z ; | |
| -- Predicted tokens: sum += z ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: dfs ( 1 ) ; | |
| -- Predicted tokens: dfs ( 1 ) ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Predicted tokens: if ( sum - t < t ) { t = sum - t ; } | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << t << endl ; | |
| -- Predicted tokens: cout << t << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: long long i , j , k ; | |
| -- Predicted tokens: long long i = j , j = j , k = k ; | |
| -- Bleu score: 0.275600167872 | |
| Calculating bleu score..... | |
| -- Reference tokens: string s [ 10 ] ; | |
| -- Predicted tokens: s :: s s [ 10 ] = { 10 } ; | |
| -- Bleu score: 0.302664372669 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { cin >> s [ i ] ; } | |
| -- Predicted tokens: getline ( cin , s ) ; | |
| -- Bleu score: 0.0286800206382 | |
| Calculating bleu score..... | |
| -- Reference tokens: int cnt = 0 ; | |
| -- Predicted tokens: int cnt = 0 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( i = 0 ; i < 8 ; i ++ ) { | |
| -- Predicted tokens: for ( int i = 0 ; i < 8 ; i ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: int f = 0 , flag = 0 ; | |
| -- Predicted tokens: int f = 0 , f = 0 ; | |
| -- Bleu score: 0.658037006476 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ 0 ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| line 1:12 token recognition error at: ''){' | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ i ] [ j ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: f = 1 ; | |
| -- Predicted tokens: f = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( f == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( f == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Predicted tokens: if ( s [ 0 ] [ i ] == 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: for ( j = 0 ; j < 8 ; j ++ ) { | |
| -- Predicted tokens: for ( int j = 0 ; j < 8 ; j ++ ) { | |
| -- Bleu score: 0.837117009878 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Predicted tokens: if ( s [ j ] [ i ] != 'B' ) { | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: flag = 1 ; | |
| -- Predicted tokens: flag = 1 ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: break ; | |
| -- Predicted tokens: break ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Predicted tokens: if ( flag == 0 ) cnt ++ ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: if ( cnt == 16 ) | |
| -- Predicted tokens: if ( cnt == 16 ) | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << _STR : 0_ << endl ; | |
| -- Predicted tokens: cout << _STR : 0_ << endl ; | |
| -- Bleu score: 1.0 | |
| Calculating bleu score..... | |
| -- Reference tokens: else | |
| -- Predicted tokens: } else { | |
| -- Bleu score: 0.840896415254 | |
| Calculating bleu score..... | |
| -- Reference tokens: cout << cnt << endl ; | |
| -- Predicted tokens: cout << cnt << endl ; | |
| -- Bleu score: 1.0 | |
| 07/21/2020 23:38:27 [INFO] evaluation: sentence level bleu: 0.806286 | |
| 07/21/2020 23:38:27 [INFO] evaluation: accuracy: 0.597765 | |
| 07/21/2020 23:38:27 [INFO] evaluation: oracle bleu: 0.878245 | |
| 07/21/2020 23:38:27 [INFO] evaluation: oracle accuracy: 0.743017 | |
| 07/21/2020 23:38:27 [INFO] learner: avg. example bleu: 0.806286 | |
| 07/21/2020 23:38:27 [INFO] learner: accuracy: 0.597765 | |
| 07/21/2020 23:38:27 [INFO] learner: hitting patience_counter: 8 | |
| 07/21/2020 23:38:27 [INFO] model: save model to [runs/model.iter8960] | |
| 07/21/2020 23:40:59 [INFO] learner: [Epoch 61] cumulative loss = 0.298224, (took 651s) | |
| Epoch 62, eta 197s | |
| 07/21/2020 23:44:49 [INFO] learner: [Epoch 62] cumulative loss = 0.279831, (took 229s) | |
| Epoch 63, eta 218s | |
| 07/21/2020 23:46:07 [INFO] learner: begin validation | |
| Process finished with exit code 0 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment