Created
August 22, 2018 05:41
-
-
Save wchargin/2e4352b5e875cf764e1ea64f56ed13b7 to your computer and use it in GitHub Desktop.
tensorflow with retries on 5a91d99e868815f17893cfe7399a0cf27f04cfef
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ node bin/sourcecred.js load --plugin github tensorflow/tensorflow 2>&1 | ts -s '%.s' | |
| 0.252566 Fetching repo... | |
| 0.258422 Trying... | |
| 5.203014 Trying... | |
| 10.696685 Trying... | |
| 16.609612 Trying... | |
| 20.781806 Trying... | |
| 25.846355 Trying... | |
| 29.972605 Trying... | |
| 33.568364 Trying... | |
| 37.549874 Trying... | |
| 42.242648 Trying... | |
| 46.132331 Trying... | |
| 51.383854 Trying... | |
| 55.864720 Trying... | |
| 60.181630 Trying... | |
| 64.094317 Trying... | |
| 68.134681 Trying... | |
| 72.327279 Trying... | |
| 76.929878 Trying... | |
| 81.909691 Trying... | |
| 86.623211 Trying... | |
| 90.307516 Trying... | |
| 95.446663 Trying... | |
| 100.165926 Trying... | |
| 104.023178 Trying... | |
| 107.715320 Trying... | |
| 111.290423 Trying... | |
| 115.307406 Trying... | |
| 119.826902 Trying... | |
| 123.925273 Trying... | |
| 127.488304 Trying... | |
| 132.642788 Trying... | |
| 137.551647 Trying... | |
| 142.873006 Trying... | |
| 148.072347 Trying... | |
| 152.373428 Trying... | |
| 156.820666 Trying... | |
| 162.750461 Trying... | |
| 168.474986 Trying... | |
| 172.392611 Trying... | |
| 178.220042 Trying... | |
| 182.688373 Trying... | |
| 187.000741 Trying... | |
| 191.328070 Trying... | |
| 195.541027 Trying... | |
| 200.859499 Trying... | |
| 205.967731 Trying... | |
| 209.586598 Trying... | |
| 215.648445 Trying... | |
| 220.125132 Trying... | |
| 224.898113 Trying... | |
| 230.564451 Trying... | |
| 234.597316 Trying... | |
| 239.862904 Trying... | |
| 243.976134 Trying... | |
| 248.385107 Trying... | |
| 252.963822 Trying... | |
| 257.668681 Trying... | |
| 266.595822 Trying... | |
| 277.023226 Will retry (n=1)... | |
| 282.063090 Trying... | |
| 292.483815 Will retry (n=1)... | |
| 297.976075 Trying... | |
| 307.655285 Trying... | |
| 318.188312 Will retry (n=1)... | |
| 323.518948 Trying... | |
| 333.496935 Trying... | |
| 343.348069 Trying... | |
| 351.936344 Trying... | |
| 362.425978 Will retry (n=1)... | |
| 368.575431 Trying... | |
| 379.015394 Will retry (n=1)... | |
| 385.394900 Trying... | |
| 395.808621 Will retry (n=1)... | |
| 401.036669 Trying... | |
| 411.474698 Will retry (n=1)... | |
| 416.918922 Trying... | |
| 427.451795 Will retry (n=1)... | |
| 435.284308 Trying... | |
| 445.781581 Will retry (n=1)... | |
| 452.950232 Trying... | |
| 463.265445 Will retry (n=1)... | |
| 468.191394 Trying... | |
| 476.878370 Trying... | |
| 487.471550 Trying... | |
| 497.087892 Trying... | |
| 505.623255 Trying... | |
| 515.025077 Trying... | |
| 522.214959 Trying... | |
| 531.174087 Trying... | |
| 541.627139 Will retry (n=1)... | |
| 547.985409 Trying... | |
| 556.546474 Trying... | |
| 564.667805 Trying... | |
| 564.890565 Will retry (n=1)... | |
| 573.641763 Trying... | |
| 584.123373 Will retry (n=1)... | |
| 589.372091 Trying... | |
| 599.895375 Will retry (n=1)... | |
| 605.028347 Trying... | |
| 615.662566 Will retry (n=1)... | |
| 621.415552 Trying... | |
| 631.819661 Trying... | |
| 640.661807 Trying... | |
| 650.964629 Trying... | |
| 660.156681 Trying... | |
| 670.757262 Will retry (n=1)... | |
| 679.107765 Trying... | |
| 689.698641 Will retry (n=1)... | |
| 696.151188 Trying... | |
| 706.328528 Trying... | |
| 716.113307 Trying... | |
| 725.273676 Trying... | |
| 735.885544 Will retry (n=1)... | |
| 741.407816 Trying... | |
| 750.755545 Trying... | |
| 761.278926 Will retry (n=1)... | |
| 768.389561 Trying... | |
| 777.606217 Trying... | |
| 787.953471 Will retry (n=1)... | |
| 794.317494 Trying... | |
| 804.798240 Will retry (n=1)... | |
| 810.987811 Trying... | |
| 821.125902 Trying... | |
| 831.748883 Trying... | |
| 839.834183 Trying... | |
| 850.369433 Will retry (n=1)... | |
| 856.732605 Trying... | |
| 866.529397 Trying... | |
| 876.891715 Will retry (n=1)... | |
| 882.506652 Trying... | |
| 890.682559 Trying... | |
| 898.613124 Trying... | |
| 908.939436 Will retry (n=1)... | |
| 913.570325 Trying... | |
| 922.396047 Trying... | |
| 932.862201 Trying... | |
| 943.281656 Trying... | |
| 952.522468 Trying... | |
| 961.508473 Trying... | |
| 969.774208 Trying... | |
| 978.738726 Trying... | |
| 988.308714 Trying... | |
| 997.022270 Trying... | |
| 1007.177868 Trying... | |
| 1016.866223 Trying... | |
| 1026.019674 Trying... | |
| 1036.088013 Trying... | |
| 1046.648492 Will retry (n=1)... | |
| 1053.243735 Trying... | |
| 1063.774242 Will retry (n=1)... | |
| 1069.684994 Trying... | |
| 1080.510504 Trying... | |
| 1091.115487 Will retry (n=1)... | |
| 1097.307622 Trying... | |
| 1107.342426 Trying... | |
| 1117.665803 Trying... | |
| 1126.493585 Trying... | |
| 1136.169808 Trying... | |
| 1143.982738 Trying... | |
| 1154.500105 Will retry (n=1)... | |
| 1159.437774 Trying... | |
| 1168.560180 Trying... | |
| 1178.128433 Trying... | |
| 1188.299839 Trying... | |
| 1198.842247 Will retry (n=1)... | |
| 1204.693747 Trying... | |
| 1215.353323 Trying... | |
| 1224.809560 Trying... | |
| 1234.086870 Trying... | |
| 1244.521197 Trying... | |
| 1254.848044 Will retry (n=1)... | |
| 1260.893334 Trying... | |
| 1271.547368 Trying... | |
| 1282.094735 Will retry (n=1)... | |
| 1283.349192 Will retry (n=2)... | |
| 1289.188728 Trying... | |
| 1299.706129 Will retry (n=1)... | |
| 1305.974598 Trying... | |
| 1316.399343 Will retry (n=1)... | |
| 1321.807040 Trying... | |
| 1331.586060 Trying... | |
| 1340.783493 Trying... | |
| 1348.530612 Trying... | |
| 1359.101437 Will retry (n=1)... | |
| 1364.331311 Trying... | |
| 1374.076659 Trying... | |
| 1384.596559 Will retry (n=1)... | |
| 1391.452261 Trying... | |
| 1399.703799 Trying... | |
| 1410.201193 Will retry (n=1)... | |
| 1415.553534 Trying... | |
| 1426.173994 Will retry (n=1)... | |
| 1431.213065 Trying... | |
| 1439.884798 Trying... | |
| 1449.888879 Trying... | |
| 1458.815546 Trying... | |
| 1468.228112 Trying... | |
| 1468.499404 Will retry (n=1)... | |
| 1477.712004 Trying... | |
| 1485.295707 Trying... | |
| 1495.702189 Will retry (n=1)... | |
| 1500.655244 Trying... | |
| 1510.729309 Trying... | |
| 1517.994247 Trying... | |
| 1526.487744 Trying... | |
| 1534.026892 Trying... | |
| 1541.553315 Trying... | |
| 1547.205156 Trying... | |
| 1555.933717 Trying... | |
| 1562.591956 Trying... | |
| 1568.740215 Trying... | |
| 1571.559916 Trying... | |
| 1573.882136 Trying... | |
| 1575.851073 Trying... | |
| 1577.559739 Trying... | |
| 1579.645724 Trying... | |
| 1581.584229 Trying... | |
| 1583.554539 Trying... | |
| 1585.675006 Trying... | |
| 1587.430420 Trying... | |
| 1589.478696 Trying... | |
| 1591.536622 Trying... | |
| 1593.572532 Trying... | |
| 1595.706184 Trying... | |
| 1598.192319 Trying... | |
| 1599.609526 Trying... | |
| 1601.706343 Trying... | |
| 1603.816207 Trying... | |
| 1606.227222 Trying... | |
| 1608.215763 Trying... | |
| 1610.070426 Trying... | |
| 1612.230254 Trying... | |
| 1614.219076 Trying... | |
| 1616.661024 Trying... | |
| 1618.722396 Trying... | |
| 1621.041160 Trying... | |
| 1622.958637 Trying... | |
| 1624.989341 Trying... | |
| 1628.112027 Trying... | |
| 1629.805721 Trying... | |
| 1631.792168 Trying... | |
| 1633.713170 Trying... | |
| 1635.548401 Trying... | |
| 1637.642196 Trying... | |
| 1639.344539 Trying... | |
| 1640.926846 Trying... | |
| 1642.784716 Trying... | |
| 1644.620407 Trying... | |
| 1646.428329 Trying... | |
| 1648.302129 Trying... | |
| 1650.092483 Trying... | |
| 1652.002966 Trying... | |
| 1654.004743 Trying... | |
| 1655.975157 Trying... | |
| 1657.664765 Trying... | |
| 1659.705329 Trying... | |
| 1661.359502 Trying... | |
| 1662.998547 Trying... | |
| 1664.840294 Trying... | |
| 1666.759514 Trying... | |
| 1668.089494 Trying... | |
| 1669.557671 Trying... | |
| 1671.333336 Trying... | |
| 1673.876566 Trying... | |
| 1676.062356 Trying... | |
| 1678.131937 Trying... | |
| 1680.187092 Trying... | |
| 1682.614824 Trying... | |
| 1684.300362 Trying... | |
| 1686.811328 Trying... | |
| 1688.932685 Trying... | |
| 1690.964568 Trying... | |
| 1692.542458 Trying... | |
| 1694.181354 Trying... | |
| 1695.712716 Trying... | |
| 1697.007866 Trying... | |
| 1698.642977 Trying... | |
| 1700.330716 Trying... | |
| 1702.128931 Trying... | |
| 1703.508458 Trying... | |
| 1705.509432 Trying... | |
| 1707.095219 Trying... | |
| 1708.859270 Trying... | |
| 1710.468833 Trying... | |
| 1711.937581 Trying... | |
| 1713.687829 Trying... | |
| 1715.321799 Trying... | |
| 1716.720125 Trying... | |
| 1718.464195 Trying... | |
| 1719.945032 Trying... | |
| 1721.715907 Trying... | |
| 1723.303440 Trying... | |
| 1724.854199 Trying... | |
| 1726.491986 Trying... | |
| 1727.730164 Trying... | |
| 1729.413859 Trying... | |
| 1731.040590 Trying... | |
| 1732.467972 Trying... | |
| 1733.879000 Trying... | |
| 1735.567875 Trying... | |
| 1736.781471 Trying... | |
| 1738.495433 Trying... | |
| 1739.876835 Trying... | |
| 1741.026869 Ensuring no more pages... | |
| 1742.139978 Creating view... | |
| 1752.023697 Stringifying... | |
| 1754.697116 Writing... | |
| 1754.697772 Done. |
Created on top of 5b6447eaf90f4d86171be81f0bd7bf8b53468bda by applying:
diff --git a/src/plugins/github/fetchGithubRepo.js b/src/plugins/github/fetchGithubRepo.js
index 1bf799c..248b1fe 100644
--- a/src/plugins/github/fetchGithubRepo.js
+++ b/src/plugins/github/fetchGithubRepo.js
@@ -103,14 +103,15 @@ function tryGithubFetch(fetch, fetchOptions): Promise<any> {
function retryGithubFetch(fetch, fetchOptions) {
return new Promise((resolve, reject) => {
const operation = retry.operation();
- operation.attempt(() => {
+ console.info(`Trying...`);
+ operation.attempt((attemptCount) => {
tryGithubFetch(fetch, fetchOptions)
.then((result) => {
resolve(result);
})
.catch((error) => {
if (error.retry && operation.retry(true)) {
- return;
+ console.info(`Will retry (n=${attemptCount})...`);
} else {
reject(error);
}
diff --git a/src/plugins/github/loadGithubData.js b/src/plugins/github/loadGithubData.js
index c0fc7e2..e553c70 100644
--- a/src/plugins/github/loadGithubData.js
+++ b/src/plugins/github/loadGithubData.js
@@ -15,10 +15,15 @@ export type Options = {|
|};
export async function loadGithubData(options: Options): Promise<void> {
+ console.info("Fetching repo...");
const response = await fetchGithubRepo(options.repo, options.token);
+ console.info("Creating view...");
const view = new RelationalView();
view.addData(response);
+ console.info("Stringifying...");
const blob = JSON.stringify(view);
+ console.info("Writing...");
const outputFilename = path.join(options.outputDirectory, "view.json");
- return fs.writeFile(outputFilename, blob);
+ const result = fs.writeFile(outputFilename, blob);
+ console.info("Done.");
}
Result available on IPFS: QmQYXQBBYCu6QkkRt31EUHZ128kP9PTyvBMqssC8vtELZ4.
Query deltas:
$ pbpaste | grep -e Trying -e retry | awk '{ if (NR > 1) print $1 - last; last = $1; }'
4.94459
5.49367
5.91293
4.17219
5.06455
4.12625
3.59576
3.98151
4.69277
3.88968
5.25152
4.48087
4.31691
3.91269
4.04036
4.1926
4.6026
4.97981
4.71352
3.68431
5.13915
4.71926
3.85725
3.69214
3.5751
4.01698
4.5195
4.09837
3.56303
5.15448
4.90886
5.32136
5.19934
4.30108
4.44724
5.9298
5.72452
3.91762
5.82743
4.46833
4.31237
4.32733
4.21296
5.31847
5.10823
3.61887
6.06185
4.47669
4.77298
5.66634
4.03287
5.26559
4.11323
4.40897
4.57871
4.70486
8.92714
10.4274
5.03986
10.4207
5.49226
9.67921
10.533
5.33064
9.97799
9.85113
8.58828
10.4896
6.14945
10.44
6.37951
10.4137
5.22805
10.438
5.44422
10.5329
7.83251
10.4973
7.16865
10.3152
4.92595
8.68698
10.5932
9.61634
8.53536
9.40182
7.18988
8.95913
10.4531
6.35827
8.56106
8.12133
0.22276
8.7512
10.4816
5.24872
10.5233
5.13297
10.6342
5.75299
10.4041
8.84215
10.3028
9.19205
10.6006
8.3505
10.5909
6.45255
10.1773
9.78478
9.16037
10.6119
5.52227
9.34773
10.5234
7.11064
9.21666
10.3473
6.36402
10.4807
6.18957
10.1381
10.623
8.0853
10.5352
6.36317
9.79679
10.3623
5.61494
8.17591
7.93057
10.3263
4.63089
8.82572
10.4662
10.4195
9.24081
8.986
8.26574
8.96452
9.56999
8.71356
10.1556
9.68836
9.15345
10.0683
10.5605
6.59524
10.5305
5.91075
10.8255
10.605
6.19214
10.0348
10.3234
8.82778
9.67622
7.81293
10.5174
4.93767
9.12241
9.56825
10.1714
10.5424
5.8515
10.6596
9.45624
9.27731
10.4343
10.3268
6.04529
10.654
10.5474
1.25446
5.83954
10.5174
6.26847
10.4247
5.4077
9.77902
9.19743
7.74712
10.5708
5.22987
9.74535
10.5199
6.8557
8.25154
10.4974
5.35234
10.6205
5.03907
8.67173
10.0041
8.92667
9.41257
0.271292
9.2126
7.5837
10.4065
4.95305
10.0741
7.26494
8.4935
7.53915
7.52642
5.65184
8.72856
6.65824
6.14826
2.8197
2.32222
1.96894
1.70867
2.08598
1.93851
1.97031
2.12047
1.75541
2.04828
2.05793
2.03591
2.13365
2.48614
1.41721
2.09682
2.10986
2.41101
1.98854
1.85466
2.15983
1.98882
2.44195
2.06137
2.31876
1.91748
2.0307
3.12269
1.69369
1.98645
1.921
1.83523
2.0938
1.70234
1.58231
1.85787
1.83569
1.80792
1.8738
1.79035
1.91048
2.00178
1.97041
1.68961
2.04056
1.65417
1.63904
1.84175
1.91922
1.32998
1.46818
1.77566
2.54323
2.18579
2.06958
2.05515
2.42773
1.68554
2.51097
2.12136
2.03188
1.57789
1.6389
1.53136
1.29515
1.63511
1.68774
1.79822
1.37953
2.00097
1.58579
1.76405
1.60956
1.46875
1.75025
1.63397
1.39833
1.74407
1.48084
1.77087
1.58753
1.55076
1.63779
1.23818
1.68369
1.62673
1.42738
1.41103
1.68888
1.2136
1.71396
1.3814
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
started at 2018-08-21T21:56-0800