Script to upload files to github.

README.md

This script has a new home: https://github.com/wereHamster/ghup

this is cool, thanks! is there a way to avoid using the password explicitly? I know little about OAuth, and the github api is Greek to me...

I just updated the script to use oauth tokens instead of basic auth. You have to create an oauth token, here is how:

curl -X POST -u <github user>:<github password> -d '{"note":"file upload script","note_url":"https://gist.github.com/772010","scopes":["repo"]}' https://api.github.com/authorizations

Copy the token from the response and put it into your git config file:

 git config --global github.upload-script-token <the token from the response>

Now you can use this upload script.

I tried the oauth approach, and I can see the uploads but cannot really download them: https://github.com/yihui/cn/downloads Github tells me the files do not exist...

Is there any unusual output from the script? I tested the script with one of my private repositories and there it works beautifully...

I see these messages when I tried to upload files:

warning: peer certificate won't be verified in this SSL session
warning: peer certificate won't be verified in this SSL session
S3 is mean to us.

I'm using Ubuntu 12.04.

$ gem list
*** LOCAL GEMS ***
json (1.7.0)
$ gem --version
1.8.15

Uploading the file to S3 fails, for whatever reason. Can you put a 'puts res.body' just before the die() there?

First I saw this:

warning: peer certificate won't be verified in this SSL session
warning: peer certificate won't be verified in this SSL session
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>InvalidArgument</Code><Message>Bucket POST must contain a field named 'Signature'.  If it is specified, please check the order of the fields.</Message><ArgumentValue></ArgumentValue><ArgumentName>Signature</ArgumentName><RequestId>E73F72584A08A1C2</RequestId><HostId>UIShLlQtC0UXCxg7dmGNdHTiO0oRoEF4/L7mlDm02KBv7waFdfCl9fc7lCx19YXQ</HostId></Error>
S3 is mean to us.

then I realized signature should be Signature, but even if I made this change, I still failed to upload. After looking at info and res.body, and I found file should really be '@' + file. This change finally made it work for me.

sorry I just figured out the real culprit; it is because Ubuntu uses ruby 1.8 by default, and I just installed 1.9. With 1.8, the hash does not preserve the order of the elements, which caused the failure, e.g.

{'a'=>1, 'z'=>2}
=> {"z"=>2, "a"=>1}

1.9 works fine. Thanks a lot for all the help!

Well, another problem. Although I can upload the file now, it seems to be corrupted somehow. Here is an example, and I'm not sure if you can reproduce it: https://gist.github.com/2570071 I uploaded knitr-slides.html to my repository, and the download is different with the original file:

437,438c437
<         this.step >= this.slides[this.idx - 1].$$('.incremental > *').length) {
<         return;

---
>         this.step >= this.slides[this.idx - 1].$$('.incremental > *').length)eturn;

might be something wrong with build_multipart_content?

I was able to reproduce it. Strange that only this single part of code is corrupted, everything else is fine. I will be travelling for two weeks now and have limited access to the internet. So I most likely won't be able to look into it until I get back.

I just found it might not be the problem of your script, but could be Github's fault. Even if I upload the file through the web interface, it is still corrupted. I will report to Github developers. Thank you so much!

A couple of minor things: if this script does require ruby 1.9, could you please indicate that by changing that hash-bang line to

!/usr/bin/env ruby1.9

?

Also, there's a typo in one error message: "doens't" → "doesn't"

The thing with env ruby1.9 is that it's not always correct. It happens to work that way on ubuntu and maybe other systems, but not with rvm for example. I think it would be best to manually check the version at the very top of the file and tell the user what to do in case the ruby version is not 1.9.

Indeed, 'env ruby1.9' does not work on my Ubuntu system, but I don't think it's a big problem: it gives an immediate error message, and it's obvious what to do. If 'env ruby' is ruby 1.8 you instead get obscure failures, as demonstrated above.

Also, would it be possible to turn github-upload into a proper project? This page is relatively hard to find, and the existing github-upload project does not work (so I'm glad I found this script!). That would also allow properly structured discussion, e.g. filing issues &c., which would make things quicker and more efficient for everyone!

Hm, sure. Good idea. Maybe I could even make it a proper gem.

…

On Mon, 28 May 2012 12:33:16 -0700, Reuben Thomas ***@***.*** wrote: Also, would it be possible to turn github-upload into a proper project? This page is relatively hard to find, and the existing github-upload project does not work (so I'm glad I found this script!). That would also allow properly structured discussion, e.g. filing issues &c., which would make things quicker and more efficient for everyone!

Is it a simple matter to add a parameter for the "description" of the upload? (I'd try my hand at adding it myself, but I'm afraid I'm only comfortable with ActionScript and Java code.)

I converted the gist into a full git repo: https://github.com/wereHamster/ghup. You can open issues there if you want.

.blg file:

[1] Config.pm:304> INFO - This is Biber 2.13
[1] Config.pm:307> INFO - Logfile is 'refTest.blg'
[40] biber-MSWIN64:315> INFO - ===
[68] Biber.pm:375> INFO - Reading 'refTest.bcf'
[179] Biber.pm:905> INFO - Found 1 citekeys in bib section 0
[206] Biber.pm:4196> INFO - Processing section 0
[210] Utils.pm:75> INFO - Globbing data source 'biblatex-examples.bib'
[231] Utils.pm:91> INFO - Globbed data source 'biblatex-examples.bib' to biblatex-examples.bib
[250] Biber.pm:4373> INFO - Looking for bibtex format file 'biblatex-examples.bib' for section 0
[539] bibtex.pm:1462> INFO - LaTeX decoding ...
[791] bibtex.pm:1281> INFO - Found BibTeX data source 'C:/Program Files/MiKTeX 2.9/bibtex/bib/biblatex/biblatex-examples.bib'
[859] UCollate.pm:68> INFO - Overriding locale 'en-GB' defaults 'normalization = NFD' with 'normalization = prenormalized'
[859] UCollate.pm:68> INFO - Overriding locale 'en-GB' defaults 'variable = shifted' with 'variable = non-ignorable'
[860] Biber.pm:4024> INFO - Sorting list 'nyt/global//global/global' of type 'entry' with template 'nyt' and locale 'en-GB'
[860] Biber.pm:4030> INFO - No sort tailoring available for locale 'en-GB'
[864] bbl.pm:648> INFO - Writing 'refTest.bbl' with encoding 'UTF-8'
[867] bbl.pm:751> INFO - Output to refTest.bbl

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
.log file
This is pdfTeX, Version 3.14159265-2.6-1.40.20 (MiKTeX 2.9.7250 64-bit) (preloaded format=latex 2019.12.24) 24 DEC 2019 02:28
entering extended mode
**./refTest.tex
(refTest.tex
LaTeX2e <2019-10-01> patch level 3
("C:\Program Files\MiKTeX 2.9\tex/latex/base\article.cls"
Document Class: article 2019/10/25 v1.4k Standard LaTeX document class
("C:\Program Files\MiKTeX 2.9\tex/latex/base\size10.clo"
File: size10.clo 2019/10/25 v1.4k Standard LaTeX file (size option)
)
\c@part=\count80
\c@section=\count81
\c@subsection=\count82
\c@subsubsection=\count83
\c@paragraph=\count84
\c@subparagraph=\count85
\c@figure=\count86
\c@table=\count87
\abovecaptionskip=\skip41
\belowcaptionskip=\skip42
\bibindent=\dimen102
)
("C:\Program Files\MiKTeX 2.9\tex/latex/base\fontenc.sty"
Package: fontenc 2018/08/11 v2.0j Standard LaTeX package

("C:\Program Files\MiKTeX 2.9\tex/latex/base\t1enc.def"
File: t1enc.def 2018/08/11 v2.0j Standard LaTeX file
LaTeX Font Info: Redeclaring font encoding T1 on input line 48.
))
("C:\Program Files\MiKTeX 2.9\tex/latex/base\inputenc.sty"
Package: inputenc 2018/08/11 v1.3c Input encoding file
\inpenc@prehook=\toks14
\inpenc@posthook=\toks15
)
("C:\Program Files\MiKTeX 2.9\tex/generic/babel\babel.sty"
Package: babel 2019/11/14 3.36 The Babel package

("C:\Program Files\MiKTeX 2.9\tex/generic/babel\switch.def"
File: switch.def 2019/11/14 3.36 Babel switching mechanism
)

---

• Local config file bblopts.cfg used

("C:\Program Files\MiKTeX 2.9\tex/latex/arabi\bblopts.cfg"
File: bblopts.cfg 2005/09/08 v0.1 add Arabic and Farsi to "declared" options of
babel
)
("C:\Program Files\MiKTeX 2.9\tex/latex/babel-english\british.ldf"
Language: british 2017/06/06 v3.3r English support from the babel system

("C:\Program Files\MiKTeX 2.9\tex/latex/babel-english\english.ldf"
Language: english 2017/06/06 v3.3r English support from the babel system

("C:\Program Files\MiKTeX 2.9\tex/generic/babel\babel.def"
File: babel.def 2019/11/14 3.36 Babel common definitions
\babel@savecnt=\count88
\U@D=\dimen103

("C:\Program Files\MiKTeX 2.9\tex/generic/babel\txtbabel.def")
\bbl@dirlevel=\count89
)
Package babel Info: \l@canadian = using hyphenrules for english
(babel) (\language0) on input line 102.
Package babel Info: \l@australian = using hyphenrules for ukenglish
(babel) (\language76) on input line 105.
Package babel Info: \l@newzealand = using hyphenrules for ukenglish
(babel) (\language76) on input line 108.
)))
("C:\Program Files\MiKTeX 2.9\tex/latex/csquotes\csquotes.sty"
Package: csquotes 2019-12-06 v5.2j context-sensitive quotations (JAW)

("C:\Program Files\MiKTeX 2.9\tex/latex/etoolbox\etoolbox.sty"
Package: etoolbox 2019/09/21 v2.5h e-TeX tools for LaTeX (JAW)
\etb@tempcnta=\count90
)
("C:\Program Files\MiKTeX 2.9\tex/latex/graphics\keyval.sty"
Package: keyval 2014/10/28 v1.15 key=value parser (DPC)
\KV@toks@=\toks16
)
\csq@reset=\count91
\csq@gtype=\count92
\csq@glevel=\count93
\csq@qlevel=\count94
\csq@maxlvl=\count95
\csq@tshold=\count96
\csq@ltx@everypar=\toks17

("C:\Program Files\MiKTeX 2.9\tex/latex/csquotes\csquotes.def"
File: csquotes.def 2019-12-06 v5.2j csquotes generic definitions (JAW)
)
Package csquotes Info: Trying to load configuration file 'csquotes.cfg'...
Package csquotes Info: ... configuration file loaded successfully.

("C:\Program Files\MiKTeX 2.9\tex/latex/csquotes\csquotes.cfg"
File: csquotes.cfg
))
("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex\biblatex.sty"
Package: biblatex 2019/08/31 v3.13a programmable bibliographies (PK/MW)

("C:\Program Files\MiKTeX 2.9\tex/generic/oberdiek\pdftexcmds.sty"
Package: pdftexcmds 2019/07/25 v0.30 Utility functions of pdfTeX for LuaTeX (HO
)

("C:\Program Files\MiKTeX 2.9\tex/generic/oberdiek\infwarerr.sty"
Package: infwarerr 2016/05/16 v1.4 Providing info/warning/error messages (HO)
)
("C:\Program Files\MiKTeX 2.9\tex/generic/iftex\ifluatex.sty"
Package: ifluatex 2019/10/25 v1.5 ifluatex legacy package. Use iftex instead.

("C:\Program Files\MiKTeX 2.9\tex/generic/iftex\iftex.sty"
Package: iftex 2019/11/07 v1.0c TeX engine tests
))
("C:\Program Files\MiKTeX 2.9\tex/generic/oberdiek\ltxcmds.sty"
Package: ltxcmds 2016/05/16 v1.23 LaTeX kernel commands for general use (HO)
)
("C:\Program Files\MiKTeX 2.9\tex/generic/iftex\ifpdf.sty"
Package: ifpdf 2019/10/25 v3.4 ifpdf legacy package. Use iftex instead.
)
Package pdftexcmds Info: LuaTeX not detected.
Package pdftexcmds Info: \pdf@primitive is available.
Package pdftexcmds Info: \pdf@ifprimitive is available.
Package pdftexcmds Info: \pdfdraftmode is ignored in DVI mode.
)
("C:\Program Files\MiKTeX 2.9\tex/latex/oberdiek\kvoptions.sty"
Package: kvoptions 2016/05/16 v3.12 Key value format for package options (HO)

("C:\Program Files\MiKTeX 2.9\tex/generic/oberdiek\kvsetkeys.sty"
Package: kvsetkeys 2016/05/16 v1.17 Key value parser (HO)

("C:\Program Files\MiKTeX 2.9\tex/generic/oberdiek\etexcmds.sty"
Package: etexcmds 2016/05/16 v1.6 Avoid name clashes with e-TeX commands (HO)
)))
("C:\Program Files\MiKTeX 2.9\tex/latex/logreq\logreq.sty"
Package: logreq 2010/08/04 v1.0 xml request logger
\lrq@indent=\count97

("C:\Program Files\MiKTeX 2.9\tex/latex/logreq\logreq.def"
File: logreq.def 2010/08/04 v1.0 logreq spec v1.0
))
("C:\Program Files\MiKTeX 2.9\tex/latex/base\ifthen.sty"
Package: ifthen 2014/09/29 v1.1c Standard LaTeX ifthen package (DPC)
)
("C:\Program Files\MiKTeX 2.9\tex/latex/url\url.sty"
\Urlmuskip=\muskip10
Package: url 2013/09/16 ver 3.4 Verb mode for urls, etc.
)
\c@tabx@nest=\count98
\c@listtotal=\count99
\c@listcount=\count100
\c@liststart=\count101
\c@liststop=\count102
\c@citecount=\count103
\c@citetotal=\count104
\c@multicitecount=\count105
\c@multicitetotal=\count106
\c@instcount=\count107
\c@maxnames=\count108
\c@minnames=\count109
\c@maxitems=\count110
\c@minitems=\count111
\c@citecounter=\count112
\c@maxcitecounter=\count113
\c@savedcitecounter=\count114
\c@uniquelist=\count115
\c@uniquename=\count116
\c@refsection=\count117
\c@refsegment=\count118
\c@maxextratitle=\count119
\c@maxextratitleyear=\count120
\c@maxextraname=\count121
\c@maxextradate=\count122
\c@maxextraalpha=\count123
\c@abbrvpenalty=\count124
\c@highnamepenalty=\count125
\c@lownamepenalty=\count126
\c@maxparens=\count127
\c@parenlevel=\count128
\blx@tempcnta=\count129
\blx@tempcntb=\count130
\blx@tempcntc=\count131
\blx@maxsection=\count132
\blx@maxsegment@0=\count133
\blx@notetype=\count134
\blx@parenlevel@text=\count135
\blx@parenlevel@foot=\count136
\blx@sectionciteorder@0=\count137
\blx@entrysetcounter=\count138
\labelnumberwidth=\skip43
\labelalphawidth=\skip44
\biblabelsep=\skip45
\bibitemsep=\skip46
\bibnamesep=\skip47
\bibinitsep=\skip48
\bibparsep=\skip49
\bibhang=\skip50
\blx@bcfin=\read1
\blx@bcfout=\write3
\blx@langwohyphens=\language82
\c@mincomprange=\count139
\c@maxcomprange=\count140
\c@mincompwidth=\count141
Package biblatex Info: Trying to load biblatex default data model...
Package biblatex Info: ... file 'blx-dm.def' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex\blx-dm.def"
File: blx-dm.def 2019/08/31 v3.13a biblatex localization (PK/MW)
)
Package biblatex Info: Trying to load biblatex style data model...
Package biblatex Info: ... file 'authoryear.dbx' not found.
Package biblatex Info: Trying to load biblatex custom data model...
Package biblatex Info: ... file 'biblatex-dm.cfg' not found.
\c@afterword=\count142
\c@savedafterword=\count143
\c@annotator=\count144
\c@savedannotator=\count145
\c@author=\count146
\c@savedauthor=\count147
\c@bookauthor=\count148
\c@savedbookauthor=\count149
\c@commentator=\count150
\c@savedcommentator=\count151
\c@editor=\count152
\c@savededitor=\count153
\c@editora=\count154
\c@savededitora=\count155
\c@editorb=\count156
\c@savededitorb=\count157
\c@editorc=\count158
\c@savededitorc=\count159
\c@foreword=\count160
\c@savedforeword=\count161
\c@holder=\count162
\c@savedholder=\count163
\c@introduction=\count164
\c@savedintroduction=\count165
\c@namea=\count166
\c@savednamea=\count167
\c@nameb=\count168
\c@savednameb=\count169
\c@namec=\count170
\c@savednamec=\count171
\c@translator=\count172
\c@savedtranslator=\count173
\c@shortauthor=\count174
\c@savedshortauthor=\count175
\c@shorteditor=\count176
\c@savedshorteditor=\count177
\c@labelname=\count178
\c@savedlabelname=\count179
\c@institution=\count180
\c@savedinstitution=\count181
\c@lista=\count182
\c@savedlista=\count183
\c@listb=\count184
\c@savedlistb=\count185
\c@listc=\count186
\c@savedlistc=\count187
\c@listd=\count188
\c@savedlistd=\count189
\c@liste=\count190
\c@savedliste=\count191
\c@listf=\count192
\c@savedlistf=\count193
\c@location=\count194
\c@savedlocation=\count195
\c@organization=\count196
\c@savedorganization=\count197
\c@origlocation=\count198
\c@savedoriglocation=\count199
\c@origpublisher=\count266
\c@savedorigpublisher=\count267
\c@publisher=\count268
\c@savedpublisher=\count269
\c@language=\count270
\c@savedlanguage=\count271
\c@origlanguage=\count272
\c@savedoriglanguage=\count273
\c@pageref=\count274
\c@savedpageref=\count275
\shorthandwidth=\skip51
\shortjournalwidth=\skip52
\shortserieswidth=\skip53
\shorttitlewidth=\skip54
\shortauthorwidth=\skip55
\shorteditorwidth=\skip56
\locallabelnumberwidth=\skip57
\locallabelalphawidth=\skip58
\localshorthandwidth=\skip59
\localshortjournalwidth=\skip60
\localshortserieswidth=\skip61
\localshorttitlewidth=\skip62
\localshortauthorwidth=\skip63
\localshorteditorwidth=\skip64
Package biblatex Info: Trying to load compatibility code...
Package biblatex Info: ... file 'blx-compat.def' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex\blx-compat.def"
File: blx-compat.def 2019/08/31 v3.13a biblatex compatibility (PK/MW)
)
Package biblatex Info: Trying to load generic definitions...
Package biblatex Info: ... file 'biblatex.def' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex\biblatex.def"
File: biblatex.def 2019/08/31 v3.13a biblatex compatibility (PK/MW)
\c@textcitecount=\count276
\c@textcitetotal=\count277
\c@textcitemaxnames=\count278
\c@biburlbigbreakpenalty=\count279
\c@biburlbreakpenalty=\count280
\c@biburlnumpenalty=\count281
\c@biburlucpenalty=\count282
\c@biburllcpenalty=\count283
\biburlbigskip=\muskip11
\biburlnumskip=\muskip12
\biburlucskip=\muskip13
\biburllcskip=\muskip14
\c@smartand=\count284
)
Package biblatex Info: Trying to load bibliography style 'authoryear'...
Package biblatex Info: ... file 'authoryear.bbx' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex/bbx\authoryear.bbx"
File: authoryear.bbx 2019/08/31 v3.13a biblatex bibliography style (PK/MW)
Package biblatex Info: Trying to load bibliography style 'standard'...
Package biblatex Info: ... file 'standard.bbx' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex/bbx\standard.bbx"
File: standard.bbx 2019/08/31 v3.13a biblatex bibliography style (PK/MW)
\c@bbx:relatedcount=\count285
\c@bbx:relatedtotal=\count286
))
Package biblatex Info: Trying to load citation style 'authoryear'...
Package biblatex Info: ... file 'authoryear.cbx' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex/cbx\authoryear.cbx"
File: authoryear.cbx 2019/08/31 v3.13a biblatex citation style (PK/MW)
Package biblatex Info: Redefining '\cite'.
Package biblatex Info: Redefining '\parencite'.
Package biblatex Info: Redefining '\footcite'.
Package biblatex Info: Redefining '\footcitetext'.
Package biblatex Info: Redefining '\smartcite'.
Package biblatex Info: Redefining '\textcite'.
Package biblatex Info: Redefining '\textcites'.
)
Package biblatex Info: Trying to load configuration file...
Package biblatex Info: ... file 'biblatex.cfg' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex\biblatex.cfg"
File: biblatex.cfg
))
Package csquotes Info: Checking for multilingual support...
Package csquotes Info: ... found 'babel' package.
Package csquotes Info: Adjusting default style.
Package csquotes Info: Redefining alias 'default' -> 'british'.
Package biblatex Info: Trying to load language 'british'...
Package biblatex Info: ... file 'british.lbx' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex/lbx\british.lbx"
File: british.lbx 2019/08/31 v3.13a biblatex localization (PK/MW)
Package biblatex Info: Trying to load language 'english'...
Package biblatex Info: ... file 'english.lbx' found.

("C:\Program Files\MiKTeX 2.9\tex/latex/biblatex/lbx\english.lbx"
File: english.lbx 2019/08/31 v3.13a biblatex localization (PK/MW)
))
(refTest.aux)
\openout1 = `refTest.aux'.

LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 12.
LaTeX Font Info: ... okay on input line 12.
LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 12.
LaTeX Font Info: ... okay on input line 12.
LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 12.
LaTeX Font Info: ... okay on input line 12.
LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 12.
LaTeX Font Info: ... okay on input line 12.
LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 12.
LaTeX Font Info: ... okay on input line 12.
LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 12.
LaTeX Font Info: ... okay on input line 12.
Package biblatex Info: Input encoding 'utf8' detected.
Package biblatex Info: Automatic encoding selection.
(biblatex) Assuming data encoding 'utf8'.
\openout3 = `refTest.bcf'.

Package biblatex Info: Trying to load bibliographic data...
Package biblatex Info: ... file 'refTest.bbl' found.
(refTest.bbl)
Package biblatex Info: Reference section=0 on input line 12.
Package biblatex Info: Reference segment=0 on input line 12.
LaTeX Font Info: Trying to load font information for T1+cmtt on input line 1
4.

("C:\Program Files\MiKTeX 2.9\tex/latex/base\t1cmtt.fd"
File: t1cmtt.fd 2014/09/29 v2.5h Standard LaTeX font definitions
)
LaTeX Font Info: External font cmex10' loaded for size (Font) <7> on input line 14. LaTeX Font Info: External font cmex10' loaded for size
(Font) <5> on input line 14.
[1

] (refTest.aux)
Package logreq Info: Writing requests to 'refTest.run.xml'.
\openout1 = `refTest.run.xml'.

)
Here is how much of TeX's memory you used:
9049 strings out of 492451
164418 string characters out of 3129771
637428 words of memory out of 3000000
13359 multiletter control sequences out of 15000+200000
7618 words of font info for 20 fonts, out of 3000000 for 9000
1141 hyphenation exceptions out of 8191
42i,4n,46p,922b,2187s stack positions out of 5000i,500n,10000p,200000b,50000s

Output written on refTest.dvi (1 page, 1020 bytes).

sorry, i just test command :D

dádsd

aaaaa

bbbbb

aaaa

bbbb