Skip to content

Instantly share code, notes, and snippets.

@michaelaye
Forked from brianewing/remotemd5.py
Created October 7, 2021 02:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save michaelaye/968bcdfe840a342e88b36dfd9323a288 to your computer and use it in GitHub Desktop.
Save michaelaye/968bcdfe840a342e88b36dfd9323a288 to your computer and use it in GitHub Desktop.
Python MD5 of remote file (URL)
import os, hashlib, urllib2, optparse
def get_remote_md5_sum(url, max_file_size=100*1024*1024):
remote = urllib2.urlopen(url)
hash = hashlib.md5()
total_read = 0
while True:
data = remote.read(4096)
total_read += 4096
if not data or total_read > max_file_size:
break
hash.update(data)
return hash.hexdigest()
if __name__ == '__main__':
opt = optparse.OptionParser()
opt.add_option('--url', '-u', default='http://www.google.com')
options, args = opt.parse_args()
print get_remote_md5_sum(options.url)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment