Skip to content

Instantly share code, notes, and snippets.

@ssp

ssp/git-big.md

Created December 2, 2012 13:00
Show Gist options
  • Save ssp/4188524 to your computer and use it in GitHub Desktop.
Save ssp/4188524 to your computer and use it in GitHub Desktop.
Download ZIP
git with a lot of data
Raw
git-big.md

Testing how git behaves when dealing with many files

  • XML: ** 391041 files with 1 authority record each as XML (100 directories with about 3500-4000 files each) ** taking about 1,5GB of disk space
  • JSON: ** another copy of the same data in 350MB of JSON batch upload files for CouchDB

git add . … 200 seconds CPU time @ 25% CPU git commit … 100 seconds CPU time @ 25% CPU

.git folder size: 3,1GB

change a few lines in each file, 1600361 lines replaced

git add . … 220 seconds CPU time @ 25% CPU git commit … 330 seconds CPU time @ 30-80% CPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment