atilaromero/grep big file

Created August 14, 2019 18:33

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/atilaromero/1f678e8454364bbe723840fed6a5a5d6.js"></script>
Save atilaromero/1f678e8454364bbe723840fed6a5a5d6 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

grep big file

stdbuf -i0 -o0 -e0 cat image.dd | tr '\000' '\n' | parallel --pipe --block 1G --recend '' grep -Fabf keywords.txt --label={#} -H | tee results.srch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment