Skip to content

Instantly share code, notes, and snippets.

@johnynek
Last active December 23, 2015 11:59
Show Gist options
  • Star 3 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save johnynek/6632488 to your computer and use it in GitHub Desktop.
Save johnynek/6632488 to your computer and use it in GitHub Desktop.
Sed rules for porting to scalding 0.9.0 from earlier versions. Run this in the directory with your jobs with gnu sed (brew install gnu-sed).
find . -type f -print0 | xargs -0 gsed -i 's/\.sum(/.sum[Double](/g'
find . -type f -print0 | xargs -0 gsed -i 's/\.plus\[/.sum[/g'
find . -type f -print0 | xargs -0 gsed -i 's/import com.twitter.scalding.DateOps.richDateToCalendar/import com.twitter.scalding.RichDate.toCalendar/'
find . -type f -print0 | xargs -0 gsed -i 's/ RichDate("\([^"]\+\)")(\([^)]\+\))/ com.twitter.scalding.DateParser.default.parse("\1")(\2).get/g'
find . -type f -print0 | xargs -0 gsed -i 's/\.then[^(Do)]/.thenDo/g'
find . -type f -print0 | xargs -0 gsed -i 's/Mode\.mode/mode/g'
find . -type f -print0 | xargs -0 gsed -i 's/new RichDate/RichDate/g'
@epishkin
Copy link

If you use old avro library then run

find . -type f -print0 | xargs -0 gsed -i 's/import scalding.avro/import com.twitter.scalding.avro/'

@epishkin
Copy link

the 1st command is wrong. Should be

find . -type f -print0 | xargs -0 gsed -i 's/\.sum(/.sum[Double](/g'

@johnynek
Copy link
Author

johnynek commented Apr 6, 2014

@epishkin thanks!

@ishaaq
Copy link

ishaaq commented May 18, 2014

If you're using Linux (at least the Debian/Ubuntu flavours), it's sed not gsed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment