This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python | |
import os | |
import sys | |
import urllib2 | |
import json | |
''' | |
This script queries Github for source and target branches of a pull request | |
and updates environment variables at TeamCity CI to make these variable |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/** | |
* Workaround for CRUNCH-102 bug (https://issues.apache.org/jira/browse/CRUNCH-102) | |
* | |
* If before executing union() operation on two PCollections, there was groupByKey() executed on one collection, | |
* but not on another, union() will only include data from the former collection. | |
* | |
* This bug was fixed in Crunch-0.4.0, but for those using CDH3 it still occurs. | |
* | |
* To prevent this bug, call this method on ungrouped collection before using it in union() operation. | |
* |