Skip to content

Instantly share code, notes, and snippets.

@vinothchandar
Last active October 16, 2019 18:26
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save vinothchandar/b558d3a86ffe1e733c54d1305a44ec38 to your computer and use it in GitHub Desktop.
Save vinothchandar/b558d3a86ffe1e733c54d1305a44ec38 to your computer and use it in GitHub Desktop.
Apache Hudi Release Check
07:26:38 [Cache]$ RC_NUM=rc6
# Checksums and Signatures OK
07:26:42 [Cache]$ shasum -a 512 hudi-0.5.0-incubating-${RC_NUM}.src.tgz > sha512
07:26:58 [Cache]$ diff sha512 hudi-0.5.0-incubating-${RC_NUM}.src.tgz.sha512.txt | wc -l
0
07:27:19 [Cache]$ gpg --verify hudi-0.5.0-incubating-${RC_NUM}.src.tgz.asc.txt hudi-0.5.0-incubating-${RC_NUM}.src.tgz
gpg: Signature made Wed Oct 16 03:34:37 2019 PDT
gpg: using RSA key AF9BAF79D311A3D3288E583F24A499037262AAA4
gpg: Good signature from "Balaji Varadarajan <vbalaji@apache.org>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg: There is no indication that the signature belongs to the owner.
Primary key fingerprint: AF9B AF79 D311 A3D3 288E 583F 24A4 9903 7262 AAA4
07:27:47 [Cache]$
# Notice, DISCLAIMER-WIP, LICENSE
07:27:47 [Cache]$ ls hudi-0.5.0-incubating-${RC_NUM}/NOTICE
hudi-0.5.0-incubating-rc6/NOTICE
07:28:26 [Cache]$ ls hudi-0.5.0-incubating-${RC_NUM}/DISC*
hudi-0.5.0-incubating-rc6/DISCLAIMER-WIP
07:28:32 [Cache]$ ls hudi-0.5.0-incubating-${RC_NUM}/LICENSE
hudi-0.5.0-incubating-rc6/LICENSE
# No unexpected binaries
07:28:44 [Cache]$ find hudi-0.5.0-incubating-${RC_NUM}/ -name *.jar | wc -l
0
07:29:23 [Cache]$
# Every source file is attributed either with ASF license or in NOTICE file for others
07:29:23 [Cache]$ grep -LR "Licensed to the Apache Software Foundation" hudi-0.5.0-incubating-${RC_NUM}
hudi-0.5.0-incubating-rc6/docker/demo/data/batch_2.json
hudi-0.5.0-incubating-rc6/docker/demo/data/batch_1.json
hudi-0.5.0-incubating-rc6/LICENSE
hudi-0.5.0-incubating-rc6/DISCLAIMER-WIP
hudi-0.5.0-incubating-rc6/hudi-spark/src/main/scala/org/apache/hudi/AvroConversionHelper.scala
hudi-0.5.0-incubating-rc6/NOTICE
hudi-0.5.0-incubating-rc6/hudi-common/src/test/resources/sample.data
hudi-0.5.0-incubating-rc6/hudi-common/src/main/java/org/apache/hudi/common/util/ObjectSizeCalculator.java
hudi-0.5.0-incubating-rc6/hudi-utilities/src/test/resources/IncrementalPull.sqltemplate
07:31:22 [Cache]$ grep -e "AvroConversionHelper" -e "ObjectSizeCalculator" hudi-0.5.0-incubating-${RC_NUM}/LICENSE
This product includes code from https://github.com/twitter/commons/blob/master/src/java/com/twitter/common/objectsize/ObjectSizeCalculator.java with the following license
* org.apache.hudi.AvroConversionHelper copied from classes in com/databricks/spark/avro package
07:31:29 [Cache]$
# Validation script passes
07:32:54 [scripts]$ ./release/validate_staged_release.sh --release=0.5.0 --rc_num=6
/tmp/validation_scratch_dir_001 ~/Cache/hudi-0.5.0-incubating-rc6/scripts
Checking Checksum of Source Release
Checksum Check of Source Release - [OK]
Checking Signature
Signature Check - [OK]
Checking for binary files in source release
No Binary Files in Source Release? - [OK]
Checking for DISCLAIMERi-WIP
DISCLAIMER file exists ? [OK]
Checking for LICENSE and NOTICE
License file exists ? [OK]
Notice file exists ? [OK]
Performing custom Licensing Check
Licensing Check Passed [OK]
Running RAT Check
RAT Check Passed [OK]
~/Cache/hudi-0.5.0-incubating-rc6/scripts
07:33:39 [scripts]$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment