Skip to content

Instantly share code, notes, and snippets.

@jiayuasu

jiayuasu/Publish Sedona

Last active December 30, 2020 07:00
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jiayuasu/849e1f3bf7a2dd11593ca27c14e9e92d to your computer and use it in GitHub Desktop.
Save jiayuasu/849e1f3bf7a2dd11593ca27c14e9e92d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Publish Sedona
Maven:
https://infra.apache.org/publishing-maven-artifacts.html
https://repository.apache.org/
- Publish snapshots
- Publish Sedona for Spark 3.0 and Scala 2.12
python3 spark-version-converter.py spark3
mvn clean -Darguments="-DskipTests" release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false
mvn deploy -DskipTests
- Publish Sedona for Spark 2.4 and Scala 2.11
python3 spark-version-converter.py spark2
mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"
mvn deploy -DskipTests -Dscala=2.11 -Dspark=2.4
- Publish Sedona for Spark 2.4 and Scala 2.12
python3 spark-version-converter.py spark2
mvn clean release:prepare -DdryRun=true -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"
mvn deploy -DskipTests -Dscala=2.12 -Dspark=2.4
- Publish releases
- Publish Sedona for Spark 3.0 and Scala 2.12
python3 spark-version-converter.py spark3
- Stage a release (release id: 1.0.0-incubator, scm tag id: sedona-3.0_2.12-1.0.0-incubator)
mvn clean release:prepare -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"
mvn clean release:perform -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests"
- Publish Sedona for Spark 2.4 and Scala 2.11
python3 spark-version-converter.py spark2
- (then manuallly commit the changes of the scala files)
- Stage a release (release id: 1.0.0-incubator, scm tag id: sedona-2.4_2.11-1.0.0-incubator)
mvn clean release:prepare -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"
mvn clean release:perform -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.11 -Dspark=2.4"
- Publish Sedona for Spark 2.4 and Scala 2.12
python3 spark-version-converter.py spark2
- (then manuallly commit the changes of the scala files, if not committed before)
- Stage a release (release id: 1.0.0-incubator, scm tag id: sedona-2.4_2.12-1.0.0-incubator)
mvn clean release:prepare -DautoVersionSubmodules=true -Dresume=false -DcheckModificationExcludeList=sql/src/main/scala/org/apache/sedona/sql/UDF/UdfRegistrator.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/JoinQueryDetector.scala,sql/src/main/scala/org/apache/spark/sql/sedona_sql/strategy/join/TraitJoinQueryExec.scala -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"
mvn clean release:perform -DautoVersionSubmodules=true -Dresume=false -Darguments="-DskipTests -Dscala=2.12 -Dspark=2.4"
After staged the three releases, manually revert the commited three scala files.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment