Skip to content

Instantly share code, notes, and snippets.

@hnykda
Created April 20, 2019 14:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hnykda/7b2a2828bf03b40eda66a9c09841969f to your computer and use it in GitHub Desktop.
Save hnykda/7b2a2828bf03b40eda66a9c09841969f to your computer and use it in GitHub Desktop.
apiVersion: batch/v1
kind: Job
metadata:
labels:
app: pyxecutor
dan: test
name: orchestra-core-q1-2019-20190420-080653
namespace: pyxecspawner-jobs
spec:
backoffLimit: 1
parallelism: 1
template:
metadata:
creationTimestamp: null
labels:
app: pyxecutor
job-name: orchestra-core-q1-2019-20190420-080653
project_id: core
timestamp: 20190420-080653
wave: q1_2019
dan: test
workers: moreworksnocomplete
spec:
containers:
- args:
- --local-scheduler
- --workers
- "8"
- --module
- orchestra.luigi.tasks
- --Configuration-current-job-id
- 20190420-080653
- PipelineExecution
- --load-to-platform
- --qualtrics-download
command:
- luigi
env:
- name: GOOGLE_APPLICATION_CREDENTIALS
value: /usr/src/app/gcs-access-sa.json
- name: QUALTRICS_API_KEY
value: JPr0ghXHxmcKq21wWYQ3Pknyy6vcgK23s0IWzcYJ
- name: RUNNING_IN_DOCKER
value: "True"
- name: LOG_FORMAT
value: jsonlogger
- name: LOG_LEVEL
value: DEBUG
- name: SKIP_ERRORS
value: "False"
- name: SLACK_THREAD_TS
value: "1555747619.132600"
- name: SLACK_CHANNEL
value: pyxecutor-job-bot
- name: LUIGI_CONFIG_PATH
value: /usr/src/app/orchestra/waveconfig/core/q1_2019.cfg
image: eu.gcr.io/data-tooling-p/pyxecutor:3.1.6-alpha.4
imagePullPolicy: IfNotPresent
name: pyxecutor-job
resources:
requests:
memory: 50Gi
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
dnsPolicy: ClusterFirst
restartPolicy: Never
schedulerName: default-scheduler
securityContext: {}
terminationGracePeriodSeconds: 30
tolerations:
- effect: NoSchedule
key: pyxecjob
operator: Equal
value: "true"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment