knil-sama
/ init_container_kubernetes.yaml
Last active
September 2, 2019 20:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| apiVersion: batch/v1beta1 | |
| kind: CronJob | |
| metadata: | |
| name: example | |
| namespace: default | |
| spec: | |
| schedule: '*/1 * * * *' | |
| jobTemplate: | |
| spec: | |
| template: |
knil-sama
/ env_envFrom_interpolation_cronjob.yaml
Created
August 11, 2019 10:00
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| command: ["script"] | |
| args: ["--aws-secret-access-key=$(AWS_SECRET_ACCESS_KEY_USER)", "--aws-access-key-id=$(AWS_ACCESS_KEY_ID_USER)", "--aws-region=$(AWS_DEFAULT_REGION)", | |
| "--postgres=$(POSTGRES_URI)","--s3-bucket=$(AWS_TRACKING_BUCKET)" | |
| envFrom: | |
| - secretRef: | |
| name: {{ .Values.secrets_postgres_database }} | |
| - configMapRef: | |
| name: {{ .Values.config_aws }} |
knil-sama
/ cronjob_run_current_catchup.sh
Last active
August 11, 2019 09:44
Comparer cronjob run current vs catchup
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #normal run that load yesterday data | |
| command: ["etl_script"] | |
| args: ["--bucket-name", "name"] | |
| #catchup run that load specific date | |
| command: ["etl_script"] | |
| args: ["--bucket-name", "name", "--start-date", "2018-02-1", "--end-date", "2018-03-01"] |
knil-sama
/ cronjob_pre_post.sh
Created
August 4, 2019 10:27
Example cronjoblogging starting and ending of job in kube
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kind: CronJob | |
| metadata: | |
| name: example | |
| spec: | |
| schedule: "10 3,15,20 * * *" | |
| concurrencyPolicy: "Forbid" | |
| suspend: false | |
| jobTemplate: | |
| spec: | |
| template: |
knil-sama
/ delete_old_job_kubernetes.sh
Last active
July 15, 2019 09:11
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kubectl get job -o json | jq --arg DATE "$(date '+%s' -d '1 day ago')" '.items[] | select(.metadata.creationTimestamp | fromdateiso8601 < $DATE) | .metadata.labels."job-name" | select(.!=null) ' |
knil-sama
/ remove_large_file_git.sh
Created
June 13, 2019 19:06
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| git filter-branch --tree-filter 'rm -f directory/large_file' HEAD |
knil-sama
/ duplicate_cronjob.sh
Last active
July 15, 2019 10:31
Create duplicated cronjob in the same namespace
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kubectl get cronjob <cronjob-name> -o json > /tmp/<cronjob-name>.json && sed -i 's/<cronjob-name>/<cronjob-name>-duplicate/' /tmp/<cronjob-name>.json && kubectl create -f /tmp/<cronjob-name>.json |
knil-sama
/ create_job_from_cronjob.sh
Last active
August 12, 2019 12:34
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kubectl create job --from=cronjob/<cronjob_name> job_name |
knil-sama
/ scrolling_vim
Created
January 29, 2019 13:03
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| map <F8> <C-E>:sleep 2500m<CR>j<F8> | |
| #then tape F8 |
knil-sama
/ small_sample_pypicloud_config.ini
Last active
January 14, 2019 21:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [app:main] | |
| use = egg:pypicloud | |
| pypi.storage = s3 | |
| storage.region_name = eu-west-1 | |
| storage.bucket = <placeholder> | |
| storage.prefix = packages/ | |
| storage.redirect_urls = true | |
| pypi.auth = sql |
NewerOlder