Complete configuration for running GPU workloads on AWS EKS with Karpenter v1.8 and G6f fractional GPU instances using multiple NodePools for dynamic instance selection.
kubectl configured to access the clusterhelm installed
| import os | |
| import docx | |
| from datetime import datetime | |
| from multiprocessing import Pool | |
| def extract_paragraphs(args): | |
| docx_file, keywords = args | |
| doc = docx.Document(docx_file) | |
| paragraphs = [] | |
| for para in doc.paragraphs: |
| mkdir ${HOME}/environment/efs_statefulset | |
| cd ${HOME}/environment/efs_statefulset | |
| curl -O https://raw.githubusercontent.com/kubernetes-sigs/aws-efs-csi-driver/master/docs/iam-policy-example.json | |
| EFS_CSI_POLICY_ARN=$(aws iam create-policy --policy-name AmazonEKS_EFS_CSI_Driver_Policy --policy-document file://iam-policy-example.json | jq -r '.Policy.Arn') | |
| echo $EFS_CSI_POLICY_ARN | |
| eksctl create iamserviceaccount \ | |
| --cluster eksworkshop-eksctl \ | |
| --namespace kube-system \ | |
| --name efs-csi-controller-sa \ | |
| --attach-policy-arn $EFS_CSI_POLICY_ARN \ |
This list is meant to be a both a quick guide and reference for further research into these topics. It's basically a summary of that comp sci course you never took or forgot about, so there's no way it can cover everything in depth. It also will be available as a gist on Github for everyone to edit and add to.
###Array ####Definition:
| { | |
| "Version": "2012-10-17", | |
| "Statement": [ | |
| { | |
| "Sid": "AllowAllUsersToListAccounts", | |
| "Effect": "Allow", | |
| "Action": [ | |
| "iam:ListAccountAliases", | |
| "iam:ListUsers", | |
| "iam:GetAccountPasswordPolicy", |
| Title | Description
| from __future__ import print_function | |
| import boto3 | |
| ec2 = boto3.client('ec2') | |
| ssm = boto3.client('ssm') | |
| tags ={'Key': os.environ['Tagname'], 'Value': os.environ['Tagvalue']} | |
| def find_viable_window (): | |
| #checks if the Tag Key value pair matches with an existing Maintenance Window | |
| wins = ssm.describe_maintenance_windows()['WindowIdentities'] | |
| for win in wins: |
I hereby claim:
To claim this, I am signing this object:
Whether you're trying to give back to the open source community or collaborating on your own projects, knowing how to properly fork and generate pull requests is essential. Unfortunately, it's quite easy to make mistakes or not know what you should do when you're initially learning the process. I know that I certainly had considerable initial trouble with it, and I found a lot of the information on GitHub and around the internet to be rather piecemeal and incomplete - part of the process described here, another there, common hangups in a different place, and so on.
In an attempt to coallate this information for myself and others, this short tutorial is what I've found to be fairly standard procedure for creating a fork, doing your work, issuing a pull request, and merging that pull request back into the original project.
Just head over to the GitHub page and click the "Fork" button. It's just that simple. Once you've done that, you can use your favorite git client to clone your repo or j
| #!/usr/bin/env bash | |
| # | |
| # gh-dl-release! It works! | |
| # | |
| # This script downloads an asset from latest or specific Github release of a | |
| # private repo. Feel free to extract more of the variables into command line | |
| # parameters. | |
| # | |
| # PREREQUISITES | |
| # |