sudo apt install zsh-autosuggestions zsh-syntax-highlighting zsh
| ## Day 3 Materials | |
| git clone https://github.com/HKT-SSA/bring-your-own-container-on-sm.git | |
| git clone https://github.com/HKT-SSA/yolov5-on-sagemaker.git | |
| powerpoint: https://tinyurl.com/y43bxytx | |
| billing alert: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/monitor_estimated_charges_with_cloudwatch.html | |
| mlops: | |
| https://github.com/imyoungyang/myAWSStudyBlog/tree/master/ml-ops-poc | |
| https://github.com/imyoungyang/iam-nija-workshop |
| curl -o /home/ec2-user/SageMaker/xgboost_customer_churn_bootcamp_student.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/xgboost_customer_churn_bootcamp_student_EN_C.ipynb | |
| curl -o /home/ec2-user/SageMaker/xgboost_customer_churn_bootcamp_student_solution.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/xgboost_customer_churn_bootcamp_student_EN_C.ipynb | |
| curl -o /home/ec2-user/SageMaker/churn.txt https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/churn.txt | |
| curl -o /home/ec2-user/SageMaker/template-cloudwatch.yaml https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/template-cloudwatch.yaml | |
| curl -o /home/ec2-user/SageMaker/UsingDeepARtoForecastElectricityTimeSeriesData.ipynb https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/UsingDeepARtoForecastElectricityTimeSeriesData.ipynb | |
| curl -o /home/ec2-user/SageMaker/household_power_consumption.txt https://cathypersonalwebsite.s3.us-east-2.amazonaws.com/household_power_consumption.txt | |
| curl -o /home/ec2-user/SageMaker/labALL.zip htt |
| arn:aws:iam::<account-id>:role/SageMakerExecutionRole | |
| go to codecommit to create a repo "nlp-workshop-<your-id>" | |
| git clone https://git-codecommit.us-west-2.amazonaws.com/v1/repos/nlp-workshop | |
| create a notebooks using t3 with existing role | |
| arn:aws:iam::<account-id>:role/SageMakerExecutionRole | |
| wget https://bit.ly/35gjdDw -O workshop.zip | |
| wget https://bit.ly/2r4mcAi -O glove6b50dtxt.zip |
| # Bird | |
| !wget -O /tmp/test.jpg https://upload.wikimedia.org/wikipedia/commons/1/17/Rotkehlchen_bird.jpg | |
| file_name = '/tmp/test.jpg' | |
| from IPython.display import Image | |
| Image(file_name) | |
| # resize and padding | |
| from matplotlib.pyplot import imshow | |
| from PIL import Image | |
| import numpy as np |
A list of public repositories and content from re:Invent 2017 Workshops. Some of these repos also contain the slides from teh workshops as well, but not all. Many of the links are subject to be moved or completely removed at any point in time in the future.
| Session ID | Session Name | Repo |
|---|---|---|
| ABD313 | Building an End-to-End Serverless Data Analytics Solution on AWS | https://github.com/aws-samples/serverless-data-analytics |
| AMF303 | Deep Dive into the Connected Vehicle Reference Architecture | https://github.com/awslabs/aws-connected-vehicle-solution |
| ARC325 | Managing Multiple AWS Accounts at Scale | https://github.com/aws-samples/arc325-multiple-accounts-workshop |
| [2018-03-27T03:33:41.147Z][INFO]-Building artifact downloader edba2da8-2103-4ca7-98ec-e71b6ee342a9 : arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000 | |
| [2018-03-27T03:33:41.148Z][INFO]-Downloading edba2da8-2103-4ca7-98ec-e71b6ee342a9 : arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000 | |
| [2018-03-27T03:33:47.748Z][ERROR]-rollback of ArtifactDownloader.process(), cause: Error while unpacking the file from /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000/mlmodel to /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000, error: Invalid compressed file type for file: /greengrass/ggc/deployment/mlmodel/arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000/mlmodel, file type: application/octet-stream | |
| [2018-03-27T03:33:48.84Z][ERROR]-Greengrass deployment error: unable to download the artifact arn:aws:s3:::appml-squeezenet:squeezenet.zip::1522116683000: Error while processing. Error while unpacking the file fr |
| *for the kubernetes dashboard* | |
| kubectl proxy --port=8080 --address 0.0.0.0 --accept-hosts '.*' | |
| *port-forward* | |
| kubectl port-forward $(kubectl get po -l prometheus=prometheus -n monitoring -o jsonpath={.items[0].metadata.name}) 8080:9090 -n monitoring | |
| Forwarding from 127.0.0.1:8080 -> 9090 |
| import cv2 | |
| cap = cv2.VideoCapture(0) | |
| cap.set(3, 640) #WIDTH | |
| cap.set(4, 480) #HEIGHT | |
| face_cascade = cv2.CascadeClassifier('/usr/local/Cellar/opencv/2.4.13/share/OpenCV/haarcascades/haarcascade_frontalface_default.xml') | |
| eye_cascade = cv2.CascadeClassifier('/usr/local/Cellar/opencv/2.4.13/share/OpenCV/haarcascades/haarcascade_eye.xml') | |
| while(True): |
| Yahoo special: | |
| * flux-examples https://github.com/yahoo/flux-examples | |
| fluxible-app, fluxible-plugin-routr, and fluxible-plugin-fetchr. | |
| * fluxible-app https://github.com/yahoo/fluxible-app | |
| Pluggable container for isomorphic flux applications that provides interfaces that are common throughout the Flux architecture and restricts usage of these APIs to only the parts that need them to enforce the unidirectional flow. | |
| * fetchr https://github.com/yahoo/fetchr | |
| Fetchr augments Flux applications by allowing Flux stores to be used on server and client to fetch data |