Ankit Shekhawat ankitshekhawat

TensorFlow Serving in 10 minutes!

TensorFlow SERVING is Googles' recommended way to deploy TensorFlow models. Without proper computer engineering background, it can be quite intimidating, even for people who feel comfortable with TensorFlow itself. Few things that I've found particularly hard were:

Tutorial examples have C++ code (which I don't know)
Tutorials have Kubernetes, gRPG, Bezel (some of which I saw for the first time)
It needs to be compiled. That process takes forever!

After all, it worked just fine. Here I present an easiest possible way to deploy your models with TensorFlow Serving. You will have your self-built model running inside TF-Serving by the end of this tutorial. It will be scalable, and you will be able to query it via REST.

OS X Preferences

most of these require logout/restart to take effect

# Enable character repeat on keydown
defaults write -g ApplePressAndHoldEnabled -bool false

# Set a shorter Delay until key repeat

	#!/bin/env bash

	pip3 uninstall pillow

	apt install \
	libjpeg-turbo8-dev \
	zlib1g-dev \
	libtiff5-dev \
	liblcms2-dev \
	libfreetype6-dev \

	from bokeh.plotting import figure, output_file, show, ColumnDataSource
	from bokeh.models import HoverTool
	from bokeh.io import output_notebook
	output_notebook()

	source = ColumnDataSource(
	data=dict(
	x=[1, 2, 3, 4, 5],
	y=[2, 5, 8, 2, 7],
	desc=['A', 'b', 'C', 'd', 'E'],

	function product() {
	var args = Array.prototype.slice.call(arguments); // makes array from arguments
	return args.reduce(function tl (accumulator, value) {
	var tmp = [];
	accumulator.forEach(function (a0) {
	value.forEach(function (a1) {
	tmp.push(a0.concat(a1));
	});
	});
	return tmp;

	from flask import Flask
	from flask.json import JSONEncoder
	from bson import json_util
	from mongoengine.base import BaseDocument
	from mongoengine.queryset.base import BaseQuerySet

	class MongoEngineJSONEncoder(JSONEncoder):
	def default(self,obj):
	if isinstance(obj,BaseDocument):
	return json_util._json_convert(obj.to_mongo())

	# Make mouse useful in copy mode
	setw -g mode-mouse on

	# Allow mouse to select which pane to use
	set -g mouse-select-pane on

	# Allow mouse dragging to resize panes
	set -g mouse-resize-pane on

	# Allow mouse to select windows

	#!/bin/bash
	echo "Generating an SSL private key to sign your certificate..."
	openssl genrsa -des3 -out myssl.key 1024

	echo "Generating a Certificate Signing Request..."
	openssl req -new -key myssl.key -out myssl.csr

	echo "Removing passphrase from key (for nginx)..."
	cp myssl.key myssl.key.org
	openssl rsa -in myssl.key.org -out myssl.key