Mat Morrison mediaczar

BACKGROUND

We want to benchmark our LinkedIn Company Page against a series of our competitors. As part of this, we want to collect data on their posts, and the engagement on their posts.

From a list of LinkedIn Company Pages -- e.g. (link removed):

Collect posts and their metadata (date published, social actions on the post, the user IDs of people who has engaged with the post etc. -- a full list is published below)

We expect to collect at least 100 posts per page. Note that LinkedIn pages have an “infinite scroll” feature.

Set up for Python

Consider installing iTerm2

There’s nothing wrong with the Terminal, but iTerm2 https://www.iterm2.com/

Install command line developer tools

xcode-select --install

Install separate version of python

/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)”

	#!/usr/bin/env python
	# -- coding: utf-8 --

	import fbtools as fb
	import json

	fb.token_string = fb.get_token()

	args = fb.get_args()

	#!/usr/bin/env/ python

	import requests
	from bs4 import BeautifulSoup

	def collect(year):
	url = "https://www.interbrand.com/best-brands/best-global-brands/%s/ranking" % str(year)
	html = requests.get(url)
	page = BeautifulSoup(html.text, features="html5lib")
	return page

	#!/usr/bin/env python
	# -- coding: utf-8 --

	###################
	import scraperwiki
	import requests
	import xmltodict
	import json
	import time

	#!/usr/bin/env python
	# -- coding: utf-8 --

	###################
	import scraperwiki
	import requests
	import xmltodict
	import json
	import time

	#!/usr/bin/env python

	from instagram.client import InstagramAPI

	access_token = '[this space intentionally left blank]'

	api = InstagramAPI(access_token=access_token)
	recent_media, next = api.user_recent_media() # What's happening here? I don't understand syntax

	#!/usr/bin/perl

	# bigramcount - counts the number of bigrams in a text,
	# prints them out in order of decreasing frequency.
	# author: Thapelo J. Otlogetswe
	# date: 2006-01-27
	# http://thaps.blogspot.co.uk/2006/01/perl-bigram-count.html
	# modified: Mat Morrison (@mediaczar)
	# date: 2013-01-06