Created
April 12, 2020 19:24
-
-
Save viniciusmss/e99abdd3d35c6153a1443b7ec444c3df to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "nbformat": 4, | |
| "nbformat_minor": 0, | |
| "metadata": { | |
| "colab": { | |
| "name": "Causal Inference - Dona", | |
| "provenance": [], | |
| "collapsed_sections": [] | |
| }, | |
| "kernelspec": { | |
| "name": "ir", | |
| "display_name": "R" | |
| } | |
| }, | |
| "cells": [ | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "DRf0vcRj5ge0", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "**Causal Inference Assignment**\n", | |
| "[Github link](https://gist.github.com/donamobeen/2c6af73cbd144f93dbe7dae1d5a7f3ca)\n", | |
| "\n", | |
| "I recieved help from Yun-Te, Manh and Pedro. " | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "5hH-g1FuGVt8", | |
| "colab_type": "code", | |
| "outputId": "8622f020-8ea3-4246-9918-f17d0277036c", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 374 | |
| } | |
| }, | |
| "source": [ | |
| "install.packages(\"Matching\")\n", | |
| "install.packages(\"rgenoud\")\n", | |
| "install.packages(\"date\")\n", | |
| "library(Matching)" | |
| ], | |
| "execution_count": 3, | |
| "outputs": [ | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "Installing package into ‘/usr/local/lib/R/site-library’\n", | |
| "(as ‘lib’ is unspecified)\n", | |
| "\n", | |
| "Installing package into ‘/usr/local/lib/R/site-library’\n", | |
| "(as ‘lib’ is unspecified)\n", | |
| "\n", | |
| "Installing package into ‘/usr/local/lib/R/site-library’\n", | |
| "(as ‘lib’ is unspecified)\n", | |
| "\n", | |
| "Loading required package: MASS\n", | |
| "\n", | |
| "## \n", | |
| "## Matching (Version 4.9-7, Build Date: 2020-02-05)\n", | |
| "## See http://sekhon.berkeley.edu/matching for additional documentation.\n", | |
| "## Please cite software as:\n", | |
| "## Jasjeet S. Sekhon. 2011. ``Multivariate and Propensity Score Matching\n", | |
| "## Software with Automated Balance Optimization: The Matching package for R.''\n", | |
| "## Journal of Statistical Software, 42(7): 1-52. \n", | |
| "##\n", | |
| "\n", | |
| "\n" | |
| ], | |
| "name": "stderr" | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "mCOUOrqAIXHd", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 204 | |
| }, | |
| "outputId": "7fc9ccf9-d340-4f08-dd0c-f7bcc8e93112" | |
| }, | |
| "source": [ | |
| "##Question 1##\n", | |
| "##Part A##\n", | |
| "\n", | |
| "#importing data\n", | |
| "foo <- read.csv(url(\"https://course-resources.minerva.kgi.edu/uploaded_files/mke/00089202-1711/daughters.csv\"))\n", | |
| "head(foo)" | |
| ], | |
| "execution_count": 4, | |
| "outputs": [ | |
| { | |
| "output_type": "display_data", | |
| "data": { | |
| "text/plain": [ | |
| " X year congress party district statenam name ngirls nboys\n", | |
| "1 1 1997-1998 105 0 1 HAWAII ABERCROMBIE, NEIL 0 0 \n", | |
| "2 2 1997-1998 105 0 5 NEW YOR ACKERMAN, GARY L. 1 2 \n", | |
| "3 3 1997-1998 105 1 4 ALABAMA ADERHOLT, ROBERT B. 0 0 \n", | |
| "4 4 1997-1998 105 0 1 MAINE ALLEN, THOMAS H. 2 0 \n", | |
| "5 5 1997-1998 105 0 1 NEW JER ANDREWS, ROBERT E. 2 0 \n", | |
| "6 6 1997-1998 105 1 7 TEXAS ARCHER, W.R. 3 4 \n", | |
| " totchi ⋯ reg3 reg4 reg5 reg6 reg7 reg8 reg9 Dems Repubs OthParty\n", | |
| "1 0 ⋯ 0 0 0 0 0 0 1 1 0 0 \n", | |
| "2 3 ⋯ 0 0 0 0 0 0 0 1 0 0 \n", | |
| "3 0 ⋯ 0 0 0 1 0 0 0 0 1 0 \n", | |
| "4 2 ⋯ 0 0 0 0 0 0 0 1 0 0 \n", | |
| "5 2 ⋯ 0 0 0 0 0 0 0 1 0 0 \n", | |
| "6 7 ⋯ 0 0 0 0 1 0 0 0 1 0 " | |
| ], | |
| "text/latex": "A data.frame: 6 × 83\n\\begin{tabular}{r|lllllllllllllllllllll}\n & X & year & congress & party & district & statenam & name & ngirls & nboys & totchi & ⋯ & reg3 & reg4 & reg5 & reg6 & reg7 & reg8 & reg9 & Dems & Repubs & OthParty\\\\\n & <int> & <fct> & <int> & <int> & <int> & <fct> & <fct> & <int> & <int> & <int> & ⋯ & <int> & <int> & <int> & <int> & <int> & <int> & <int> & <int> & <int> & <int>\\\\\n\\hline\n\t1 & 1 & 1997-1998 & 105 & 0 & 1 & HAWAII & ABERCROMBIE, NEIL & 0 & 0 & 0 & ⋯ & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 1 & 0 & 0\\\\\n\t2 & 2 & 1997-1998 & 105 & 0 & 5 & NEW YOR & ACKERMAN, GARY L. & 1 & 2 & 3 & ⋯ & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & 0\\\\\n\t3 & 3 & 1997-1998 & 105 & 1 & 4 & ALABAMA & ADERHOLT, ROBERT B. & 0 & 0 & 0 & ⋯ & 0 & 0 & 0 & 1 & 0 & 0 & 0 & 0 & 1 & 0\\\\\n\t4 & 4 & 1997-1998 & 105 & 0 & 1 & MAINE & ALLEN, THOMAS H. & 2 & 0 & 2 & ⋯ & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & 0\\\\\n\t5 & 5 & 1997-1998 & 105 & 0 & 1 & NEW JER & ANDREWS, ROBERT E. & 2 & 0 & 2 & ⋯ & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 1 & 0 & 0\\\\\n\t6 & 6 & 1997-1998 & 105 & 1 & 7 & TEXAS & ARCHER, W.R. & 3 & 4 & 7 & ⋯ & 0 & 0 & 0 & 0 & 1 & 0 & 0 & 0 & 1 & 0\\\\\n\\end{tabular}\n", | |
| "text/markdown": "\nA data.frame: 6 × 83\n\n| <!--/--> | X <int> | year <fct> | congress <int> | party <int> | district <int> | statenam <fct> | name <fct> | ngirls <int> | nboys <int> | totchi <int> | ⋯ ⋯ | reg3 <int> | reg4 <int> | reg5 <int> | reg6 <int> | reg7 <int> | reg8 <int> | reg9 <int> | Dems <int> | Repubs <int> | OthParty <int> |\n|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|\n| 1 | 1 | 1997-1998 | 105 | 0 | 1 | HAWAII | ABERCROMBIE, NEIL | 0 | 0 | 0 | ⋯ | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 |\n| 2 | 2 | 1997-1998 | 105 | 0 | 5 | NEW YOR | ACKERMAN, GARY L. | 1 | 2 | 3 | ⋯ | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |\n| 3 | 3 | 1997-1998 | 105 | 1 | 4 | ALABAMA | ADERHOLT, ROBERT B. | 0 | 0 | 0 | ⋯ | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 1 | 0 |\n| 4 | 4 | 1997-1998 | 105 | 0 | 1 | MAINE | ALLEN, THOMAS H. | 2 | 0 | 2 | ⋯ | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |\n| 5 | 5 | 1997-1998 | 105 | 0 | 1 | NEW JER | ANDREWS, ROBERT E. | 2 | 0 | 2 | ⋯ | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |\n| 6 | 6 | 1997-1998 | 105 | 1 | 7 | TEXAS | ARCHER, W.R. | 3 | 4 | 7 | ⋯ | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 0 |\n\n", | |
| "text/html": [ | |
| "<table>\n", | |
| "<caption>A data.frame: 6 × 83</caption>\n", | |
| "<thead>\n", | |
| "\t<tr><th></th><th scope=col>X</th><th scope=col>year</th><th scope=col>congress</th><th scope=col>party</th><th scope=col>district</th><th scope=col>statenam</th><th scope=col>name</th><th scope=col>ngirls</th><th scope=col>nboys</th><th scope=col>totchi</th><th scope=col>⋯</th><th scope=col>reg3</th><th scope=col>reg4</th><th scope=col>reg5</th><th scope=col>reg6</th><th scope=col>reg7</th><th scope=col>reg8</th><th scope=col>reg9</th><th scope=col>Dems</th><th scope=col>Repubs</th><th scope=col>OthParty</th></tr>\n", | |
| "\t<tr><th></th><th scope=col><int></th><th scope=col><fct></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><fct></th><th scope=col><fct></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col>⋯</th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th><th scope=col><int></th></tr>\n", | |
| "</thead>\n", | |
| "<tbody>\n", | |
| "\t<tr><th scope=row>1</th><td>1</td><td>1997-1998</td><td>105</td><td>0</td><td>1</td><td>HAWAII </td><td>ABERCROMBIE, NEIL </td><td>0</td><td>0</td><td>0</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>1</td><td>0</td><td>0</td></tr>\n", | |
| "\t<tr><th scope=row>2</th><td>2</td><td>1997-1998</td><td>105</td><td>0</td><td>5</td><td>NEW YOR</td><td>ACKERMAN, GARY L. </td><td>1</td><td>2</td><td>3</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>0</td></tr>\n", | |
| "\t<tr><th scope=row>3</th><td>3</td><td>1997-1998</td><td>105</td><td>1</td><td>4</td><td>ALABAMA</td><td>ADERHOLT, ROBERT B.</td><td>0</td><td>0</td><td>0</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td></tr>\n", | |
| "\t<tr><th scope=row>4</th><td>4</td><td>1997-1998</td><td>105</td><td>0</td><td>1</td><td>MAINE </td><td>ALLEN, THOMAS H. </td><td>2</td><td>0</td><td>2</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>0</td></tr>\n", | |
| "\t<tr><th scope=row>5</th><td>5</td><td>1997-1998</td><td>105</td><td>0</td><td>1</td><td>NEW JER</td><td>ANDREWS, ROBERT E. </td><td>2</td><td>0</td><td>2</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>0</td></tr>\n", | |
| "\t<tr><th scope=row>6</th><td>6</td><td>1997-1998</td><td>105</td><td>1</td><td>7</td><td>TEXAS </td><td>ARCHER, W.R. </td><td>3</td><td>4</td><td>7</td><td>⋯</td><td>0</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td><td>0</td><td>0</td><td>1</td><td>0</td></tr>\n", | |
| "</tbody>\n", | |
| "</table>\n" | |
| ] | |
| }, | |
| "metadata": { | |
| "tags": [] | |
| } | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "l6D9-iGTM-Rl", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 442 | |
| }, | |
| "outputId": "2860785b-8049-4167-dab0-15df082d2207" | |
| }, | |
| "source": [ | |
| "#Running a regression\n", | |
| "reg <- lm(foo$nowtot~foo$Dems+foo$Repubs+foo$Christian+foo$age+foo$srvlng+foo$demvote+foo$hasgirls)\n", | |
| "summary(reg)" | |
| ], | |
| "execution_count": 5, | |
| "outputs": [ | |
| { | |
| "output_type": "display_data", | |
| "data": { | |
| "text/plain": [ | |
| "\n", | |
| "Call:\n", | |
| "lm(formula = foo$nowtot ~ foo$Dems + foo$Repubs + foo$Christian + \n", | |
| " foo$age + foo$srvlng + foo$demvote + foo$hasgirls)\n", | |
| "\n", | |
| "Residuals:\n", | |
| " Min 1Q Median 3Q Max \n", | |
| "-56.028 -10.322 -1.517 11.208 69.642 \n", | |
| "\n", | |
| "Coefficients:\n", | |
| " Estimate Std. Error t value Pr(>|t|) \n", | |
| "(Intercept) 38.6991 18.6306 2.077 0.038390 * \n", | |
| "foo$Dems -8.1022 17.5861 -0.461 0.645238 \n", | |
| "foo$Repubs -55.1069 17.6340 -3.125 0.001901 ** \n", | |
| "foo$Christian -13.3961 3.7218 -3.599 0.000357 ***\n", | |
| "foo$age 0.1260 0.1117 1.128 0.259938 \n", | |
| "foo$srvlng -0.2251 0.1355 -1.662 0.097349 . \n", | |
| "foo$demvote 87.5501 8.4847 10.319 < 2e-16 ***\n", | |
| "foo$hasgirls -0.4523 1.9036 -0.238 0.812322 \n", | |
| "---\n", | |
| "Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1\n", | |
| "\n", | |
| "Residual standard error: 17.19 on 422 degrees of freedom\n", | |
| "Multiple R-squared: 0.7821,\tAdjusted R-squared: 0.7784 \n", | |
| "F-statistic: 216.3 on 7 and 422 DF, p-value: < 2.2e-16\n" | |
| ] | |
| }, | |
| "metadata": { | |
| "tags": [] | |
| } | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "yAMJafUbQXNu", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "In the summary we see that the coefficient for variable 'hasgirls' = -0.4523. We also see that this result is not statistically significant (0.81 Pr(>|t|)) from the code. The coefficient suggests that having a girl would imply voting 0.4523 points less in agreement with the National Organization for Women. However, we can dismiss this due to the lack of significance." | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "a9-F4-c3QrdS", | |
| "colab_type": "code", | |
| "colab": {} | |
| }, | |
| "source": [ | |
| "#Genetic Matching\n", | |
| "set.seed(989)\n", | |
| "genout <- GenMatch(Tr = foo$hasgirls, X = cbind(foo$Dems, foo$Repubs, foo$Christian, foo$age, foo$srvlng, foo$demvote), pop.size = 500, nboots = 10, estimand=\"ATT\")\n", | |
| "\n", | |
| "mout <- Match(Tr = foo$hasgirls, X = cbind(foo$Dems, foo$Repubs, foo$Christian, foo$age, foo$srvlng, foo$demvote), Weight.matrix = genout, estimand=\"ATT\")\n", | |
| "\n", | |
| "MatchBalance(foo$hasgirls~foo$Dems+foo$Repubs+foo$Christian+foo$age+foo$srvlng+foo$demvote , match.out = mout)" | |
| ], | |
| "execution_count": 0, | |
| "outputs": [] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "fn91xUeKJJA2", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "After performing matching, we can see that it was highly effective. Before we performed matching, the lowest p-value for Age was significant at 'p-value: < 2.2e-16' between the treatment and control groups. After performing Matching, we see that the minimum p-value is 0.55, (for srvlng) indicating no significant difference at all. \n" | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "_EHmBghkR9Vt", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 1000 | |
| }, | |
| "outputId": "b11dd9a1-313c-4d85-b1e5-9cd1c7442104" | |
| }, | |
| "source": [ | |
| "#Getting the treatment effect\n", | |
| "set.seed(1234)\n", | |
| "genout <- GenMatch(Tr = foo$hasgirls, X = cbind(foo$Dems, foo$Repubs, foo$Christian, foo$age, foo$srvlng, foo$demvote), pop.size = 500, nboots = 10, M=1, estimand=\"ATT\")\n", | |
| "\n", | |
| "mout <- Match(Y=foo$nowtot, Tr = foo$hasgirls, X = cbind(foo$Dems, foo$Repubs, foo$Christian, foo$age, foo$srvlng, foo$demvote), Weight.matrix = genout, M=1, estimand=\"ATT\")\n", | |
| "summary(mout)" | |
| ], | |
| "execution_count": 9, | |
| "outputs": [ | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "\n", | |
| "\n", | |
| "Fri Apr 10 13:15:30 2020\n", | |
| "Domains:\n", | |
| " 0.000000e+00 <= X1 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X2 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X3 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X4 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X5 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X6 <= 1.000000e+03 \n", | |
| "\n", | |
| "Data Type: Floating Point\n", | |
| "Operators (code number, name, population) \n", | |
| "\t(1) Cloning........................... \t65\n", | |
| "\t(2) Uniform Mutation.................. \t62\n", | |
| "\t(3) Boundary Mutation................. \t62\n", | |
| "\t(4) Non-Uniform Mutation.............. \t62\n", | |
| "\t(5) Polytope Crossover................ \t62\n", | |
| "\t(6) Simple Crossover.................. \t62\n", | |
| "\t(7) Whole Non-Uniform Mutation........ \t62\n", | |
| "\t(8) Heuristic Crossover............... \t62\n", | |
| "\t(9) Local-Minimum Crossover........... \t0\n", | |
| "\n", | |
| "SOFT Maximum Number of Generations: 100\n", | |
| "Maximum Nonchanging Generations: 4\n", | |
| "Population size : 500\n", | |
| "Convergence Tolerance: 1.000000e-03\n", | |
| "\n", | |
| "Not Using the BFGS Derivative Based Optimizer on the Best Individual Each Generation.\n", | |
| "Not Checking Gradients before Stopping.\n", | |
| "Using Out of Bounds Individuals.\n", | |
| "\n", | |
| "Maximization Problem.\n", | |
| "GENERATION: 0 (initializing the population)\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.000000e-01 6.385557e-01 6.989484e-01 7.834072e-01 8.000000e-01 8.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 500, #Total UniqueCount: 500\n", | |
| "var 1:\n", | |
| "best............ 7.921295e+02\n", | |
| "mean............ 4.947380e+02\n", | |
| "variance........ 8.498855e+04\n", | |
| "var 2:\n", | |
| "best............ 4.301657e+02\n", | |
| "mean............ 5.055468e+02\n", | |
| "variance........ 8.192001e+04\n", | |
| "var 3:\n", | |
| "best............ 9.617333e+02\n", | |
| "mean............ 4.975913e+02\n", | |
| "variance........ 8.937009e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 5.004925e+02\n", | |
| "variance........ 8.703159e+04\n", | |
| "var 5:\n", | |
| "best............ 1.060612e+02\n", | |
| "mean............ 5.061838e+02\n", | |
| "variance........ 8.229899e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 4.921350e+02\n", | |
| "variance........ 8.808858e+04\n", | |
| "\n", | |
| "GENERATION: 1\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.385557e-01 6.989484e-01 7.834072e-01 8.000000e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 369, #Total UniqueCount: 869\n", | |
| "var 1:\n", | |
| "best............ 7.921295e+02\n", | |
| "mean............ 5.912130e+02\n", | |
| "variance........ 5.747697e+04\n", | |
| "var 2:\n", | |
| "best............ 4.301657e+02\n", | |
| "mean............ 3.849549e+02\n", | |
| "variance........ 3.275161e+04\n", | |
| "var 3:\n", | |
| "best............ 9.709087e+02\n", | |
| "mean............ 6.056050e+02\n", | |
| "variance........ 1.026726e+05\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 7.078297e+02\n", | |
| "variance........ 3.470404e+04\n", | |
| "var 5:\n", | |
| "best............ 1.060612e+02\n", | |
| "mean............ 2.339183e+02\n", | |
| "variance........ 3.782003e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.905111e+02\n", | |
| "variance........ 2.865223e+04\n", | |
| "\n", | |
| "GENERATION: 2\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.385557e-01 6.989484e-01 7.834072e-01 9.000000e-01 9.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 333, #Total UniqueCount: 1202\n", | |
| "var 1:\n", | |
| "best............ 7.921295e+02\n", | |
| "mean............ 7.443157e+02\n", | |
| "variance........ 1.565347e+04\n", | |
| "var 2:\n", | |
| "best............ 4.301657e+02\n", | |
| "mean............ 4.188580e+02\n", | |
| "variance........ 9.470136e+03\n", | |
| "var 3:\n", | |
| "best............ 7.812749e+02\n", | |
| "mean............ 7.663325e+02\n", | |
| "variance........ 8.431917e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.523287e+02\n", | |
| "variance........ 9.741255e+03\n", | |
| "var 5:\n", | |
| "best............ 1.060612e+02\n", | |
| "mean............ 1.349395e+02\n", | |
| "variance........ 1.031445e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.280923e+02\n", | |
| "variance........ 9.341913e+03\n", | |
| "\n", | |
| "GENERATION: 3\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.385557e-01 6.989484e-01 7.834072e-01 9.000000e-01 9.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 344, #Total UniqueCount: 1546\n", | |
| "var 1:\n", | |
| "best............ 7.921295e+02\n", | |
| "mean............ 7.646301e+02\n", | |
| "variance........ 1.143208e+04\n", | |
| "var 2:\n", | |
| "best............ 4.301657e+02\n", | |
| "mean............ 4.187919e+02\n", | |
| "variance........ 1.218735e+04\n", | |
| "var 3:\n", | |
| "best............ 7.812749e+02\n", | |
| "mean............ 7.698951e+02\n", | |
| "variance........ 3.062484e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.504103e+02\n", | |
| "variance........ 6.080516e+03\n", | |
| "var 5:\n", | |
| "best............ 1.060612e+02\n", | |
| "mean............ 1.304775e+02\n", | |
| "variance........ 1.054585e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.218186e+02\n", | |
| "variance........ 8.048822e+03\n", | |
| "\n", | |
| "GENERATION: 4\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.632608e-01 6.977754e-01 7.000000e-01 7.253681e-01 8.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 316, #Total UniqueCount: 1862\n", | |
| "var 1:\n", | |
| "best............ 7.920612e+02\n", | |
| "mean............ 7.701416e+02\n", | |
| "variance........ 1.074884e+04\n", | |
| "var 2:\n", | |
| "best............ 3.333195e+02\n", | |
| "mean............ 4.230592e+02\n", | |
| "variance........ 7.339656e+03\n", | |
| "var 3:\n", | |
| "best............ 7.292168e+02\n", | |
| "mean............ 7.708624e+02\n", | |
| "variance........ 1.374837e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.505156e+02\n", | |
| "variance........ 5.175364e+03\n", | |
| "var 5:\n", | |
| "best............ 9.587710e+01\n", | |
| "mean............ 1.304632e+02\n", | |
| "variance........ 9.629210e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.213792e+02\n", | |
| "variance........ 6.164039e+03\n", | |
| "\n", | |
| "GENERATION: 5\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.000000e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 350, #Total UniqueCount: 2212\n", | |
| "var 1:\n", | |
| "best............ 7.920473e+02\n", | |
| "mean............ 7.671781e+02\n", | |
| "variance........ 1.027341e+04\n", | |
| "var 2:\n", | |
| "best............ 3.158115e+02\n", | |
| "mean............ 3.964499e+02\n", | |
| "variance........ 9.662454e+03\n", | |
| "var 3:\n", | |
| "best............ 7.186669e+02\n", | |
| "mean............ 7.375898e+02\n", | |
| "variance........ 1.087603e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.469751e+02\n", | |
| "variance........ 7.401241e+03\n", | |
| "var 5:\n", | |
| "best............ 9.403311e+01\n", | |
| "mean............ 1.240953e+02\n", | |
| "variance........ 9.500541e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.231688e+02\n", | |
| "variance........ 8.032402e+03\n", | |
| "\n", | |
| "GENERATION: 6\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 8.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 348, #Total UniqueCount: 2560\n", | |
| "var 1:\n", | |
| "best............ 7.920508e+02\n", | |
| "mean............ 7.637283e+02\n", | |
| "variance........ 1.266526e+04\n", | |
| "var 2:\n", | |
| "best............ 3.201481e+02\n", | |
| "mean............ 3.483067e+02\n", | |
| "variance........ 6.656385e+03\n", | |
| "var 3:\n", | |
| "best............ 6.104503e+02\n", | |
| "mean............ 6.497027e+02\n", | |
| "variance........ 3.463227e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.467098e+02\n", | |
| "variance........ 6.281683e+03\n", | |
| "var 5:\n", | |
| "best............ 9.448985e+01\n", | |
| "mean............ 1.145561e+02\n", | |
| "variance........ 8.853601e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.175271e+02\n", | |
| "variance........ 7.322054e+03\n", | |
| "\n", | |
| "GENERATION: 7\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 9.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 360, #Total UniqueCount: 2920\n", | |
| "var 1:\n", | |
| "best............ 7.920486e+02\n", | |
| "mean............ 7.683593e+02\n", | |
| "variance........ 1.110632e+04\n", | |
| "var 2:\n", | |
| "best............ 3.174281e+02\n", | |
| "mean............ 3.290377e+02\n", | |
| "variance........ 4.666123e+03\n", | |
| "var 3:\n", | |
| "best............ 6.677376e+02\n", | |
| "mean............ 6.465948e+02\n", | |
| "variance........ 1.298895e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.522575e+02\n", | |
| "variance........ 4.364021e+03\n", | |
| "var 5:\n", | |
| "best............ 9.420336e+01\n", | |
| "mean............ 1.149735e+02\n", | |
| "variance........ 6.760309e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.274755e+02\n", | |
| "variance........ 9.858245e+03\n", | |
| "\n", | |
| "GENERATION: 8\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 360, #Total UniqueCount: 3280\n", | |
| "var 1:\n", | |
| "best............ 7.920492e+02\n", | |
| "mean............ 7.794939e+02\n", | |
| "variance........ 5.261261e+03\n", | |
| "var 2:\n", | |
| "best............ 3.181587e+02\n", | |
| "mean............ 3.298093e+02\n", | |
| "variance........ 6.234174e+03\n", | |
| "var 3:\n", | |
| "best............ 6.324659e+02\n", | |
| "mean............ 6.152440e+02\n", | |
| "variance........ 1.939690e+04\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.461639e+02\n", | |
| "variance........ 5.818126e+03\n", | |
| "var 5:\n", | |
| "best............ 9.428031e+01\n", | |
| "mean............ 1.153821e+02\n", | |
| "variance........ 8.962502e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.168350e+02\n", | |
| "variance........ 5.890844e+03\n", | |
| "\n", | |
| "GENERATION: 9\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 335, #Total UniqueCount: 3615\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 7.801526e+02\n", | |
| "variance........ 4.965463e+03\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.306802e+02\n", | |
| "variance........ 5.950864e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.438477e+02\n", | |
| "variance........ 9.522980e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.473968e+02\n", | |
| "variance........ 5.278932e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.238076e+02\n", | |
| "variance........ 1.131116e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.219869e+02\n", | |
| "variance........ 7.083450e+03\n", | |
| "\n", | |
| "GENERATION: 10\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 339, #Total UniqueCount: 3954\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 6.630080e+02\n", | |
| "variance........ 2.516019e+04\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.252980e+02\n", | |
| "variance........ 4.209039e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.334273e+02\n", | |
| "variance........ 6.919551e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.487402e+02\n", | |
| "variance........ 4.654709e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.248277e+02\n", | |
| "variance........ 1.172101e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.161577e+02\n", | |
| "variance........ 5.073483e+03\n", | |
| "\n", | |
| "GENERATION: 11\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 223, #Total UniqueCount: 4177\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 5.721707e+02\n", | |
| "variance........ 1.669436e+04\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.266946e+02\n", | |
| "variance........ 3.877359e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.320737e+02\n", | |
| "variance........ 5.875845e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.515582e+02\n", | |
| "variance........ 5.465256e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.145031e+02\n", | |
| "variance........ 7.434838e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.208137e+02\n", | |
| "variance........ 7.823791e+03\n", | |
| "\n", | |
| "GENERATION: 12\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 212, #Total UniqueCount: 4389\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 5.156703e+02\n", | |
| "variance........ 4.388116e+03\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.240172e+02\n", | |
| "variance........ 3.693398e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.267403e+02\n", | |
| "variance........ 6.275624e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.518000e+02\n", | |
| "variance........ 4.849907e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.166713e+02\n", | |
| "variance........ 8.470375e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.195158e+02\n", | |
| "variance........ 6.722686e+03\n", | |
| "\n", | |
| "GENERATION: 13\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 214, #Total UniqueCount: 4603\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 5.154154e+02\n", | |
| "variance........ 5.031503e+03\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.281198e+02\n", | |
| "variance........ 5.013813e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.352616e+02\n", | |
| "variance........ 4.171112e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.494835e+02\n", | |
| "variance........ 5.251653e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.155336e+02\n", | |
| "variance........ 8.086329e+03\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.188318e+02\n", | |
| "variance........ 5.611674e+03\n", | |
| "\n", | |
| "GENERATION: 14\n", | |
| "Lexical Fit..... 3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 202, #Total UniqueCount: 4805\n", | |
| "var 1:\n", | |
| "best............ 5.185437e+02\n", | |
| "mean............ 5.150350e+02\n", | |
| "variance........ 4.061656e+03\n", | |
| "var 2:\n", | |
| "best............ 3.171574e+02\n", | |
| "mean............ 3.258431e+02\n", | |
| "variance........ 4.501720e+03\n", | |
| "var 3:\n", | |
| "best............ 6.403282e+02\n", | |
| "mean............ 6.347304e+02\n", | |
| "variance........ 3.117276e+03\n", | |
| "var 4:\n", | |
| "best............ 6.583800e+02\n", | |
| "mean............ 6.569916e+02\n", | |
| "variance........ 3.088612e+03\n", | |
| "var 5:\n", | |
| "best............ 9.417484e+01\n", | |
| "mean............ 1.193729e+02\n", | |
| "variance........ 1.018731e+04\n", | |
| "var 6:\n", | |
| "best............ 2.022406e+02\n", | |
| "mean............ 2.202708e+02\n", | |
| "variance........ 6.892943e+03\n", | |
| "\n", | |
| "'wait.generations' limit reached.\n", | |
| "No significant improvement in 4 generations.\n", | |
| "\n", | |
| "Solution Lexical Fitness Value:\n", | |
| "3.173124e-01 3.173124e-01 6.756622e-01 6.982337e-01 7.253681e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "\n", | |
| "Parameters at the Solution:\n", | |
| "\n", | |
| " X[ 1] :\t5.185437e+02\n", | |
| " X[ 2] :\t3.171574e+02\n", | |
| " X[ 3] :\t6.403282e+02\n", | |
| " X[ 4] :\t6.583800e+02\n", | |
| " X[ 5] :\t9.417484e+01\n", | |
| " X[ 6] :\t2.022406e+02\n", | |
| "\n", | |
| "Solution Found Generation 9\n", | |
| "Number of Generations Run 14\n", | |
| "\n", | |
| "Fri Apr 10 13:16:25 2020\n", | |
| "Total run time : 0 hours 0 minutes and 55 seconds\n", | |
| "\n", | |
| "Estimate... 0.74519 \n", | |
| "AI SE...... 2.2228 \n", | |
| "T-stat..... 0.33525 \n", | |
| "p.val...... 0.73744 \n", | |
| "\n", | |
| "Original number of observations.............. 430 \n", | |
| "Original number of treated obs............... 312 \n", | |
| "Matched number of observations............... 312 \n", | |
| "Matched number of observations (unweighted). 313 \n", | |
| "\n" | |
| ], | |
| "name": "stdout" | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "kQBwuTT2PEZs", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "We can see from the above code that the treatment effect is 0.74519, with the p-value at 0.73744 which is not statistically significant. Following from these results we cannot discard the null hypothesis that there is no significant difference between treatment and control." | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "vjYnR4IsT1Cb", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 442 | |
| }, | |
| "outputId": "810488ee-876c-4737-fa7a-343e985b18fe" | |
| }, | |
| "source": [ | |
| "##PART B##\n", | |
| "#Treatment: 2 girls and no boys, Control: 2 boys and no girls \n", | |
| "nfoo = data.frame(foo)\n", | |
| "girlsdata = nfoo$ngirls==2 & nfoo$totchi==2\n", | |
| "boysdata = nfoo$nboys==2 & nfoo$totchi==2\n", | |
| "filter = girlsdata | boysdata\n", | |
| "nfoo = nfoo[filter,]\n", | |
| "#regression\n", | |
| "reg2 <- lm(nfoo$nowtot~nfoo$Dems+nfoo$Repubs+nfoo$Christian+nfoo$age+nfoo$srvlng+nfoo$demvote+nfoo$hasgirls)\n", | |
| "summary(reg2)" | |
| ], | |
| "execution_count": 15, | |
| "outputs": [ | |
| { | |
| "output_type": "display_data", | |
| "data": { | |
| "text/plain": [ | |
| "\n", | |
| "Call:\n", | |
| "lm(formula = nfoo$nowtot ~ nfoo$Dems + nfoo$Repubs + nfoo$Christian + \n", | |
| " nfoo$age + nfoo$srvlng + nfoo$demvote + nfoo$hasgirls)\n", | |
| "\n", | |
| "Residuals:\n", | |
| " Min 1Q Median 3Q Max \n", | |
| "-54.665 -4.266 0.512 8.109 24.145 \n", | |
| "\n", | |
| "Coefficients: (1 not defined because of singularities)\n", | |
| " Estimate Std. Error t value Pr(>|t|) \n", | |
| "(Intercept) -25.5073 18.5535 -1.375 0.175089 \n", | |
| "nfoo$Dems 55.9167 4.8958 11.421 8.67e-16 ***\n", | |
| "nfoo$Repubs NA NA NA NA \n", | |
| "nfoo$Christian 1.1113 8.7391 0.127 0.899298 \n", | |
| "nfoo$age -0.0159 0.2662 -0.060 0.952615 \n", | |
| "nfoo$srvlng 0.1017 0.2846 0.357 0.722309 \n", | |
| "nfoo$demvote 68.0931 18.9100 3.601 0.000708 ***\n", | |
| "nfoo$hasgirls 13.2027 3.7620 3.510 0.000936 ***\n", | |
| "---\n", | |
| "Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1\n", | |
| "\n", | |
| "Residual standard error: 13.42 on 52 degrees of freedom\n", | |
| "Multiple R-squared: 0.8921,\tAdjusted R-squared: 0.8797 \n", | |
| "F-statistic: 71.68 on 6 and 52 DF, p-value: < 2.2e-16\n" | |
| ] | |
| }, | |
| "metadata": { | |
| "tags": [] | |
| } | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "V29dqYkEWqGG", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "As seen from the results above, the coefficient for the variable 'hasgirls' is 13.2027 which is positive. We also observe that this estimate is statistically significant at Pr(>|t|) = 0.000936.\n" | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "OljsshJSZpnq", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 1000 | |
| }, | |
| "outputId": "6208c9ca-35a2-42fa-c368-6a8ecad6af9a" | |
| }, | |
| "source": [ | |
| "#Genetic Matching\n", | |
| "set.seed(1234)\n", | |
| "genout <- GenMatch(Tr = nfoo$hasgirls, X = cbind(nfoo$Dems, nfoo$Repubs, nfoo$Christian, nfoo$age, nfoo$srvlng, nfoo$demvote), pop.size = 500, nboots = 10, M=1, estimand=\"ATT\")\n", | |
| "\n", | |
| "mout <- Match(Y=nfoo$nowtot, Tr = nfoo$hasgirls, X = cbind(nfoo$Dems, nfoo$Repubs, nfoo$Christian, nfoo$age, nfoo$srvlng, nfoo$demvote), Weight.matrix = genout, M=1, estimand=\"ATT\")\n", | |
| "MatchBalance(nfoo$hasgirls~nfoo$Dems+nfoo$Repubs+nfoo$Christian+nfoo$age+nfoo$srvlng+nfoo$demvote, match.out = mout)" | |
| ], | |
| "execution_count": 16, | |
| "outputs": [ | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "\n", | |
| "\n", | |
| "Fri Apr 10 14:05:37 2020\n", | |
| "Domains:\n", | |
| " 0.000000e+00 <= X1 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X2 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X3 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X4 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X5 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X6 <= 1.000000e+03 \n", | |
| "\n", | |
| "Data Type: Floating Point\n", | |
| "Operators (code number, name, population) \n", | |
| "\t(1) Cloning........................... \t65\n", | |
| "\t(2) Uniform Mutation.................. \t62\n", | |
| "\t(3) Boundary Mutation................. \t62\n", | |
| "\t(4) Non-Uniform Mutation.............. \t62\n", | |
| "\t(5) Polytope Crossover................ \t62\n", | |
| "\t(6) Simple Crossover.................. \t62\n", | |
| "\t(7) Whole Non-Uniform Mutation........ \t62\n", | |
| "\t(8) Heuristic Crossover............... \t62\n", | |
| "\t(9) Local-Minimum Crossover........... \t0\n", | |
| "\n", | |
| "SOFT Maximum Number of Generations: 100\n", | |
| "Maximum Nonchanging Generations: 4\n", | |
| "Population size : 500\n", | |
| "Convergence Tolerance: 1.000000e-03\n", | |
| "\n", | |
| "Not Using the BFGS Derivative Based Optimizer on the Best Individual Each Generation.\n", | |
| "Not Checking Gradients before Stopping.\n", | |
| "Using Out of Bounds Individuals.\n", | |
| "\n", | |
| "Maximization Problem.\n", | |
| "GENERATION: 0 (initializing the population)\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.000000e-01 5.980396e-01 6.772148e-01 6.956040e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 500, #Total UniqueCount: 500\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 4.947380e+02\n", | |
| "variance........ 8.498855e+04\n", | |
| "var 2:\n", | |
| "best............ 3.726836e+02\n", | |
| "mean............ 5.055468e+02\n", | |
| "variance........ 8.192001e+04\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 4.975913e+02\n", | |
| "variance........ 8.937009e+04\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.004925e+02\n", | |
| "variance........ 8.703159e+04\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 5.061838e+02\n", | |
| "variance........ 8.229899e+04\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.921350e+02\n", | |
| "variance........ 8.808858e+04\n", | |
| "\n", | |
| "GENERATION: 1\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 7.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 375, #Total UniqueCount: 875\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 5.566018e+02\n", | |
| "variance........ 6.199914e+04\n", | |
| "var 2:\n", | |
| "best............ 2.601264e+02\n", | |
| "mean............ 3.473297e+02\n", | |
| "variance........ 4.069107e+04\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 4.521894e+02\n", | |
| "variance........ 4.392144e+04\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 6.109677e+02\n", | |
| "variance........ 2.739603e+04\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 5.692932e+02\n", | |
| "variance........ 9.657713e+04\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 1.431777e+02\n", | |
| "variance........ 4.781987e+04\n", | |
| "\n", | |
| "GENERATION: 2\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 321, #Total UniqueCount: 1196\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 6.064013e+02\n", | |
| "variance........ 1.641238e+04\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 3.382777e+02\n", | |
| "variance........ 4.363548e+04\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 4.740710e+02\n", | |
| "variance........ 2.019220e+04\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.835669e+02\n", | |
| "variance........ 1.032448e+04\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 7.594303e+02\n", | |
| "variance........ 5.590071e+04\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.708232e+01\n", | |
| "variance........ 1.209098e+04\n", | |
| "\n", | |
| "GENERATION: 3\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 328, #Total UniqueCount: 1524\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 5.993702e+02\n", | |
| "variance........ 8.328113e+03\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 3.773022e+02\n", | |
| "variance........ 2.747716e+04\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 5.123538e+02\n", | |
| "variance........ 1.312628e+04\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.844687e+02\n", | |
| "variance........ 8.414983e+03\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 8.375346e+02\n", | |
| "variance........ 7.403127e+03\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.830007e+01\n", | |
| "variance........ 1.291928e+04\n", | |
| "\n", | |
| "GENERATION: 4\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 201, #Total UniqueCount: 1725\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 5.979100e+02\n", | |
| "variance........ 5.820014e+03\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 4.185531e+02\n", | |
| "variance........ 1.583522e+04\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 5.170311e+02\n", | |
| "variance........ 8.350618e+03\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.864981e+02\n", | |
| "variance........ 6.989333e+03\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 8.391280e+02\n", | |
| "variance........ 7.202103e+03\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.517366e+01\n", | |
| "variance........ 1.062443e+04\n", | |
| "\n", | |
| "GENERATION: 5\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 216, #Total UniqueCount: 1941\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 5.956724e+02\n", | |
| "variance........ 8.421519e+03\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 4.510076e+02\n", | |
| "variance........ 7.114628e+03\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 5.304158e+02\n", | |
| "variance........ 5.821963e+03\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.824598e+02\n", | |
| "variance........ 6.654927e+03\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 8.309138e+02\n", | |
| "variance........ 1.083888e+04\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.521150e+01\n", | |
| "variance........ 1.129980e+04\n", | |
| "\n", | |
| "GENERATION: 6\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 196, #Total UniqueCount: 2137\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 6.047721e+02\n", | |
| "variance........ 5.134645e+03\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 4.442201e+02\n", | |
| "variance........ 3.888952e+03\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 5.377809e+02\n", | |
| "variance........ 5.324498e+03\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.832593e+02\n", | |
| "variance........ 4.580886e+03\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 8.364438e+02\n", | |
| "variance........ 8.019647e+03\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.634565e+01\n", | |
| "variance........ 1.301952e+04\n", | |
| "\n", | |
| "GENERATION: 7\n", | |
| "Lexical Fit..... 7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 190, #Total UniqueCount: 2327\n", | |
| "var 1:\n", | |
| "best............ 6.059099e+02\n", | |
| "mean............ 6.020907e+02\n", | |
| "variance........ 5.262346e+03\n", | |
| "var 2:\n", | |
| "best............ 4.407046e+02\n", | |
| "mean............ 4.433709e+02\n", | |
| "variance........ 5.911753e+03\n", | |
| "var 3:\n", | |
| "best............ 5.370299e+02\n", | |
| "mean............ 5.322368e+02\n", | |
| "variance........ 5.252879e+03\n", | |
| "var 4:\n", | |
| "best............ 5.895102e+02\n", | |
| "mean............ 5.890106e+02\n", | |
| "variance........ 2.979327e+03\n", | |
| "var 5:\n", | |
| "best............ 8.578884e+02\n", | |
| "mean............ 8.377683e+02\n", | |
| "variance........ 8.167136e+03\n", | |
| "var 6:\n", | |
| "best............ 1.521170e+01\n", | |
| "mean............ 4.442424e+01\n", | |
| "variance........ 1.151512e+04\n", | |
| "\n", | |
| "'wait.generations' limit reached.\n", | |
| "No significant improvement in 4 generations.\n", | |
| "\n", | |
| "Solution Lexical Fitness Value:\n", | |
| "7.836441e-02 7.836441e-02 5.980396e-01 6.772148e-01 6.956040e-01 8.000000e-01 9.000000e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "\n", | |
| "Parameters at the Solution:\n", | |
| "\n", | |
| " X[ 1] :\t6.059099e+02\n", | |
| " X[ 2] :\t4.407046e+02\n", | |
| " X[ 3] :\t5.370299e+02\n", | |
| " X[ 4] :\t5.895102e+02\n", | |
| " X[ 5] :\t8.578884e+02\n", | |
| " X[ 6] :\t1.521170e+01\n", | |
| "\n", | |
| "Solution Found Generation 2\n", | |
| "Number of Generations Run 7\n", | |
| "\n", | |
| "Fri Apr 10 14:05:47 2020\n", | |
| "Total run time : 0 hours 0 minutes and 10 seconds\n", | |
| "\n", | |
| "***** (V1) nfoo$Dems *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.64516 \t \t 0.64516 \n", | |
| "mean control.......... 0.42857 \t \t 0.64516 \n", | |
| "std mean diff......... 44.532 \t \t 0 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.21429 \t \t 0 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 0 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.10829 \t \t 0 \n", | |
| "med eCDF diff........ 0.10829 \t \t 0 \n", | |
| "max eCDF diff........ 0.21659 \t \t 0 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.93145 \t \t 1 \n", | |
| "T-test p-value........ 0.099329 \t \t 1 \n", | |
| "\n", | |
| "\n", | |
| "***** (V2) nfoo$Repubs *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.35484 \t \t 0.35484 \n", | |
| "mean control.......... 0.57143 \t \t 0.35484 \n", | |
| "std mean diff......... -44.532 \t \t 0 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.21429 \t \t 0 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 0 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.10829 \t \t 0 \n", | |
| "med eCDF diff........ 0.10829 \t \t 0 \n", | |
| "max eCDF diff........ 0.21659 \t \t 0 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.93145 \t \t 1 \n", | |
| "T-test p-value........ 0.099329 \t \t 1 \n", | |
| "\n", | |
| "\n", | |
| "***** (V3) nfoo$Christian *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.90323 \t \t 0.90323 \n", | |
| "mean control.......... 1 \t \t 1 \n", | |
| "std mean diff......... -32.2 \t \t -32.2 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.10714 \t \t 0.096774 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.048387 \t \t 0.048387 \n", | |
| "med eCDF diff........ 0.048387 \t \t 0.048387 \n", | |
| "max eCDF diff........ 0.096774 \t \t 0.096774 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... Inf \t \t Inf \n", | |
| "T-test p-value........ 0.083087 \t \t 0.078364 \n", | |
| "\n", | |
| "\n", | |
| "***** (V4) nfoo$age *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 48.226 \t \t 48.226 \n", | |
| "mean control.......... 49.857 \t \t 47.935 \n", | |
| "std mean diff......... -19.026 \t \t 3.3861 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 2.4643 \t \t 1.7097 \n", | |
| "med raw eQQ diff..... 2.5 \t \t 1 \n", | |
| "max raw eQQ diff..... 5 \t \t 11 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.061382 \t \t 0.049088 \n", | |
| "med eCDF diff........ 0.051843 \t \t 0.032258 \n", | |
| "max eCDF diff........ 0.13479 \t \t 0.12903 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.0028 \t \t 1.7367 \n", | |
| "T-test p-value........ 0.46822 \t \t 0.67721 \n", | |
| "KS Bootstrap p-value.. 0.792 \t \t 0.868 \n", | |
| "KS Naive p-value...... 0.95201 \t \t 0.9586 \n", | |
| "KS Statistic.......... 0.13479 \t \t 0.12903 \n", | |
| "\n", | |
| "\n", | |
| "***** (V5) nfoo$srvlng *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 7.5484 \t \t 7.5484 \n", | |
| "mean control.......... 9.6071 \t \t 7.3871 \n", | |
| "std mean diff......... -28.926 \t \t 2.2662 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 2.4286 \t \t 1 \n", | |
| "med raw eQQ diff..... 1 \t \t 0 \n", | |
| "max raw eQQ diff..... 10 \t \t 4 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.066172 \t \t 0.039702 \n", | |
| "med eCDF diff........ 0.05818 \t \t 0.032258 \n", | |
| "max eCDF diff........ 0.17051 \t \t 0.096774 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.60661 \t \t 0.95857 \n", | |
| "T-test p-value........ 0.34249 \t \t 0.6956 \n", | |
| "KS Bootstrap p-value.. 0.462 \t \t 0.922 \n", | |
| "KS Naive p-value...... 0.7858 \t \t 0.99866 \n", | |
| "KS Statistic.......... 0.17051 \t \t 0.096774 \n", | |
| "\n", | |
| "\n", | |
| "***** (V6) nfoo$demvote *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.52677 \t \t 0.52677 \n", | |
| "mean control.......... 0.50714 \t \t 0.54065 \n", | |
| "std mean diff......... 15.554 \t \t -10.99 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.05 \t \t 0.04871 \n", | |
| "med raw eQQ diff..... 0.05 \t \t 0.04 \n", | |
| "max raw eQQ diff..... 0.12 \t \t 0.12 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.10108 \t \t 0.092325 \n", | |
| "med eCDF diff........ 0.066244 \t \t 0.096774 \n", | |
| "max eCDF diff........ 0.29493 \t \t 0.22581 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.88501 \t \t 1.1346 \n", | |
| "T-test p-value........ 0.56612 \t \t 0.59804 \n", | |
| "KS Bootstrap p-value.. 0.064 \t \t 0.3 \n", | |
| "KS Naive p-value...... 0.15463 \t \t 0.4081 \n", | |
| "KS Statistic.......... 0.29493 \t \t 0.22581 \n", | |
| "\n", | |
| "\n", | |
| "Before Matching Minimum p.value: 0.064 \n", | |
| "Variable Name(s): nfoo$demvote Number(s): 6 \n", | |
| "\n", | |
| "After Matching Minimum p.value: 0.078364 \n", | |
| "Variable Name(s): nfoo$Christian Number(s): 3 \n", | |
| "\n" | |
| ], | |
| "name": "stdout" | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "U5ZHi1-cerhZ", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 204 | |
| }, | |
| "outputId": "34c46a1c-90df-4f17-efe2-01ffa3ab9fc1" | |
| }, | |
| "source": [ | |
| "summary(mout)" | |
| ], | |
| "execution_count": 17, | |
| "outputs": [ | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "\n", | |
| "Estimate... 12.097 \n", | |
| "AI SE...... 5.3382 \n", | |
| "T-stat..... 2.2661 \n", | |
| "p.val...... 0.023447 \n", | |
| "\n", | |
| "Original number of observations.............. 59 \n", | |
| "Original number of treated obs............... 31 \n", | |
| "Matched number of observations............... 31 \n", | |
| "Matched number of observations (unweighted). 31 \n", | |
| "\n" | |
| ], | |
| "name": "stdout" | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "8qKGkBTve3Uz", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "\n", | |
| "Before Matching Minimum p.value: 0.064 \n", | |
| "Variable Name(s): nfoo$demvote Number(s): 6 \n", | |
| "\n", | |
| "After Matching Minimum p.value: 0.078364 \n", | |
| "Variable Name(s): nfoo$Christian Number(s): 3 \n", | |
| "\n", | |
| "\n", | |
| "After matching we see that before matching, the minimum p-value obtained was 0.064 compared to a minimum p-value of 0.078364 after matching which isn't that impressive. If we set the significance threshold at 0.05, we additionally see that our p-value is not statistically significant at 0.072. \n", | |
| "\n", | |
| "With the Matched set we see that the estimate is 12.097. The p-value as seen in 'summary(mout)' is 0.02. If 0.05 is our considered threshold for statistical significance, then our result is statistically significant at 0.02. \n" | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "cReagCg2U6DV", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "**Question 2**" | |
| ] | |
| }, | |
| { | |
| "cell_type": "code", | |
| "metadata": { | |
| "id": "GFscZzqPVAzR", | |
| "colab_type": "code", | |
| "colab": { | |
| "base_uri": "https://localhost:8080/", | |
| "height": 1000 | |
| }, | |
| "outputId": "83a24b7e-f7c4-44c5-ea79-4ed2dea40ecb" | |
| }, | |
| "source": [ | |
| "rm(list=ls())\n", | |
| "\n", | |
| "foo <- read.csv(\"https://tinyurl.com/y2qv82ks\")\n", | |
| "\n", | |
| "library(date)\n", | |
| "library(Matching)\n", | |
| "\n", | |
| "dim(foo)\n", | |
| "# 76772 14\n", | |
| "\n", | |
| "names(foo)\n", | |
| "#[1] \"bank_code\" [2] \"bank_name\" [3] \"date_of_birth\" \n", | |
| "#[4] \"gender\" [5] \"marital_status\" [6] \"education\" \n", | |
| "#[7] \"occupation\" [8] \"postal_code\" [9] \"district_code\" \n", | |
| "#[10] \"worker\" [11] \"capital\" [12] \"credit_proposal\"\n", | |
| "#[13] \"status\" [14] \"randomid\"\n", | |
| "\n", | |
| "# vars 1, 2, and 3 have 17,330, 68,029, and 1108 blanks (\"\"), respectively\n", | |
| "# vars 8 and 11 have 13,118 and 14,642 NAs, respectively\n", | |
| "\n", | |
| "# create dummies indicating where the blanks and NAs are.\n", | |
| "missing_bank_code <- rep(0, 76772)\n", | |
| "missing_bank_name <- rep(0, 76772)\n", | |
| "missing_date_of_birth <- rep(0, 76772)\n", | |
| "NA_postal_code <- rep(0, 76772)\n", | |
| "NA_capital <- rep(0, 76772)\n", | |
| "NA_credit_proposal <- rep(0, 76772)\n", | |
| "\n", | |
| "foo <- cbind(foo, missing_bank_code,\n", | |
| " missing_bank_name,\n", | |
| " missing_date_of_birth,\n", | |
| " NA_postal_code,\n", | |
| " NA_capital,\n", | |
| " NA_credit_proposal)\n", | |
| "\n", | |
| "foo$missing_bank_code[which(foo$bank_code == \"\")] <- 1\n", | |
| "foo$missing_bank_name[which(foo$bank_name == \"\")] <- 1\n", | |
| "foo$missing_date_of_birth[which(foo$date_of_birth == \"\")] <- 1\n", | |
| "foo$NA_capital[which(is.na(foo$capital) == TRUE)] <- 1\n", | |
| "foo$NA_credit_proposal[which(is.na(foo$credit_proposal) == TRUE)] <- 1\n", | |
| "foo$NA_postal_code[which(is.na(foo$postal_code) == TRUE)] <- 1\n", | |
| "\n", | |
| "# change the dates to R-readable format\n", | |
| "foo$R_date_of_birth <- as.character(foo[,3])\n", | |
| "for(i in 1:length(foo[,3])) {foo$R_date_of_birth[i] <- as.date(foo$R_date_of_birth[i], order = \n", | |
| " \"dmy\")}\n", | |
| "foo$R_date_of_birth <- as.date(as.numeric(foo$R_date_of_birth))\n", | |
| "\n", | |
| "oldest <- which(foo$R_date_of_birth < as.date(\"1-Jan-1910\"))\n", | |
| "youngest <- which(foo$R_date_of_birth > as.date(\"1 Jan 2001\"))\n", | |
| "\n", | |
| "foo$oldest <- rep(0, length(foo[,3]))\n", | |
| "foo$youngest <- rep(0, length(foo[,3]))\n", | |
| "foo$outlier_ages <- rep(0, length(foo[,3]))\n", | |
| "foo$oldest[oldest] <- 1\n", | |
| "foo$youngest[youngest] <- 1\n", | |
| "foo$outlier_ages[c(oldest,youngest)] <- 1\n", | |
| "\n", | |
| "foo$R_date_of_birth[which(is.na(foo$R_date_of_birth) == TRUE)] <- -9999999\n", | |
| "\n", | |
| "# This obs with specific postal code makes no sense\n", | |
| "foo <- foo[-which(foo$postal_code == 9151), ]\n", | |
| "\n", | |
| "# To extract only the first digit of postal codes:\n", | |
| "foo$postal_code1 <- foo$postal_code%/% 10000\n", | |
| "foo$postal_code1[which(is.na(foo$postal_code1) == TRUE)] <- -9999999\n", | |
| "\n", | |
| "# credit_proposal feature engineering\n", | |
| "foo$credit_proposal[which(is.na(foo$credit_proposal) == TRUE)] <- 9999999\n", | |
| "\n", | |
| "foo$credit_proposal_0 <- foo$credit_proposal == 0 & (is.na(foo$credit_proposal) == FALSE)\n", | |
| "foo$credit_proposal_0to5 <- foo$credit_proposal > 0 & foo$credit_proposal < 5000000 & \n", | |
| " (is.na(foo$credit_proposal) == FALSE)\n", | |
| "foo$credit_proposal_5to10 <- foo$credit_proposal >= 5000000 & foo$credit_proposal < 10000000 & \n", | |
| " (is.na(foo$credit_proposal) == FALSE)\n", | |
| "foo$credit_proposal_10to20 <- foo$credit_proposal >= 10000000 & foo$credit_proposal < 20000000 & \n", | |
| " (is.na(foo$credit_proposal) == FALSE)\n", | |
| "foo$credit_proposal_20up <- foo$credit_proposal >= 20000000 & (is.na(foo$credit_proposal) == \n", | |
| " FALSE)\n", | |
| "\n", | |
| "foo$credit_proposal_transformed <-\n", | |
| " 1*foo$credit_proposal_0 +\n", | |
| " 2*foo$credit_proposal_0to5 +\n", | |
| " 3*foo$credit_proposal_5to10 +\n", | |
| " 4*foo$credit_proposal_10to20 +\n", | |
| " 5*foo$credit_proposal_20up +\n", | |
| " 6*foo$NA_credit_proposal\n", | |
| "\n", | |
| "# NA capital\n", | |
| "foo$capital[which(is.na(foo$capital) == TRUE)] <- 9999999\n", | |
| "\n", | |
| "# capital feature engineering\n", | |
| "foo$capital_0 <- foo$capital == 0 & (is.na(foo$capital) == FALSE)\n", | |
| "foo$capital_0to2 <- foo$capital > 0 & foo$capital < 200000 & (is.na(foo$capital) == FALSE)\n", | |
| "foo$capital_2to5 <- foo$capital >= 200000 & foo$capital < 500000 & (is.na(foo$capital) == FALSE)\n", | |
| "foo$capital_5to10 <- foo$capital >= 500000 & foo$capital < 1000000 & (is.na(foo$capital) == \n", | |
| " FALSE)\n", | |
| "foo$capital_10to20 <- foo$capital >= 1000000 & foo$capital < 2000000 & (is.na(foo$capital) == \n", | |
| " FALSE)\n", | |
| "foo$capital_20to50 <- foo$capital >= 2000000 & foo$capital < 5000000 & (is.na(foo$capital) == \n", | |
| " FALSE)\n", | |
| "foo$capital_50up <- foo$capital >= 5000000 & (is.na(foo$capital) == FALSE)\n", | |
| "foo$capital_transformed <-\n", | |
| " 1*foo$capital_0 +\n", | |
| " 2*foo$capital_0to2 +\n", | |
| " 3*foo$capital_2to5 +\n", | |
| " 4*foo$capital_5to10 +\n", | |
| " 5*foo$capital_10to20 +\n", | |
| " 6*foo$capital_20to50 +\n", | |
| " 7*foo$capital_50up +\n", | |
| " 8*foo$NA_capital\n", | |
| "\n", | |
| "# worker feature engineering\n", | |
| "# remove outlier in the control group (10 million workers)\n", | |
| "foo <- foo[-which(foo$worker == max(foo$worker)),]\n", | |
| "\n", | |
| "foo$worker_0 <- foo$worker == 0\n", | |
| "foo$worker_1 <- foo$worker == 1\n", | |
| "foo$worker_2 <- foo$worker == 2\n", | |
| "foo$worker_3 <- foo$worker == 3\n", | |
| "foo$worker_4 <- foo$worker == 4\n", | |
| "foo$worker_5to9 <- foo$worker >=5 & foo$worker < 10\n", | |
| "foo$worker_10to24 <- foo$worker >=10 & foo$worker < 25\n", | |
| "foo$worker_25to99 <- foo$worker >=25 & foo$worker < 100\n", | |
| "foo$worker_100up <- foo$worker >= 100\n", | |
| "\n", | |
| "foo$worker_transformed <-\n", | |
| " 1*foo$worker_0 +\n", | |
| " 2*foo$worker_1 +\n", | |
| " 3*foo$worker_2 +\n", | |
| " 4*foo$worker_3 +\n", | |
| " 5*foo$worker_4 +\n", | |
| " 6*foo$worker_5to9 +\n", | |
| " 7*foo$worker_10to24 +\n", | |
| " 8*foo$worker_25to99 +\n", | |
| " 9*foo$worker_100up\n", | |
| "\n", | |
| "\n", | |
| "# Treatment Indicator\n", | |
| "foo$treat <- foo$status == \"Sudah\"\n", | |
| "\n", | |
| "### (var 14) randomid\n", | |
| "foo_badan <- foo[which(foo$gender == \"BADAN USAHA\"), ]\n", | |
| "foo_people <- foo[-which(foo$gender == \"BADAN USAHA\"), ]\n", | |
| "\n", | |
| "##code modification begins here\n", | |
| "\n", | |
| "foo$district_code<-foo$district_code%/%100\n", | |
| "\n", | |
| "foo <- foo[sample(1:76770, 5000, replace = FALSE),]\n", | |
| "\n", | |
| "X = cbind(foo$R_date_of_birth, \n", | |
| " foo$gender, \n", | |
| " foo$marital_status,\n", | |
| " foo$education, \n", | |
| " foo$occupation, \n", | |
| " foo$district_code,\n", | |
| " foo$worker, \n", | |
| " foo$capital,\n", | |
| " foo$worker_transformed,\n", | |
| " foo$capital_transformed, \n", | |
| " foo$credit_proposal_transformed,\n", | |
| " foo$missing_date_of_birth,\n", | |
| " foo$NA_postal_code,\n", | |
| " foo$NA_capital,\n", | |
| " foo$NA_credit_proposal)\n", | |
| "\n", | |
| "\n", | |
| "Tr <- foo$treat\n", | |
| "\n", | |
| "BalanceMat <- X\n", | |
| "\n", | |
| "genout <- GenMatch(Tr=Tr, \n", | |
| " X=X, \n", | |
| " BalanceMatrix=BalanceMat, \n", | |
| " estimand=\"ATT\", \n", | |
| " M=1,\n", | |
| " pop.size=100, \n", | |
| " max.generations=5, \n", | |
| " wait.generations=3, \n", | |
| " caliper=c(0.066, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000, 1000),\n", | |
| " exact = c(FALSE, TRUE, TRUE,\n", | |
| " TRUE, TRUE, TRUE,\n", | |
| " FALSE, FALSE, FALSE,\n", | |
| " TRUE, TRUE, TRUE,\n", | |
| " TRUE, TRUE, TRUE))\n", | |
| "\n", | |
| "\n", | |
| "\n", | |
| "mout <- Match(Tr=Tr, X=X, estimand=\"ATT\", M=1,\n", | |
| "# exact = c(FALSE, TRUE, TRUE,\n", | |
| "# TRUE, TRUE, TRUE,\n", | |
| "# FALSE, FALSE, FALSE,\n", | |
| "# TRUE, TRUE, TRUE,\n", | |
| "# TRUE, TRUE, TRUE, TRUE), \n", | |
| "Weight.matrix = diag(c(8.229663e+02, 3.248991e+02,\n", | |
| "1.582134e+02, 6.569852e+02, 9.990704e+01, 2.693163e+02, \n", | |
| "3.513421e+02, 7.512798e+00, 1.233057e+02,\n", | |
| "7.083123e+02, 9.801175e+02, 5.627142e+02,\n", | |
| "6.751423e+02, 4.900635e+02, 1.064447e+02,\n", | |
| "3.989456e+02)))\n", | |
| "\n", | |
| "mb <- MatchBalance(foo$treat~\n", | |
| " \tfoo$R_date_of_birth + foo$gender + foo$marital_status +\n", | |
| " \tfoo$education + foo$occupation + foo$district_code +\n", | |
| " \tfoo$worker + foo$capital + foo$credit_proposal +\n", | |
| " \tfoo$worker_transformed + foo$capital_transformed + \n", | |
| " foo$credit_proposal_transformed +\n", | |
| " \tfoo$missing_date_of_birth +\n", | |
| " \tfoo$NA_postal_code +\n", | |
| " \tfoo$NA_capital +\n", | |
| " \tfoo$NA_credit_proposal,\n", | |
| " \tmatch.out=mout, nboots=500)" | |
| ], | |
| "execution_count": 1, | |
| "outputs": [ | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "Loading required package: MASS\n", | |
| "\n", | |
| "## \n", | |
| "## Matching (Version 4.9-7, Build Date: 2020-02-05)\n", | |
| "## See http://sekhon.berkeley.edu/matching for additional documentation.\n", | |
| "## Please cite software as:\n", | |
| "## Jasjeet S. Sekhon. 2011. ``Multivariate and Propensity Score Matching\n", | |
| "## Software with Automated Balance Optimization: The Matching package for R.''\n", | |
| "## Journal of Statistical Software, 42(7): 1-52. \n", | |
| "##\n", | |
| "\n", | |
| "\n" | |
| ], | |
| "name": "stderr" | |
| }, | |
| { | |
| "output_type": "display_data", | |
| "data": { | |
| "text/plain": [ | |
| "[1] 76772 14" | |
| ], | |
| "text/latex": "\\begin{enumerate*}\n\\item 76772\n\\item 14\n\\end{enumerate*}\n", | |
| "text/markdown": "1. 76772\n2. 14\n\n\n", | |
| "text/html": [ | |
| "<style>\n", | |
| ".list-inline {list-style: none; margin:0; padding: 0}\n", | |
| ".list-inline>li {display: inline-block}\n", | |
| ".list-inline>li:not(:last-child)::after {content: \"\\00b7\"; padding: 0 .5ex}\n", | |
| "</style>\n", | |
| "<ol class=list-inline><li>76772</li><li>14</li></ol>\n" | |
| ] | |
| }, | |
| "metadata": { | |
| "tags": [] | |
| } | |
| }, | |
| { | |
| "output_type": "display_data", | |
| "data": { | |
| "text/plain": [ | |
| " [1] \"bank_code\" \"bank_name\" \"date_of_birth\" \"gender\" \n", | |
| " [5] \"marital_status\" \"education\" \"occupation\" \"postal_code\" \n", | |
| " [9] \"district_code\" \"worker\" \"capital\" \"credit_proposal\"\n", | |
| "[13] \"status\" \"randomid\" " | |
| ], | |
| "text/latex": "\\begin{enumerate*}\n\\item 'bank\\_code'\n\\item 'bank\\_name'\n\\item 'date\\_of\\_birth'\n\\item 'gender'\n\\item 'marital\\_status'\n\\item 'education'\n\\item 'occupation'\n\\item 'postal\\_code'\n\\item 'district\\_code'\n\\item 'worker'\n\\item 'capital'\n\\item 'credit\\_proposal'\n\\item 'status'\n\\item 'randomid'\n\\end{enumerate*}\n", | |
| "text/markdown": "1. 'bank_code'\n2. 'bank_name'\n3. 'date_of_birth'\n4. 'gender'\n5. 'marital_status'\n6. 'education'\n7. 'occupation'\n8. 'postal_code'\n9. 'district_code'\n10. 'worker'\n11. 'capital'\n12. 'credit_proposal'\n13. 'status'\n14. 'randomid'\n\n\n", | |
| "text/html": [ | |
| "<style>\n", | |
| ".list-inline {list-style: none; margin:0; padding: 0}\n", | |
| ".list-inline>li {display: inline-block}\n", | |
| ".list-inline>li:not(:last-child)::after {content: \"\\00b7\"; padding: 0 .5ex}\n", | |
| "</style>\n", | |
| "<ol class=list-inline><li>'bank_code'</li><li>'bank_name'</li><li>'date_of_birth'</li><li>'gender'</li><li>'marital_status'</li><li>'education'</li><li>'occupation'</li><li>'postal_code'</li><li>'district_code'</li><li>'worker'</li><li>'capital'</li><li>'credit_proposal'</li><li>'status'</li><li>'randomid'</li></ol>\n" | |
| ] | |
| }, | |
| "metadata": { | |
| "tags": [] | |
| } | |
| }, | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "Loading required namespace: rgenoud\n", | |
| "\n" | |
| ], | |
| "name": "stderr" | |
| }, | |
| { | |
| "output_type": "stream", | |
| "text": [ | |
| "\n", | |
| "\n", | |
| "Fri Apr 10 15:56:56 2020\n", | |
| "Domains:\n", | |
| " 0.000000e+00 <= X1 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X2 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X3 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X4 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X5 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X6 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X7 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X8 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X9 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X10 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X11 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X12 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X13 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X14 <= 1.000000e+03 \n", | |
| " 0.000000e+00 <= X15 <= 1.000000e+03 \n", | |
| "\n", | |
| "Data Type: Floating Point\n", | |
| "Operators (code number, name, population) \n", | |
| "\t(1) Cloning........................... \t15\n", | |
| "\t(2) Uniform Mutation.................. \t12\n", | |
| "\t(3) Boundary Mutation................. \t12\n", | |
| "\t(4) Non-Uniform Mutation.............. \t12\n", | |
| "\t(5) Polytope Crossover................ \t12\n", | |
| "\t(6) Simple Crossover.................. \t12\n", | |
| "\t(7) Whole Non-Uniform Mutation........ \t12\n", | |
| "\t(8) Heuristic Crossover............... \t12\n", | |
| "\t(9) Local-Minimum Crossover........... \t0\n", | |
| "\n", | |
| "SOFT Maximum Number of Generations: 5\n", | |
| "Maximum Nonchanging Generations: 3\n", | |
| "Population size : 100\n", | |
| "Convergence Tolerance: 1.000000e-03\n", | |
| "\n", | |
| "Not Using the BFGS Derivative Based Optimizer on the Best Individual Each Generation.\n", | |
| "Not Checking Gradients before Stopping.\n", | |
| "Using Out of Bounds Individuals.\n", | |
| "\n", | |
| "Maximization Problem.\n", | |
| "GENERATION: 0 (initializing the population)\n", | |
| "Lexical Fit..... 4.952137e-03 7.685160e-02 1.464130e-01 2.025554e-01 3.028419e-01 9.911132e-01 9.978357e-01 9.978357e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 100, #Total UniqueCount: 100\n", | |
| "var 1:\n", | |
| "best............ 9.108297e+02\n", | |
| "mean............ 5.208040e+02\n", | |
| "variance........ 8.949361e+04\n", | |
| "var 2:\n", | |
| "best............ 6.567189e+01\n", | |
| "mean............ 5.407186e+02\n", | |
| "variance........ 8.342701e+04\n", | |
| "var 3:\n", | |
| "best............ 5.439354e+02\n", | |
| "mean............ 4.732997e+02\n", | |
| "variance........ 8.049704e+04\n", | |
| "var 4:\n", | |
| "best............ 5.339814e+02\n", | |
| "mean............ 4.826848e+02\n", | |
| "variance........ 8.376533e+04\n", | |
| "var 5:\n", | |
| "best............ 3.859752e+02\n", | |
| "mean............ 5.281570e+02\n", | |
| "variance........ 8.215314e+04\n", | |
| "var 6:\n", | |
| "best............ 8.178150e+02\n", | |
| "mean............ 5.057343e+02\n", | |
| "variance........ 8.321157e+04\n", | |
| "var 7:\n", | |
| "best............ 2.861763e+02\n", | |
| "mean............ 5.256754e+02\n", | |
| "variance........ 7.424848e+04\n", | |
| "var 8:\n", | |
| "best............ 2.710843e+01\n", | |
| "mean............ 5.050986e+02\n", | |
| "variance........ 7.676859e+04\n", | |
| "var 9:\n", | |
| "best............ 5.915625e+02\n", | |
| "mean............ 4.253982e+02\n", | |
| "variance........ 8.002558e+04\n", | |
| "var 10:\n", | |
| "best............ 9.099750e+02\n", | |
| "mean............ 4.840960e+02\n", | |
| "variance........ 8.149625e+04\n", | |
| "var 11:\n", | |
| "best............ 4.617210e+02\n", | |
| "mean............ 4.673193e+02\n", | |
| "variance........ 9.203641e+04\n", | |
| "var 12:\n", | |
| "best............ 1.822649e+02\n", | |
| "mean............ 4.887279e+02\n", | |
| "variance........ 8.039812e+04\n", | |
| "var 13:\n", | |
| "best............ 3.556154e+02\n", | |
| "mean............ 4.943209e+02\n", | |
| "variance........ 8.085664e+04\n", | |
| "var 14:\n", | |
| "best............ 7.172130e+02\n", | |
| "mean............ 5.093188e+02\n", | |
| "variance........ 8.414527e+04\n", | |
| "var 15:\n", | |
| "best............ 6.578212e+02\n", | |
| "mean............ 5.015074e+02\n", | |
| "variance........ 8.616737e+04\n", | |
| "\n", | |
| "GENERATION: 1\n", | |
| "Lexical Fit..... 5.749787e-03 7.685160e-02 1.464676e-01 2.221047e-01 3.028419e-01 9.911132e-01 9.978357e-01 9.978357e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 72, #Total UniqueCount: 172\n", | |
| "var 1:\n", | |
| "best............ 9.012175e+02\n", | |
| "mean............ 6.079554e+02\n", | |
| "variance........ 7.755288e+04\n", | |
| "var 2:\n", | |
| "best............ 5.080022e+01\n", | |
| "mean............ 2.309061e+02\n", | |
| "variance........ 5.662684e+04\n", | |
| "var 3:\n", | |
| "best............ 5.459675e+02\n", | |
| "mean............ 4.920251e+02\n", | |
| "variance........ 3.767220e+04\n", | |
| "var 4:\n", | |
| "best............ 5.121522e+02\n", | |
| "mean............ 5.744369e+02\n", | |
| "variance........ 5.310565e+04\n", | |
| "var 5:\n", | |
| "best............ 3.647228e+02\n", | |
| "mean............ 3.926862e+02\n", | |
| "variance........ 5.358800e+04\n", | |
| "var 6:\n", | |
| "best............ 7.606625e+02\n", | |
| "mean............ 5.412657e+02\n", | |
| "variance........ 7.765067e+04\n", | |
| "var 7:\n", | |
| "best............ 4.576669e+02\n", | |
| "mean............ 4.263129e+02\n", | |
| "variance........ 3.193356e+04\n", | |
| "var 8:\n", | |
| "best............ 2.410702e+01\n", | |
| "mean............ 1.365721e+02\n", | |
| "variance........ 5.691356e+04\n", | |
| "var 9:\n", | |
| "best............ 5.220046e+02\n", | |
| "mean............ 4.023926e+02\n", | |
| "variance........ 7.980234e+04\n", | |
| "var 10:\n", | |
| "best............ 9.310097e+02\n", | |
| "mean............ 6.574403e+02\n", | |
| "variance........ 6.480540e+04\n", | |
| "var 11:\n", | |
| "best............ 4.721960e+02\n", | |
| "mean............ 4.712913e+02\n", | |
| "variance........ 5.403311e+04\n", | |
| "var 12:\n", | |
| "best............ 2.219642e+02\n", | |
| "mean............ 3.727733e+02\n", | |
| "variance........ 5.483166e+04\n", | |
| "var 13:\n", | |
| "best............ 3.508147e+02\n", | |
| "mean............ 4.760011e+02\n", | |
| "variance........ 3.271648e+04\n", | |
| "var 14:\n", | |
| "best............ 7.096901e+02\n", | |
| "mean............ 6.348292e+02\n", | |
| "variance........ 5.185230e+04\n", | |
| "var 15:\n", | |
| "best............ 6.947508e+02\n", | |
| "mean............ 6.708794e+02\n", | |
| "variance........ 5.832272e+04\n", | |
| "\n", | |
| "GENERATION: 2\n", | |
| "Lexical Fit..... 5.891921e-03 4.871107e-02 1.769536e-01 2.341665e-01 3.044834e-01 9.923368e-01 9.982026e-01 9.982026e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 75, #Total UniqueCount: 247\n", | |
| "var 1:\n", | |
| "best............ 6.105977e+02\n", | |
| "mean............ 8.283941e+02\n", | |
| "variance........ 1.684772e+04\n", | |
| "var 2:\n", | |
| "best............ 3.702480e+01\n", | |
| "mean............ 7.191061e+01\n", | |
| "variance........ 9.609714e+03\n", | |
| "var 3:\n", | |
| "best............ 3.271443e+02\n", | |
| "mean............ 4.998929e+02\n", | |
| "variance........ 1.151358e+04\n", | |
| "var 4:\n", | |
| "best............ 7.335177e+02\n", | |
| "mean............ 5.712705e+02\n", | |
| "variance........ 7.640503e+03\n", | |
| "var 5:\n", | |
| "best............ 2.576115e+02\n", | |
| "mean............ 3.396502e+02\n", | |
| "variance........ 3.229468e+03\n", | |
| "var 6:\n", | |
| "best............ 1.768057e+02\n", | |
| "mean............ 6.650376e+02\n", | |
| "variance........ 5.652261e+04\n", | |
| "var 7:\n", | |
| "best............ 4.368336e+02\n", | |
| "mean............ 3.926148e+02\n", | |
| "variance........ 7.219227e+03\n", | |
| "var 8:\n", | |
| "best............ 9.801005e+00\n", | |
| "mean............ 3.400077e+01\n", | |
| "variance........ 5.141800e+03\n", | |
| "var 9:\n", | |
| "best............ 5.322000e+02\n", | |
| "mean............ 5.536807e+02\n", | |
| "variance........ 5.325132e+03\n", | |
| "var 10:\n", | |
| "best............ 8.864148e+02\n", | |
| "mean............ 8.895091e+02\n", | |
| "variance........ 8.862887e+03\n", | |
| "var 11:\n", | |
| "best............ 4.367046e+02\n", | |
| "mean............ 4.595282e+02\n", | |
| "variance........ 1.742638e+03\n", | |
| "var 12:\n", | |
| "best............ 1.943558e+02\n", | |
| "mean............ 2.239400e+02\n", | |
| "variance........ 2.561510e+03\n", | |
| "var 13:\n", | |
| "best............ 3.885333e+02\n", | |
| "mean............ 3.728793e+02\n", | |
| "variance........ 2.439915e+03\n", | |
| "var 14:\n", | |
| "best............ 7.258765e+02\n", | |
| "mean............ 7.090254e+02\n", | |
| "variance........ 1.531090e+03\n", | |
| "var 15:\n", | |
| "best............ 6.816916e+02\n", | |
| "mean............ 6.918078e+02\n", | |
| "variance........ 3.036999e+03\n", | |
| "\n", | |
| "GENERATION: 3\n", | |
| "Lexical Fit..... 6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 72, #Total UniqueCount: 319\n", | |
| "var 1:\n", | |
| "best............ 5.774128e+02\n", | |
| "mean............ 7.359376e+02\n", | |
| "variance........ 2.474409e+04\n", | |
| "var 2:\n", | |
| "best............ 3.428729e+01\n", | |
| "mean............ 6.972281e+01\n", | |
| "variance........ 1.279923e+04\n", | |
| "var 3:\n", | |
| "best............ 3.021283e+02\n", | |
| "mean............ 4.094115e+02\n", | |
| "variance........ 1.841037e+04\n", | |
| "var 4:\n", | |
| "best............ 7.597846e+02\n", | |
| "mean............ 6.324685e+02\n", | |
| "variance........ 1.286359e+04\n", | |
| "var 5:\n", | |
| "best............ 2.447871e+02\n", | |
| "mean............ 3.156989e+02\n", | |
| "variance........ 6.787465e+03\n", | |
| "var 6:\n", | |
| "best............ 1.102637e+02\n", | |
| "mean............ 4.634372e+02\n", | |
| "variance........ 9.430301e+04\n", | |
| "var 7:\n", | |
| "best............ 4.321233e+02\n", | |
| "mean............ 4.458245e+02\n", | |
| "variance........ 2.707440e+03\n", | |
| "var 8:\n", | |
| "best............ 8.198480e+00\n", | |
| "mean............ 3.437917e+01\n", | |
| "variance........ 6.833515e+03\n", | |
| "var 9:\n", | |
| "best............ 5.333478e+02\n", | |
| "mean............ 5.270660e+02\n", | |
| "variance........ 4.478571e+02\n", | |
| "var 10:\n", | |
| "best............ 8.819289e+02\n", | |
| "mean............ 9.013942e+02\n", | |
| "variance........ 1.096997e+03\n", | |
| "var 11:\n", | |
| "best............ 4.319819e+02\n", | |
| "mean............ 4.520238e+02\n", | |
| "variance........ 2.241468e+03\n", | |
| "var 12:\n", | |
| "best............ 1.903859e+02\n", | |
| "mean............ 2.165342e+02\n", | |
| "variance........ 2.124532e+03\n", | |
| "var 13:\n", | |
| "best............ 3.907722e+02\n", | |
| "mean............ 3.813613e+02\n", | |
| "variance........ 2.606100e+03\n", | |
| "var 14:\n", | |
| "best............ 7.263237e+02\n", | |
| "mean............ 7.182628e+02\n", | |
| "variance........ 1.504712e+03\n", | |
| "var 15:\n", | |
| "best............ 6.799954e+02\n", | |
| "mean............ 6.891951e+02\n", | |
| "variance........ 2.055607e+02\n", | |
| "\n", | |
| "GENERATION: 4\n", | |
| "Lexical Fit..... 6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 70, #Total UniqueCount: 389\n", | |
| "var 1:\n", | |
| "best............ 5.774128e+02\n", | |
| "mean............ 6.043070e+02\n", | |
| "variance........ 6.306996e+03\n", | |
| "var 2:\n", | |
| "best............ 3.428729e+01\n", | |
| "mean............ 8.160079e+01\n", | |
| "variance........ 2.167599e+04\n", | |
| "var 3:\n", | |
| "best............ 3.021283e+02\n", | |
| "mean............ 3.170884e+02\n", | |
| "variance........ 5.367658e+03\n", | |
| "var 4:\n", | |
| "best............ 7.597846e+02\n", | |
| "mean............ 7.259258e+02\n", | |
| "variance........ 6.570262e+03\n", | |
| "var 5:\n", | |
| "best............ 2.447871e+02\n", | |
| "mean............ 2.727725e+02\n", | |
| "variance........ 8.601646e+03\n", | |
| "var 6:\n", | |
| "best............ 1.102637e+02\n", | |
| "mean............ 2.033432e+02\n", | |
| "variance........ 3.530446e+04\n", | |
| "var 7:\n", | |
| "best............ 4.321233e+02\n", | |
| "mean............ 4.366521e+02\n", | |
| "variance........ 2.657924e+03\n", | |
| "var 8:\n", | |
| "best............ 8.198480e+00\n", | |
| "mean............ 2.880898e+01\n", | |
| "variance........ 7.565981e+03\n", | |
| "var 9:\n", | |
| "best............ 5.333478e+02\n", | |
| "mean............ 5.251603e+02\n", | |
| "variance........ 3.449733e+03\n", | |
| "var 10:\n", | |
| "best............ 8.819289e+02\n", | |
| "mean............ 8.662528e+02\n", | |
| "variance........ 7.481949e+03\n", | |
| "var 11:\n", | |
| "best............ 4.319819e+02\n", | |
| "mean............ 4.426784e+02\n", | |
| "variance........ 1.653095e+03\n", | |
| "var 12:\n", | |
| "best............ 1.903859e+02\n", | |
| "mean............ 2.043628e+02\n", | |
| "variance........ 2.582721e+03\n", | |
| "var 13:\n", | |
| "best............ 3.907722e+02\n", | |
| "mean............ 3.980103e+02\n", | |
| "variance........ 5.231790e+03\n", | |
| "var 14:\n", | |
| "best............ 7.263237e+02\n", | |
| "mean............ 7.112938e+02\n", | |
| "variance........ 5.183641e+03\n", | |
| "var 15:\n", | |
| "best............ 6.799954e+02\n", | |
| "mean............ 6.845305e+02\n", | |
| "variance........ 3.273396e+02\n", | |
| "\n", | |
| "GENERATION: 5\n", | |
| "Lexical Fit..... 6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 66, #Total UniqueCount: 455\n", | |
| "var 1:\n", | |
| "best............ 5.774128e+02\n", | |
| "mean............ 5.773601e+02\n", | |
| "variance........ 1.829235e+03\n", | |
| "var 2:\n", | |
| "best............ 3.428729e+01\n", | |
| "mean............ 4.377302e+01\n", | |
| "variance........ 3.454977e+03\n", | |
| "var 3:\n", | |
| "best............ 3.021283e+02\n", | |
| "mean............ 3.066625e+02\n", | |
| "variance........ 9.289957e+02\n", | |
| "var 4:\n", | |
| "best............ 7.597846e+02\n", | |
| "mean............ 7.504932e+02\n", | |
| "variance........ 3.518354e+03\n", | |
| "var 5:\n", | |
| "best............ 2.447871e+02\n", | |
| "mean............ 2.534440e+02\n", | |
| "variance........ 3.219067e+03\n", | |
| "var 6:\n", | |
| "best............ 1.102637e+02\n", | |
| "mean............ 1.212429e+02\n", | |
| "variance........ 3.957061e+03\n", | |
| "var 7:\n", | |
| "best............ 4.321233e+02\n", | |
| "mean............ 4.348160e+02\n", | |
| "variance........ 2.079976e+03\n", | |
| "var 8:\n", | |
| "best............ 8.198480e+00\n", | |
| "mean............ 1.260114e+01\n", | |
| "variance........ 5.929901e+02\n", | |
| "var 9:\n", | |
| "best............ 5.333478e+02\n", | |
| "mean............ 5.319459e+02\n", | |
| "variance........ 4.583074e+03\n", | |
| "var 10:\n", | |
| "best............ 8.819289e+02\n", | |
| "mean............ 8.626741e+02\n", | |
| "variance........ 7.566328e+03\n", | |
| "var 11:\n", | |
| "best............ 4.319819e+02\n", | |
| "mean............ 4.314062e+02\n", | |
| "variance........ 8.133020e+02\n", | |
| "var 12:\n", | |
| "best............ 1.903859e+02\n", | |
| "mean............ 1.923012e+02\n", | |
| "variance........ 7.964967e+03\n", | |
| "var 13:\n", | |
| "best............ 3.907722e+02\n", | |
| "mean............ 3.936508e+02\n", | |
| "variance........ 5.693021e+02\n", | |
| "var 14:\n", | |
| "best............ 7.263237e+02\n", | |
| "mean............ 7.169084e+02\n", | |
| "variance........ 2.598972e+03\n", | |
| "var 15:\n", | |
| "best............ 6.799954e+02\n", | |
| "mean............ 6.778068e+02\n", | |
| "variance........ 6.272648e+02\n", | |
| "\n", | |
| "Increasing 'max.generations' limit by 5 generations to 10 because the fitness is still improving.\n", | |
| "\n", | |
| "\n", | |
| "GENERATION: 6\n", | |
| "Lexical Fit..... 6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 64, #Total UniqueCount: 519\n", | |
| "var 1:\n", | |
| "best............ 5.774128e+02\n", | |
| "mean............ 5.788998e+02\n", | |
| "variance........ 1.791169e+03\n", | |
| "var 2:\n", | |
| "best............ 3.428729e+01\n", | |
| "mean............ 3.640123e+01\n", | |
| "variance........ 3.663741e+02\n", | |
| "var 3:\n", | |
| "best............ 3.021283e+02\n", | |
| "mean............ 3.050250e+02\n", | |
| "variance........ 1.725544e+03\n", | |
| "var 4:\n", | |
| "best............ 7.597846e+02\n", | |
| "mean............ 7.561650e+02\n", | |
| "variance........ 1.533330e+03\n", | |
| "var 5:\n", | |
| "best............ 2.447871e+02\n", | |
| "mean............ 2.591213e+02\n", | |
| "variance........ 1.826523e+03\n", | |
| "var 6:\n", | |
| "best............ 1.102637e+02\n", | |
| "mean............ 1.361131e+02\n", | |
| "variance........ 1.102815e+04\n", | |
| "var 7:\n", | |
| "best............ 4.321233e+02\n", | |
| "mean............ 4.320438e+02\n", | |
| "variance........ 2.828939e+03\n", | |
| "var 8:\n", | |
| "best............ 8.198480e+00\n", | |
| "mean............ 2.009623e+01\n", | |
| "variance........ 3.159923e+03\n", | |
| "var 9:\n", | |
| "best............ 5.333478e+02\n", | |
| "mean............ 5.319976e+02\n", | |
| "variance........ 2.070020e+03\n", | |
| "var 10:\n", | |
| "best............ 8.819289e+02\n", | |
| "mean............ 8.636409e+02\n", | |
| "variance........ 6.293889e+03\n", | |
| "var 11:\n", | |
| "best............ 4.319819e+02\n", | |
| "mean............ 4.395454e+02\n", | |
| "variance........ 1.827697e+03\n", | |
| "var 12:\n", | |
| "best............ 1.903859e+02\n", | |
| "mean............ 1.933151e+02\n", | |
| "variance........ 7.771952e+03\n", | |
| "var 13:\n", | |
| "best............ 3.907722e+02\n", | |
| "mean............ 3.963734e+02\n", | |
| "variance........ 1.574832e+03\n", | |
| "var 14:\n", | |
| "best............ 7.263237e+02\n", | |
| "mean............ 7.238602e+02\n", | |
| "variance........ 2.269244e+03\n", | |
| "var 15:\n", | |
| "best............ 6.799954e+02\n", | |
| "mean............ 6.716670e+02\n", | |
| "variance........ 2.649633e+03\n", | |
| "\n", | |
| "GENERATION: 7\n", | |
| "Lexical Fit..... 6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "#unique......... 69, #Total UniqueCount: 588\n", | |
| "var 1:\n", | |
| "best............ 5.774128e+02\n", | |
| "mean............ 5.741087e+02\n", | |
| "variance........ 4.632837e+03\n", | |
| "var 2:\n", | |
| "best............ 3.428729e+01\n", | |
| "mean............ 5.298511e+01\n", | |
| "variance........ 9.860393e+03\n", | |
| "var 3:\n", | |
| "best............ 3.021283e+02\n", | |
| "mean............ 3.108770e+02\n", | |
| "variance........ 3.656601e+03\n", | |
| "var 4:\n", | |
| "best............ 7.597846e+02\n", | |
| "mean............ 7.560868e+02\n", | |
| "variance........ 1.270544e+03\n", | |
| "var 5:\n", | |
| "best............ 2.447871e+02\n", | |
| "mean............ 2.613267e+02\n", | |
| "variance........ 5.763761e+03\n", | |
| "var 6:\n", | |
| "best............ 1.102637e+02\n", | |
| "mean............ 1.172087e+02\n", | |
| "variance........ 2.559012e+03\n", | |
| "var 7:\n", | |
| "best............ 4.321233e+02\n", | |
| "mean............ 4.351608e+02\n", | |
| "variance........ 1.252710e+03\n", | |
| "var 8:\n", | |
| "best............ 8.198480e+00\n", | |
| "mean............ 2.474960e+01\n", | |
| "variance........ 5.689932e+03\n", | |
| "var 9:\n", | |
| "best............ 5.333478e+02\n", | |
| "mean............ 5.319753e+02\n", | |
| "variance........ 3.843307e+03\n", | |
| "var 10:\n", | |
| "best............ 8.819289e+02\n", | |
| "mean............ 8.660935e+02\n", | |
| "variance........ 4.335564e+03\n", | |
| "var 11:\n", | |
| "best............ 4.319819e+02\n", | |
| "mean............ 4.284779e+02\n", | |
| "variance........ 7.888305e+02\n", | |
| "var 12:\n", | |
| "best............ 1.903859e+02\n", | |
| "mean............ 1.981629e+02\n", | |
| "variance........ 8.674487e+03\n", | |
| "var 13:\n", | |
| "best............ 3.907722e+02\n", | |
| "mean............ 3.881772e+02\n", | |
| "variance........ 9.375095e+02\n", | |
| "var 14:\n", | |
| "best............ 7.263237e+02\n", | |
| "mean............ 7.212406e+02\n", | |
| "variance........ 2.557779e+03\n", | |
| "var 15:\n", | |
| "best............ 6.799954e+02\n", | |
| "mean............ 6.822648e+02\n", | |
| "variance........ 4.653885e+02\n", | |
| "\n", | |
| "'wait.generations' limit reached.\n", | |
| "No significant improvement in 3 generations.\n", | |
| "\n", | |
| "Solution Lexical Fitness Value:\n", | |
| "6.976292e-03 4.871107e-02 1.766454e-01 2.360253e-01 3.044834e-01 9.925096e-01 9.982533e-01 9.982533e-01 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 1.000000e+00 \n", | |
| "\n", | |
| "Parameters at the Solution:\n", | |
| "\n", | |
| " X[ 1] :\t5.774128e+02\n", | |
| " X[ 2] :\t3.428729e+01\n", | |
| " X[ 3] :\t3.021283e+02\n", | |
| " X[ 4] :\t7.597846e+02\n", | |
| " X[ 5] :\t2.447871e+02\n", | |
| " X[ 6] :\t1.102637e+02\n", | |
| " X[ 7] :\t4.321233e+02\n", | |
| " X[ 8] :\t8.198480e+00\n", | |
| " X[ 9] :\t5.333478e+02\n", | |
| " X[10] :\t8.819289e+02\n", | |
| " X[11] :\t4.319819e+02\n", | |
| " X[12] :\t1.903859e+02\n", | |
| " X[13] :\t3.907722e+02\n", | |
| " X[14] :\t7.263237e+02\n", | |
| " X[15] :\t6.799954e+02\n", | |
| "\n", | |
| "Solution Found Generation 3\n", | |
| "Number of Generations Run 7\n", | |
| "\n", | |
| "Fri Apr 10 16:01:06 2020\n", | |
| "Total run time : 0 hours 4 minutes and 10 seconds\n", | |
| "\n", | |
| "***** (V1) foo$R_date_of_birth *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ -100587 \t \t -100587 \n", | |
| "mean control.......... -161850 \t \t -100587 \n", | |
| "std mean diff......... 5.9622 \t \t 1.4976e-05 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 68911 \t \t 16.414 \n", | |
| "med raw eQQ diff..... 949 \t \t 13 \n", | |
| "max raw eQQ diff..... 9997309 \t \t 135 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.059846 \t \t 0.0011726 \n", | |
| "med eCDF diff........ 0.070711 \t \t 0.00080064 \n", | |
| "max eCDF diff........ 0.10891 \t \t 0.0084067 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.6445 \t \t 1 \n", | |
| "T-test p-value........ 0.10599 \t \t 0.9491 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t 0.016 \n", | |
| "KS Naive p-value...... 7.1853e-09 \t \t 0.014264 \n", | |
| "KS Statistic.......... 0.10891 \t \t 0.0084067 \n", | |
| "\n", | |
| "\n", | |
| "***** (V2) foo$genderLAKI-LAKI *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.62924 \t \t 0.62924 \n", | |
| "mean control.......... 0.61835 \t \t 0.60583 \n", | |
| "std mean diff......... 2.2522 \t \t 4.8437 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.010649 \t \t 0.027107 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0054419 \t \t 0.013554 \n", | |
| "med eCDF diff........ 0.0054419 \t \t 0.013554 \n", | |
| "max eCDF diff........ 0.010884 \t \t 0.027107 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.98929 \t \t 0.97696 \n", | |
| "T-test p-value........ 0.51963 \t \t 0.27438 \n", | |
| "\n", | |
| "\n", | |
| "***** (V3) foo$genderPEREMPUAN *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.3698 \t \t 0.3698 \n", | |
| "mean control.......... 0.38039 \t \t 0.39333 \n", | |
| "std mean diff......... -2.1929 \t \t -4.8723 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.010649 \t \t 0.026922 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0052957 \t \t 0.013461 \n", | |
| "med eCDF diff........ 0.0052957 \t \t 0.013461 \n", | |
| "max eCDF diff........ 0.010591 \t \t 0.026922 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.98948 \t \t 0.97664 \n", | |
| "T-test p-value........ 0.53067 \t \t 0.2716 \n", | |
| "\n", | |
| "\n", | |
| "***** (V4) foo$marital_statusBELUM KAWIN *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.033882 \t \t 0.033882 \n", | |
| "mean control.......... 0.027729 \t \t 0.025728 \n", | |
| "std mean diff......... 3.3993 \t \t 4.5048 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0058083 \t \t 0.0073916 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0030766 \t \t 0.0036958 \n", | |
| "med eCDF diff........ 0.0030766 \t \t 0.0036958 \n", | |
| "max eCDF diff........ 0.0061531 \t \t 0.0073916 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.215 \t \t 1.3059 \n", | |
| "T-test p-value........ 0.32162 \t \t 0.26655 \n", | |
| "\n", | |
| "\n", | |
| "***** (V5) foo$marital_statusKAWIN *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.9332 \t \t 0.9332 \n", | |
| "mean control.......... 0.92236 \t \t 0.92526 \n", | |
| "std mean diff......... 4.3416 \t \t 3.1802 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.011617 \t \t 0.0094075 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0054224 \t \t 0.0047038 \n", | |
| "med eCDF diff........ 0.0054224 \t \t 0.0047038 \n", | |
| "max eCDF diff........ 0.010845 \t \t 0.0094075 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.87106 \t \t 0.90139 \n", | |
| "T-test p-value........ 0.22099 \t \t 0.47776 \n", | |
| "\n", | |
| "\n", | |
| "***** (V6) foo$educationDIPLOMA *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.017425 \t \t 0.017425 \n", | |
| "mean control.......... 0.014369 \t \t 0.015549 \n", | |
| "std mean diff......... 2.3347 \t \t 1.4329 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0029042 \t \t 0.0011724 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0015282 \t \t 0.00058618 \n", | |
| "med eCDF diff........ 0.0015282 \t \t 0.00058618 \n", | |
| "max eCDF diff........ 0.0030564 \t \t 0.0011724 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.2098 \t \t 1.1185 \n", | |
| "T-test p-value........ 0.49617 \t \t 0.73781 \n", | |
| "\n", | |
| "\n", | |
| "***** (V7) foo$educationLAINNYA *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.033882 \t \t 0.033882 \n", | |
| "mean control.......... 0.037308 \t \t 0.032094 \n", | |
| "std mean diff......... -1.8926 \t \t 0.98781 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0038722 \t \t 0.0015727 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0017129 \t \t 0.00078634 \n", | |
| "med eCDF diff........ 0.0017129 \t \t 0.00078634 \n", | |
| "max eCDF diff........ 0.0034259 \t \t 0.0015727 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.91206 \t \t 1.0538 \n", | |
| "T-test p-value........ 0.59168 \t \t 0.80575 \n", | |
| "\n", | |
| "\n", | |
| "***** (V8) foo$educationSARJANA *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.029042 \t \t 0.029042 \n", | |
| "mean control.......... 0.024956 \t \t 0.027199 \n", | |
| "std mean diff......... 2.4319 \t \t 1.0969 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0038722 \t \t 0.00027165 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0020429 \t \t 0.00013582 \n", | |
| "med eCDF diff........ 0.0020429 \t \t 0.00013582 \n", | |
| "max eCDF diff........ 0.0040857 \t \t 0.00027165 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.1597 \t \t 1.0657 \n", | |
| "T-test p-value........ 0.48009 \t \t 0.8005 \n", | |
| "\n", | |
| "\n", | |
| "***** (V9) foo$educationSD *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.19942 \t \t 0.19942 \n", | |
| "mean control.......... 0.2546 \t \t 0.24444 \n", | |
| "std mean diff......... -13.804 \t \t -11.263 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.055179 \t \t 0.047209 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.027591 \t \t 0.023605 \n", | |
| "med eCDF diff........ 0.027591 \t \t 0.023605 \n", | |
| "max eCDF diff........ 0.055181 \t \t 0.047209 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.84185 \t \t 0.86443 \n", | |
| "T-test p-value........ 0.0001096 \t \t 0.012924 \n", | |
| "\n", | |
| "\n", | |
| "***** (V10) foo$educationSMP *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.19071 \t \t 0.19071 \n", | |
| "mean control.......... 0.19687 \t \t 0.20559 \n", | |
| "std mean diff......... -1.5692 \t \t -3.7867 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0058083 \t \t 0.010709 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0030838 \t \t 0.0053543 \n", | |
| "med eCDF diff........ 0.0030838 \t \t 0.0053543 \n", | |
| "max eCDF diff........ 0.0061675 \t \t 0.010709 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.97681 \t \t 0.94498 \n", | |
| "T-test p-value........ 0.65412 \t \t 0.39394 \n", | |
| "\n", | |
| "\n", | |
| "***** (V11) foo$educationSMU *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.52662 \t \t 0.52662 \n", | |
| "mean control.......... 0.47013 \t \t 0.47391 \n", | |
| "std mean diff......... 11.309 \t \t 10.551 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.056147 \t \t 0.054601 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.028246 \t \t 0.0273 \n", | |
| "med eCDF diff........ 0.028246 \t \t 0.0273 \n", | |
| "max eCDF diff........ 0.056493 \t \t 0.054601 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.0015 \t \t 0.99989 \n", | |
| "T-test p-value........ 0.0012277 \t \t 0.016375 \n", | |
| "\n", | |
| "\n", | |
| "***** (V12) foo$occupationLAIN-LAIN/BADAN USAHA *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.081317 \t \t 0.081317 \n", | |
| "mean control.......... 0.064532 \t \t 0.069329 \n", | |
| "std mean diff......... 6.1379 \t \t 4.3838 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.016457 \t \t 0.0090787 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0083921 \t \t 0.0045393 \n", | |
| "med eCDF diff........ 0.0083921 \t \t 0.0045393 \n", | |
| "max eCDF diff........ 0.016784 \t \t 0.0090787 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.2384 \t \t 1.1578 \n", | |
| "T-test p-value........ 0.073146 \t \t 0.30067 \n", | |
| "\n", | |
| "\n", | |
| "***** (V13) foo$occupationNELAYAN *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.012585 \t \t 0.012585 \n", | |
| "mean control.......... 0.015125 \t \t 0.013962 \n", | |
| "std mean diff......... -2.2775 \t \t -1.2347 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0029042 \t \t 0.0010437 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.00127 \t \t 0.00052185 \n", | |
| "med eCDF diff........ 0.00127 \t \t 0.00052185 \n", | |
| "max eCDF diff........ 0.0025401 \t \t 0.0010437 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.8348 \t \t 0.90263 \n", | |
| "T-test p-value........ 0.52285 \t \t 0.78434 \n", | |
| "\n", | |
| "\n", | |
| "***** (V14) foo$occupationPEDAGANG *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.22168 \t \t 0.22168 \n", | |
| "mean control.......... 0.21528 \t \t 0.22002 \n", | |
| "std mean diff......... 1.542 \t \t 0.40012 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0067764 \t \t 0.0011438 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0032042 \t \t 0.00057189 \n", | |
| "med eCDF diff........ 0.0032042 \t \t 0.00057189 \n", | |
| "max eCDF diff........ 0.0064084 \t \t 0.0011438 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.0221 \t \t 1.0054 \n", | |
| "T-test p-value........ 0.65823 \t \t 0.92699 \n", | |
| "\n", | |
| "\n", | |
| "***** (V15) foo$occupationPENSIUNAN/PURNAWIRAWAN *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0 \t \t 0 \n", | |
| "mean control.......... 0.00050416 \t \t 0.00039658 \n", | |
| "std mean diff......... -Inf \t \t -Inf \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.00096805 \t \t 0.00022875 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.00025208 \t \t 0.00011438 \n", | |
| "med eCDF diff........ 0.00025208 \t \t 0.00011438 \n", | |
| "max eCDF diff........ 0.00050416 \t \t 0.00022875 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0 \t \t 0 \n", | |
| "T-test p-value........ 0.15733 \t \t 0.5222 \n", | |
| "\n", | |
| "\n", | |
| "***** (V16) foo$occupationPETANI *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.17231 \t \t 0.17231 \n", | |
| "mean control.......... 0.18024 \t \t 0.15594 \n", | |
| "std mean diff......... -2.097 \t \t 4.3327 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0077444 \t \t 0.024162 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0039617 \t \t 0.012081 \n", | |
| "med eCDF diff........ 0.0039617 \t \t 0.012081 \n", | |
| "max eCDF diff........ 0.0079233 \t \t 0.024162 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.96597 \t \t 1.0835 \n", | |
| "T-test p-value........ 0.54981 \t \t 0.30739 \n", | |
| "\n", | |
| "\n", | |
| "***** (V17) foo$occupationPNS *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.0019361 \t \t 0.0019361 \n", | |
| "mean control.......... 0.0017646 \t \t 0.0022399 \n", | |
| "std mean diff......... 0.39007 \t \t -0.6907 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0 \t \t 0 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 0 \t \t 0 \n", | |
| "\n", | |
| "mean eCDF diff........ 8.5775e-05 \t \t 0 \n", | |
| "med eCDF diff........ 8.5775e-05 \t \t 0 \n", | |
| "max eCDF diff........ 0.00017155 \t \t 0 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.0978 \t \t 0.86464 \n", | |
| "T-test p-value........ 0.91027 \t \t 0.87994 \n", | |
| "\n", | |
| "\n", | |
| "***** (V18) foo$occupationPROFESIONAL *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.010649 \t \t 0.010649 \n", | |
| "mean control.......... 0.019158 \t \t 0.019838 \n", | |
| "std mean diff......... -8.2865 \t \t -8.9489 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0087125 \t \t 0.0090787 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0042547 \t \t 0.0045393 \n", | |
| "med eCDF diff........ 0.0042547 \t \t 0.0045393 \n", | |
| "max eCDF diff........ 0.0085095 \t \t 0.0090787 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.56105 \t \t 0.5418 \n", | |
| "T-test p-value........ 0.027841 \t \t 0.08812 \n", | |
| "\n", | |
| "\n", | |
| "***** (V19) foo$occupationTNI/POLRI *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0 \t \t 0 \n", | |
| "mean control.......... 0 \t \t 0 \n", | |
| "std mean diff......... 0 \t \t 0 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0 \t \t 0 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 0 \t \t 0 \n", | |
| "\n", | |
| "mean eCDF diff........ 0 \t \t 0 \n", | |
| "med eCDF diff........ 0 \t \t 0 \n", | |
| "max eCDF diff........ 0 \t \t 0 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... NaN \t \t NaN \n", | |
| "T-test p-value........ 1 \t \t 1 \n", | |
| "\n", | |
| "\n", | |
| "***** (V20) foo$occupationWIRASWASTA *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.48887 \t \t 0.48887 \n", | |
| "mean control.......... 0.49029 \t \t 0.50359 \n", | |
| "std mean diff......... -0.28544 \t \t -2.9445 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.00096805 \t \t 0.018844 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.00071378 \t \t 0.0094218 \n", | |
| "med eCDF diff........ 0.00071378 \t \t 0.0094218 \n", | |
| "max eCDF diff........ 0.0014276 \t \t 0.018844 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.0006 \t \t 0.99956 \n", | |
| "T-test p-value........ 0.93488 \t \t 0.50055 \n", | |
| "\n", | |
| "\n", | |
| "***** (V21) foo$district_code *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 46.817 \t \t 46.817 \n", | |
| "mean control.......... 47.835 \t \t 48.265 \n", | |
| "std mean diff......... -5.8217 \t \t -8.2832 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 1.3224 \t \t 1.8117 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 17 \t \t 29 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.02437 \t \t 0.030972 \n", | |
| "med eCDF diff........ 0.0063842 \t \t 0.016356 \n", | |
| "max eCDF diff........ 0.085834 \t \t 0.099908 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.96536 \t \t 0.96245 \n", | |
| "T-test p-value........ 0.097001 \t \t 0.057393 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 1.1384e-05 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.085834 \t \t 0.099908 \n", | |
| "\n", | |
| "\n", | |
| "***** (V22) foo$worker *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 2.9487 \t \t 2.9487 \n", | |
| "mean control.......... 2.245 \t \t 2.1183 \n", | |
| "std mean diff......... 3.8339 \t \t 4.5244 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 1.6176 \t \t 0.91439 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 841 \t \t 233 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.005382 \t \t 0.0049156 \n", | |
| "med eCDF diff........ 0.0025716 \t \t 0.002645 \n", | |
| "max eCDF diff........ 0.069671 \t \t 0.067954 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.73232 \t \t 2.0382 \n", | |
| "T-test p-value........ 0.29003 \t \t 0.23452 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 0.00070064 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.069671 \t \t 0.067954 \n", | |
| "\n", | |
| "\n", | |
| "***** (V23) foo$capital *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 28868899 \t \t 28868899 \n", | |
| "mean control.......... 18071107 \t \t 19110467 \n", | |
| "std mean diff......... 6.2984 \t \t 5.6921 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 7592769 \t \t 10340162 \n", | |
| "med raw eQQ diff..... 1250000 \t \t 5e+05 \n", | |
| "max raw eQQ diff..... 9.5e+08 \t \t 4.52e+09 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.038304 \t \t 0.024354 \n", | |
| "med eCDF diff........ 0.040732 \t \t 0.022911 \n", | |
| "max eCDF diff........ 0.081449 \t \t 0.070456 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 3.6698 \t \t 2.6808 \n", | |
| "T-test p-value........ 0.050687 \t \t 0.11866 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 3.7884e-05 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.081449 \t \t 0.070456 \n", | |
| "\n", | |
| "\n", | |
| "***** (V24) foo$credit_proposal *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 14991916 \t \t 14991916 \n", | |
| "mean control.......... 12658397 \t \t 12779367 \n", | |
| "std mean diff......... 6.4439 \t \t 6.1099 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 2263161 \t \t 2403218 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 3.75e+08 \t \t 4e+08 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.016794 \t \t 0.011459 \n", | |
| "med eCDF diff........ 0.0050118 \t \t 0.0093789 \n", | |
| "max eCDF diff........ 0.056342 \t \t 0.040804 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 4.0856 \t \t 4.7106 \n", | |
| "T-test p-value........ 0.044864 \t \t 0.074411 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 0.010995 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.056342 \t \t 0.040804 \n", | |
| "\n", | |
| "\n", | |
| "***** (V25) foo$worker_transformed *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 2.4763 \t \t 2.4763 \n", | |
| "mean control.......... 2.3199 \t \t 2.3364 \n", | |
| "std mean diff......... 11.168 \t \t 9.988 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.15586 \t \t 0.13309 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.017377 \t \t 0.014788 \n", | |
| "med eCDF diff........ 0.014978 \t \t 0.0047038 \n", | |
| "max eCDF diff........ 0.069671 \t \t 0.067954 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.1665 \t \t 1.1492 \n", | |
| "T-test p-value........ 0.0011978 \t \t 0.019037 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 0.00070064 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.069671 \t \t 0.067954 \n", | |
| "\n", | |
| "\n", | |
| "***** (V26) foo$capital_transformed *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 5.9293 \t \t 5.9293 \n", | |
| "mean control.......... 5.7449 \t \t 5.8285 \n", | |
| "std mean diff......... 7.28 \t \t 3.9801 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.29332 \t \t 0.11145 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 8 \t \t 8 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.030438 \t \t 0.011929 \n", | |
| "med eCDF diff........ 0.0378 \t \t 0.013675 \n", | |
| "max eCDF diff........ 0.04309 \t \t 0.02013 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.82461 \t \t 0.91352 \n", | |
| "T-test p-value........ 0.04152 \t \t 0.35504 \n", | |
| "KS Bootstrap p-value.. 0.024 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 0.09532 \t \t 9.8077e-13 \n", | |
| "KS Statistic.......... 0.04309 \t \t 0.02013 \n", | |
| "\n", | |
| "\n", | |
| "***** (V27) foo$credit_proposal_transformed *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 4.6883 \t \t 4.6883 \n", | |
| "mean control.......... 4.1742 \t \t 4.2198 \n", | |
| "std mean diff......... 17.636 \t \t 16.072 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.51404 \t \t 0.43907 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 4 \t \t 4 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.047434 \t \t 0.03687 \n", | |
| "med eCDF diff........ 0.047845 \t \t 0.030238 \n", | |
| "max eCDF diff........ 0.079695 \t \t 0.072615 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.153 \t \t 1.1823 \n", | |
| "T-test p-value........ 3.4516e-07 \t \t 0.00012676 \n", | |
| "KS Bootstrap p-value.. < 2.22e-16 \t \t < 2.22e-16 \n", | |
| "KS Naive p-value...... 6.0214e-05 \t \t < 2.22e-16 \n", | |
| "KS Statistic.......... 0.079695 \t \t 0.072615 \n", | |
| "\n", | |
| "\n", | |
| "***** (V28) foo$missing_date_of_birth *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.010649 \t \t 0.010649 \n", | |
| "mean control.......... 0.016637 \t \t 0.010649 \n", | |
| "std mean diff......... -5.8317 \t \t 0 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0058083 \t \t 0 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 0 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0029943 \t \t 0 \n", | |
| "med eCDF diff........ 0.0029943 \t \t 0 \n", | |
| "max eCDF diff........ 0.0059887 \t \t 0 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.6444 \t \t 1 \n", | |
| "T-test p-value........ 0.11386 \t \t 1 \n", | |
| "\n", | |
| "\n", | |
| "***** (V29) foo$NA_postal_code *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.13359 \t \t 0.13359 \n", | |
| "mean control.......... 0.17696 \t \t 0.1584 \n", | |
| "std mean diff......... -12.741 \t \t -7.2878 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.043562 \t \t 0.023004 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.021684 \t \t 0.011502 \n", | |
| "med eCDF diff........ 0.021684 \t \t 0.011502 \n", | |
| "max eCDF diff........ 0.043368 \t \t 0.023004 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.79527 \t \t 0.86825 \n", | |
| "T-test p-value........ 0.00038891 \t \t 0.10333 \n", | |
| "\n", | |
| "\n", | |
| "***** (V30) foo$NA_capital *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.018393 \t \t 0.018393 \n", | |
| "mean control.......... 0.024956 \t \t 0.020884 \n", | |
| "std mean diff......... -4.8819 \t \t -1.8529 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.0067764 \t \t 0.0022875 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.0032814 \t \t 0.0011438 \n", | |
| "med eCDF diff........ 0.0032814 \t \t 0.0011438 \n", | |
| "max eCDF diff........ 0.0065629 \t \t 0.0022875 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 0.74251 \t \t 0.88297 \n", | |
| "T-test p-value........ 0.17716 \t \t 0.64518 \n", | |
| "\n", | |
| "\n", | |
| "***** (V31) foo$NA_credit_proposal *****\n", | |
| " Before Matching \t \t After Matching\n", | |
| "mean treatment........ 0.25169 \t \t 0.25169 \n", | |
| "mean control.......... 0.1752 \t \t 0.17425 \n", | |
| "std mean diff......... 17.618 \t \t 17.835 \n", | |
| "\n", | |
| "mean raw eQQ diff..... 0.076476 \t \t 0.072615 \n", | |
| "med raw eQQ diff..... 0 \t \t 0 \n", | |
| "max raw eQQ diff..... 1 \t \t 1 \n", | |
| "\n", | |
| "mean eCDF diff........ 0.038249 \t \t 0.036308 \n", | |
| "med eCDF diff........ 0.038249 \t \t 0.036308 \n", | |
| "max eCDF diff........ 0.076499 \t \t 0.072615 \n", | |
| "\n", | |
| "var ratio (Tr/Co)..... 1.3043 \t \t 1.3089 \n", | |
| "T-test p-value........ 2.6628e-07 \t \t 1.4277e-05 \n", | |
| "\n", | |
| "\n", | |
| "Before Matching Minimum p.value: < 2.22e-16 \n", | |
| "Variable Name(s): foo$R_date_of_birth foo$district_code foo$worker foo$capital foo$credit_proposal foo$worker_transformed foo$credit_proposal_transformed Number(s): 1 21 22 23 24 25 27 \n", | |
| "\n", | |
| "After Matching Minimum p.value: < 2.22e-16 \n", | |
| "Variable Name(s): foo$district_code foo$worker foo$capital foo$credit_proposal foo$worker_transformed foo$capital_transformed foo$credit_proposal_transformed Number(s): 21 22 23 24 25 26 27 \n", | |
| "\n" | |
| ], | |
| "name": "stdout" | |
| } | |
| ] | |
| }, | |
| { | |
| "cell_type": "markdown", | |
| "metadata": { | |
| "id": "tPFiC5hazn-l", | |
| "colab_type": "text" | |
| }, | |
| "source": [ | |
| "The following modifications were made to the code in accordance with the second question's prompt:\n", | |
| "\n", | |
| "1. I used Caliper to match units whose birthdays were close to each other - within one year\n", | |
| "2. In order to get the first two digits of the district code, I used the code \"foo$district_code%/%100\"\n", | |
| "\n", | |
| "**What does it mean to match exactly on the first two digits of the district code?**\n", | |
| "\n", | |
| "To match exactly on the first 2 digits of the district code means that we are only matching\n", | |
| "loaners that come from the same province.\n", | |
| "\n", | |
| "As apparent from the code results, we can see that the balance on the observed covariates was high.\n" | |
| ] | |
| } | |
| ] | |
| } |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment