YiGinger · YiGinger · Apr 27, 2014 · Apr 27, 2014 · Apr 27, 2014 · Apr 27, 2014
diff --git a/.gitignore b/.gitignore
@@ -6,3 +6,6 @@ _site
 
 # OS weirdness
 *.DS_Store
+
+.Rhistory
+Thumbs.db
diff --git a/Blogpost1.md b/Blogpost1.md
diff --git a/README.md b/README.md
@@ -21,3 +21,18 @@ cp _drafts/post-template.md _posts/2014-14-14-is-not-a-valid-date.md
 
 Turn a post into fun reveal.js slides by using the 'pres' layout. Slides then nest in `<section>` tags ([doc](http://lab.hakim.se/reveal-js/#/))
 
+Other useful git tricks
+------------
+
+Add this or [something similar](http://stackoverflow.com/questions/1057564/pretty-git-branch-graphs) to your .gitconfig and then type `git tree` for a nice display in your 
+```{bash}
+[alias]
+        tree = log --graph --decorate --pretty=oneline --abbrev-commit
+        lg = log --graph --abbrev-commit --decorate --date=relative \
+--format=format:'%C(bold blue)%h%C(reset) - %C(bold green)(%ar)%C(reset) %C(white)%s%C(reset) %C(dim white)- %an%C(reset)%C(bold yellow)%d%C(reset)' --all
+```
+
+If you tried to make a commit without a message, you might have gotten an error, or you might have ended up in a special place known as the text editor **vi**.
+  1. To get out of vi type `:q!` and redo your commit with `-m "useful commit message"`
+  2. To change your default editor, see for [mac](http://stackoverflow.com/questions/3957999/mac-specific-optimizations-in-gitconfig) or [windows](http://stackoverflow.com/questions/8951275/git-config-core-editor-how-to-make-sublime-text-the-default-editor-for-git-on)
+  3. vi users among you might have assumed correctly that I use emacs. [C-x M-c M-butterfly](http://xkcd.com/378/).
diff --git a/_data/agenda.yaml b/_data/agenda.yaml
@@ -71,7 +71,7 @@
 - date: 2014-02-12
   topic: More statistical graphics theory
   before: |
-    - Grammar of Graphics, ch. TBD
+    - Gelman and Hill, TBD
 
 - date: 2014-02-17
   topic: Type, Typesetting, Typography, and Strings
@@ -96,38 +96,41 @@
     - discuss color issues for class projects
 
 - date: 2014-02-24
-  topic: Trellis/Lattice
-  before: |
-    - Yau ch.6
-    - Sarkar book (SpringerLink)
-  during: Discuss problems Lattice solves, use cases, implementations, relevance to blogposts or projects
+  topic: Data are ugly
+  before:  |
+    - [Tidy data](http://vita.had.co.nz/papers/tidy-data.pdf)
+    - [Research directions in data wrangling](http://idl.cs.washington.edu/papers/data-wrangling)
 
 - date: 2014-02-26
-  topic: ggplot2 in some depth
-  before: |
-    - gglot2 book (SpringerLink)
-    - [ggplot2 doc web site](http://ggplot2.org)
-    - [ggplot in Python](http://blog.yhathq.com/posts/ggplot-for-python.html)
+  topic: APIs and data interchange
+  before: some API doc; R and Python tools for data wrangling and interfaces
+  during: discuss I/O, shortcuts, and modeling
+  after: |
+    - [ggplot2 data contract](http://martinsbioblogg.wordpress.com/2014/02/20/books-and-lessons-about-ggplot2/)
+    - [optimizing R](http://www.noamross.net/blog/2013/4/25/faster-talk.html)
 
 - date: 2014-03-03
-  topic: more strategies for improving graphs
-  due: blogpost 2 due. Submit a pull request and be ready to discuss challenges you had and how you solved them.
+  topic: blogposts review; R packaging
+  due: blogpost 1 due. Submit a pull request and be ready to discuss challenges you had and how you solved them.
   before: |
     - Yau, ch. 4,5,7
+  during: Build an R package for a project
 
 - date: 2014-03-05
-  topic: Animation
   due: Iteration plan. What was left undone, objective and key results for next three weeks.
+  during: Do grouped/stacked plot of estimated party ID in Lattice
+  topic: Nominally Animation; more APIs and data interchange
   before: |
     - [The Joy of Stats](http://www.gapminder.org/videos/the-joy-of-stats/)
     - [Google Charts motion chart doc](https://developers.google.com/chart/interactive/docs/gallery/motionchart) and in [R](http://blog.revolutionanalytics.com/2011/01/create-motion-charts-in-r-with-the-googlevis-package.html)
     - [Heer et al, animated transitions](http://idl.cs.washington.edu/papers/animated-transitions/)
 
 - date: 2014-03-10
-  topic: Gentle introduction to D3
-  before: |
-    - [Murray, Interative data Visualization for the Web](http://proquest.safaribooksonline.com.ezproxy.cul.columbia.edu/book/web-design-and-development/9781449340223) (O'Reilly Safari)
-  during: js, json, svg; tips and tricks
+  topic: Two refactoring stories
+  during: |
+    - Lightning talks
+    - Refactor old exploratory and analysis code to R-package pattern; bugfix using testthat.
+    - after: [Data science workflow](http://cacm.acm.org/blogs/blog-cacm/169199-data-science-workflow-overview-and-challenges/fulltext)
 
 - date: 2014-03-12
   topic: Getting there from here
@@ -138,41 +141,47 @@
     - [Paul Murrell's page](https://www.stat.auckland.ac.nz/~paul/)
     - Rec: [Dynamic Visualizations with D3 and AngularJS](http://www.youtube.com/watch?v=BvAeabvZ61o)
 
+- date: 2014-03-18
+  topic: (spring break)
+  during: | 
+    - [NYhackR meetup](http://www.meetup.com/nyhackr/events/169828902/)
+
 - date: 2014-03-24
-  topic: Maps
+  topic: Gentle introduction to D3
+  before: |
+    - [Murray, Interative data Visualization for the Web](http://proquest.safaribooksonline.com.ezproxy.cul.columbia.edu/book/web-design-and-development/9781449340223) (O'Reilly Safari)
+  during: js, json, svg; tips and tricks
+
+
+- date: 2014-03-26
+  topic: maps
   before: |
     - Yau, ch. 8
     - Gelman&Hill, ch. TBD
     - Recommended: [Wayfinding](http://www.slate.com/articles/life/signs/2010/03/the_secret_language_of_signs.html)
 
-- date: 2014-03-26
-  topic: project check-in
-  before: Something Agile
-  due: Iteration plan.
-  during: |
-    - Discuss status of projects: 
-      - what's done, what looks on track or not; 
-      - strategies to complete, updates to specifications and plans.
-
 - date: 2014-04-02
   topic: Reproducibility and Replication
   before: |
-    - Knuth on literate programming
-    - knitr doc
-    - IPython notebook doc
+    - [knitr doc](http://yihui.name/knitr/)
+    - [IPython notebook doc](http://ipython.org/notebook), [intro](http://www.randalolson.com/2012/05/12/a-short-demo-on-how-to-use-ipython-notebook-as-a-research-notebook/)
   during: |
     - discuss reproducible research, publishing replication data, versioning, &c
 
 - date: 2014-04-07
-  topic: Data are ugly
-  before:  |
-    - [Tidy data](http://vita.had.co.nz/papers/tidy-data.pdf)
-    - [Research directions in data wrangling](http://idl.cs.washington.edu/papers/data-wrangling)
+  topic: Trellis/Lattice
+  before: |
+    - Yau ch.6
+    - Sarkar book ([SpringerLink](http://link.springer.com/book/10.1007/978-0-387-75969-2))
+  during: Discuss problems Lattice solves, use cases, implementations, relevance to blogposts or projects
+
 
 - date: 2014-04-09
-  topic: discuss blogposts
-  due: blogpost #3
-  during: discuss blog posts, bad graphs of the day
+  due: blogpost \#2
+  during: |
+    - [Birds of the Same Feather Tweet Together](https://files.nyu.edu/pba220/public/barbera_twitter_ideal_points.pdf)
+    - [Is There Anybody Out There? The Effects of Legislators’ Communication with their Constituents](https://files.nyu.edu/pba220/public/barbera_twitter_responsiveness.pdf)
+  topic: Pablo Barberá, working paper
 
 - date: 2014-04-14
   topic: Histograms are totally simple, right?
@@ -181,20 +190,24 @@
     - [Basics of Histograms](http://rforpublichealth.blogspot.com/2012/12/basics-of-histograms.html)
     - [Histogram package paper](http://cran.r-project.org/web/packages/histogram/histogram.pdf)
     - [Histogram D3 layout](https://github.com/mbostock/d3/wiki/Histogram-Layout)
+    - [Henry Deng and Hadley Wickham, Density Estimation in R](http://vita.had.co.nz/papers/density-estimation.pdf)
 
 - date: 2014-04-16
-  topic: APIs and data interchange
-  before: some API doc; R and Python tools for data wrangling and interfaces
-  during: discuss I/O and modeling
+  topic: ggplot2 in some depth
+  before: |
+    - gglot2 book (SpringerLink)
+    - [ggplot2 doc web site](http://ggplot2.org)
+    - [ggplot in Python](http://blog.yhathq.com/posts/ggplot-for-python.html)
 
 - date: 2014-04-21
-  topic: data structures, storage, and modeling
+  topic: Bayesian logistic and item-response-family models
+  before: |
+    - Gelman & Hill ch. 6, 14.3
 
 - date: 2014-04-23
   topic: model checking, displays, and uncertainty
   before: |
-    - Gelman&Hill ch. TBD
-    - Wilkinson ch. TBD
+    - Gelman&Hill ch. 8
 
 - date: 2014-04-28
   topic: class and project reviews
@@ -203,5 +216,6 @@
   topic: project reviews
 
 - date: 2014-05-05
+  due: Blogpost \#3
   topic: project reviews
 
diff --git a/_posts/2014-02-01-Gabrielle-Agrocostea-Intro.md b/_posts/2014-02-01-Gabrielle-Agrocostea-Intro.md
@@ -2,6 +2,7 @@
 layout: post
 title: Introducing - Gabrielle Agrocostea
 description: A short intro and Assignment 0 Update
+tags: intro
 ---
 
 >I am a student in the Data Science Certificate Program here at Columbia and my undergraduate degree was in Mathematics from Fordham University.
@@ -18,5 +19,7 @@ Using ggplot I plotted all the population by years and location - which allowed
 >I found it difficult to incorporate all of the locations so I ended up by finding the average by year and keeping only the locations that had populations greater than the yearly average. This graph shows only a few locations which were above the yearly average.
 +[![popGraph-allData](http://Gabya06.github.io/edav/assets/popGraph-byCity.png)](http://Gabya06.github.io/edav/assets/popGraph-byCity.png)
 
+> Rscrapper for summary dataset and full dataset [here](https://github.com/malecki/edav/tree/gh-pages/projects/popgraph/rscrapper/scrape-population.R)
+
 ## Next Steps
 > I am starting to work analyzing the data using D3.
diff --git a/_posts/2014-02-01-Melissa-Berry-Intro.md b/_posts/2014-02-01-Melissa-Berry-Intro.md
@@ -2,6 +2,7 @@
 layout: post
 title: Introducing - Melissa Berry
 description: A short blurb to introduce myself to the class
+tags: intro
 ---
 
 I am a student in the QMSS (Quantitative Methods in the Social Sciences) Master's program here at Columbia.  I am in my second year and attend Columbia on a part-time basis.  I work full-time for SunPower (which makes the world's most efficient solar cells!) as a Business Process Analyst.  In practice that means I manage a construction/project management software that we use for commercial and utility scale solar installations. 

diff --git a/_posts/2014-02-02-Zijian-Yi-Intro.md b/_posts/2014-02-02-Zijian-Yi-Intro.md
@@ -2,5 +2,6 @@
 layout: post
 title: Introducing - Zijian Yi
 description: A graphic introduction of myself
+tags: intro
 ---
 [assignment 0 link]({{ site.baseurl }}/assets/Zijian_Yi_posts_support_files/index.html)
diff --git a/_posts/2014-02-02-bhtucker-intro.md b/_posts/2014-02-02-bhtucker-intro.md
@@ -2,6 +2,7 @@
 layout: post
 title: Introducing - Ben Tucker
 description: Who Am I / Link to HW0 Stuff
+tags: intro
 ---
 
 I'm a student in the new IDSE program, which is a major change from my background in urban studies, where I once split my time between social sciences and intellectual history. I've had the opportunity to nourish my latent technical skills and think hard about analysis and developing, and now consider myself to be on the road towards Data Scientist-dom!

diff --git a/_posts/2014-02-02-celene-intro.md b/_posts/2014-02-02-celene-intro.md
@@ -2,12 +2,12 @@
 layout: post
 title: Celene's Intro
 description:
-tags: blog
+tags: blog intro
 ---
 <section>
 	<section>
 ### My background
-![]({{ site.baseurl }}/assets/celene.JPG)<br>
+![]({{ site.baseurl }}/assets/celene_assets/celene.JPG)<br>
 I'm a Jersey Girl, and while not particularly proud of it I'll defend my state when necessary. Growing up I had always assumed I'd be a medical doctor because it was sciencey and didn't seem to depend on writing essays or understanding the law of gravity. In college I majored in Ecology & Evolutionary Bio, fulfilled the pre-med requirements, and took the MCAT. But my senior thesis experience got me thinking that research was kind of fun, and during my gap year I applied to both medical school and graduate school. (I wasn't qualified to be competitive for combined programs, and frankly wasn't interested in spending _that_ much more time in school. HA!) After interviews for both, I decided graduate school was a better fit.
 
 Fast forward to last June, when I finished my PhD in Neuroscience and felt... lost. I didn't want to be an Academic and, despite the esteem associated with a doctorate degree, didn't have many other clear-cut options. So I moved to New York to join the husband and began exploring the Interweb.

diff --git a/_posts/2014-02-02-spk2131-assignment0.md b/_posts/2014-02-02-spk2131-assignment0.md
@@ -2,6 +2,7 @@
 layout: post
 title: Assignment 0 - Stephen Kappel
 description: My work on Assignment 0
+tags: assignments
 ---
 
 ## My Repository

diff --git a/_posts/2014-02-02-spk2131.md b/_posts/2014-02-02-spk2131.md
@@ -2,6 +2,7 @@
 layout: post
 title: Introducing - spk2131
 description: about and interests
+tags: intro
 ---
 
 ## About Me

diff --git a/_posts/2014-02-02-xiaoou-introducing.md b/_posts/2014-02-02-xiaoou-introducing.md
@@ -2,7 +2,7 @@
 layout: post
 title: Introducing - Xiaoou Li
 description: a paragraph to introduce myself to the class
-
+tags: intro
 ---
 
 I am a PhD student in Statistics department at Columbia, and I am the TA for this class. 

diff --git a/_posts/2014-02-03-Intro-VivianPeng.md b/_posts/2014-02-03-Intro-VivianPeng.md
@@ -0,0 +1,14 @@
+---
+layout: post
+title: Intro
+tags: intro
+---
+
+```
+Hi, I'm Vivian- a 2nd year MPH student (studying Public Health Informatics), and freelance graphic designer. Coffee, dance, "serious" .gifs enthusiast.
+
+I make infographics for Doctors Without Borders (which hopefully never end up on our Graphs of the Day portion of class, but of course critique is always welcomed). I'm interested in learning data visualization tools to improve on my work.
+
+http://www.vivianpeng.com
+
+```
diff --git a/_posts/2014-02-03-Mayank_Misra-intro.md b/_posts/2014-02-03-Mayank_Misra-intro.md
@@ -1,7 +1,7 @@
 ---
 layout: page
 title: who am i?
-tagline: 
+tags: intro
 ---
 {% include JB/setup %}
 # moi [Mayank Misra](http://mayankmisra.com/read-me/)....   

diff --git a/_posts/2014-02-03-andrew-yuan.md b/_posts/2014-02-03-andrew-yuan.md
@@ -2,12 +2,12 @@
 layout: post
 title: Introducing - Andrew Yuan
 description: Brief introduction
-tags: emails assignments
+tags: intro
 ---
 
 Originally from Sao Paulo, Brazil, I have 9.5 years of experience as a project manager and software engineering at Accenture, part of our Systems Integration practice for the financial services industry.
 Worked with projects related to Management Information Systems, consolidating and providing data for controllers, risk managers, accountants and taxes for financial institutions. Have also worked at Technical Architecture assessment projects and software factory processes optimization.
 <br>Have a Computer Science bachelor degree at Universidade de Sao Paulo (USP).
 <p>Looking forward to learning a lot from this Data Exploration and Visualization class!
 
-<p>e-mail: agy2108@columbia.edu
+<p>e-mail: agy2108@columbia.edu
diff --git a/_posts/2014-02-03-bwelsh-intro.md b/_posts/2014-02-03-bwelsh-intro.md
@@ -2,7 +2,7 @@
 layout: post
 title: Introduction and first post
 description: this is my introductory post and first attempt at exploring the population data
-tags: post
+tags: intro assignments
 ---
 ## Introduction - Barbara Welsh ##
 

diff --git a/_posts/2014-02-03-mandeep-singh-intro.md b/_posts/2014-02-03-mandeep-singh-intro.md
@@ -2,6 +2,7 @@
 layout: pres
 title: Mandeep Intro Page
 description: Mandeep Singh Bio and Introduction
+tags: intro
 ---
 
 <section>

diff --git a/_posts/2014-02-03-priya-venkat-intro.md b/_posts/2014-02-03-priya-venkat-intro.md
@@ -1,6 +1,7 @@
 ---
 layout: post
 title: Priya
+tags: intro
 ---
 
 Hi All, this is Priya (official name is Gnanapriya Venkatasubramaniam, I know too long :) ) I am student of the graduate certificate program in Data Sciences, an undergrad in Instrumention Engineering, an IT consultant with 6 years of experience for JPMorgan Chase and a proud mother of a 2 yr old busy toddler :)

diff --git a/_posts/2014-02-03-shengcaocao.md b/_posts/2014-02-03-shengcaocao.md
@@ -2,6 +2,7 @@
 layout: post
 title: Introducing - Andy Cao
 description: a paragraph to introduce myself to the class
+tags: intro
 ---
 
 Since joining the IDSE Data Sciences Certification program, I have been introducing myself as a "full-time actuary, part-time data science student". First, the “full-time actuary” part; I work for a French life insurance company named AXA. Actuaries are basically the risk managers of the company. We project cash flows, determine reserves and capitals, buy hedges to mitigate risks, among other functions. My day-to-day work involves consolidating cash flows, and provides projection of how much money AXA needs to hold to meet policyholder obligations and regulatory requirements.

diff --git a/_posts/2014-02-03-sunandakp-intro.md b/_posts/2014-02-03-sunandakp-intro.md
@@ -1,7 +1,8 @@
 ---
 layout: post
 title: Introducing - sunandakp
-description: a paragraph to introduce myself to the class
+description: Introducing - sunandakp the class
+tags: intro
 ---
 
 ## A Brief Introduction

diff --git a/_posts/2014-02-04-Bryan_Kaufman-intro.md b/_posts/2014-02-04-Bryan_Kaufman-intro.md
@@ -1,7 +1,8 @@
 ---
 layout: page
 title: who am i?
-tagline: 
+description: Bryan Kaufman Intro
+tags: intro
 ---
 {% include JB/setup %}
 #[Bryan Kaufman](http://about.me/bkaufman)