federer007 / go

The Open Source Data Science Masters

Follow me on Twitter @clarecorthell

The Open-Source Data Science Masters

The Internet is Your Oyster

I didn't want to wait. I wanted to work on things I care about now. Why sleep through grad school lectures tomorrow when you can hack on interesting questions today?

see my transcript

With Coursera, ebooks, Stack Overflow, and GitHub -- all free and open -- how can you afford not to take advantage of an open source education?

The Motivation

We need more Data Scientists.

...by 2018 the United States will experience a shortage of 190,000 skilled data scientists, and 1.5 million managers and analysts capable of reaping actionable insights from the big data deluge.

-- McKinsey Report Highlights the Impending Data Scientist Shortage 23 July 2013

There are little to no Data Scientists with 5 years experience, because the job simply did not exist.

-- David Hardtke How To Hire A Data Scientist 13 Nov 2012

An Academic Shortfall

Classic academic conduits aren't providing Data Scientists -- this talent gap will be closed differently.

Academic credentials are important but not necessary for high-quality data science. The core aptitudes – curiosity, intellectual agility, statistical fluency, research stamina, scientific rigor, skeptical nature – that distinguish the best data scientists are widely distributed throughout the population.

We’re likely to see more uncredentialed, inexperienced individuals try their hands at data science, bootstrapping their skills on the open-source ecosystem and using the diversity of modeling tools available. Just as data-science platforms and tools are proliferating through the magic of open source, big data’s data-scientist pool will as well.

And there’s yet another trend that will alleviate any talent gap: the democratization of data science. While I agree wholeheartedly with Raden’s statement that “the crème-de-la-crème of data scientists will fill roles in academia, technology vendors, Wall Street, research and government,” I think he’s understating the extent to which autodidacts – the self-taught, uncredentialed, data-passionate people – will come to play a significant role in many organizations’ data science initiatives.

-- James Kobielus, Closing the Talent Gap 17 Jan 2013

Ready?

---

The Open Source Data Science Curriculum

Start here.

• Intro to Data Science UW / Coursera
• Topics: Python NLP on Twitter API, Distributed Computing Paradigm, MapReduce/Hadoop & Pig Script, SQL/NoSQL, Relational Algebra, Experiment design, Statistics, Graphs, Amazon EC2, Visualization.
• Haravard CS 109 Data Science Video Archive Class Webpage
• Topics: Data wrangling, data management, exploratory data analysis to generate hypotheses and intuition, prediction based on statistical methods such as regression and classification, communication of results through visualization, stories, and summaries.

Math

• Linear Algebra & Programming

• Linear Algebra / Levandosky Stanford / Book $10

• Linear Programming (Math 407) University of Washington / Course

• Statistics

• Statistics One Princeton / Coursera

• Stats in a Nutshell Book $29

• Think Stats: Probability and Statistics for Programmers Digital & Book $25

• Think Bayes Allen Downey / Book

• Differential Equations & Calculus

• Differential Equations in Data Science Python Tutorial

• Problem Solving

• Problem-Solving Heuristics "How To Solve It" Polya / Book $10

Computing

• Algorithms

• Algorithms Design & Analysis I Stanford / Coursera

• Algorithm Design, Kleinberg & Tardos Book $125

• Distributed Computing Paradigms

• *See Intro to Data Science UW / Lectures on MapReduce

• Intro to Hadoop and MapReduce Cloudera / Udacity Course *includes select free excerpts of Hadoop: The Definitive Guide Book $29

• Databases

• SQL Tutorial w3schools / Tutorials

• SQL Tutorial SQLZOO / Tutorials

• Introduction to Databases Stanford / Online Course

• Data Mining

• Mining Massive Data Sets Stanford / Online Book

• Mining The Social Web Book $30

• Introduction to Information Retrieval Stanford / Book

OSDSM Specialization: Web Scraping & Crawling

• Machine Learning

• Machine Learning Ng Stanford / Coursera

• A Course in Machine Learning UMD / Digital Book

• Programming Collective Intelligence Book $27

• The Elements of Statistical Learning Stanford / Digital Book^

• Machine Learning Caltech / Edx

• Neural Networks U Toronto / Coursera

• Statistical Network Analysis & Modeling

• Probabilistic Programming and Bayesian Methods for Hackers Github / Tutorials

• Probabalistic Graphical Models Stanford / Coursera

• Natural Language Processing

• NLP with Python (NLTK library) Digital Book, Paper Book $36

• Analysis

• Python for Data Analysis Paper Book $24

• Big Data Analysis with Twitter UC Berkeley / Lectures

• Social and Economic Networks: Models and Analysis / Stanford / Coursera

• Visualization

• Envisioning Information (Information Visualization) Tufte / Book $36

• Data Visualization, CS 171 Harvard / Lectures

• Scott Murray's Tutorial on D3 Blog / Tutorials

• Berkely's Viz Class UC Berkeley / Course Docs

• Rice University's Data Viz class Rice University

OSDSM Specialization: Data Journalism

• Python (Learning)

• Learn Python the Hard Way eBook

• Python Class / Google

• Think Python

• Introduction to Computer Science and Programming MIT OpenCourseWare / Lectures

• Python (Libraries)

• Basic Packages Python, virtualenv, NumPy, SciPy, matplotlib and IPython

• Data Science in iPython Notebooks (Linear Regression, Logistic Regression, Random Forests, K-Means Clustering)

• Bayesian Inference | pymc

• Labeled data structures objects, statistical functions, etc pandas (See: Python for Data Analysis)

• Python wrapper for the Twitter API twython

• Tools for Data Mining & Analysis scikit-learn

• Network Modeling & Viz networkx

• Natural Language Toolkit NLTK

R resources are now here

Capstone Project

• Toy Data Ideas
• Capstone Analysis of Your Own Design; Quora's Idea Compendium
• Healthcare Twitter Analysis Coursolve & UW Data Science

---

Further Study Resources

• The "Hacker News" of Data Science DataTau
• Coursera
• Khan Academy
• Metacademy
• Wolfram Alpha
• Wikipedia
• The Signal and The Noise - Nate Silver Pop-Sci Data Analysis $
• Zipfian Academy's List of Resources
• A Software Engineer's Guide to Getting Started with Data Science
• Data Scientist Interviews Metamarkets
• /r/MachineLearning Reddit

Datasets Sources

NB These are being migrated to datasets.md

• NIPS Feature Selection
• Stanford Network Analysis Project
• Data Science Contests [Kaggle] (https://www.kaggle.com/)
• @hmason's curated dataset list bit.ly
• Classical Datasets for Your Specific Need UCI Machine Learning Repository Datasets
• Time Series Data Library
• USA Congressional Voting Records Voteview
• Qandl provides a lot of interesting data with a clean API.

---

Notation

Paid books, courses, and resources are noted with $.

A Note About Direction

This is an introduction geared toward those with at least a minimum understanding of programming, and (perhaps obviously) an interest in the components of Data Science (like statistics and distributed computing). Out of personal preference and need for focus, I geared the original curriculum toward Python tools and resources. R resources can be found here.

Contribute

Please Share and Contribute Your Ideas -- it's Open Source!

Here's my transcript.

Please showcase your own specialization & transcript by submitting a markdown file pull request in the /transcripts directory with your name! eg clare-corthell-2014.md

Follow me on Twitter @clarecorthell