Difference between revisions of "Introduction to Data Science I"

From Introduction to Data Science
Jump to: navigation, search
(Timeline (Tentative))
(Timeline (Tentative))
 
(32 intermediate revisions by 21 users not shown)
Line 47: Line 47:
 
* '''Required Texts'''
 
* '''Required Texts'''
 
:* '''JWHT''': James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). ''An introduction to statistical learning with applications in R.'' New York: Springer. ['''Free''' through [https://www.lib.uwo.ca/cgi-bin/ezpauthn.cgi?url=http://link.springer.com/978-1-4614-7138-7 Western]]
 
:* '''JWHT''': James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). ''An introduction to statistical learning with applications in R.'' New York: Springer. ['''Free''' through [https://www.lib.uwo.ca/cgi-bin/ezpauthn.cgi?url=http://link.springer.com/978-1-4614-7138-7 Western]]
:* '''HTF''': ''The Elements of Statistical Learning'' by Hastie, Tibshirani and Friedman. Expanded version of required text. ['''Free''' [http://www-stat.stanford.edu/~tibs/ElemStatLearn/ online]]
+
:* '''HTF''': ''The Elements of Statistical Learning'' by Hastie, Tibshirani and Friedman. Expanded version of required text. ['''Free''' [http://web.stanford.edu/~hastie/ElemStatLearn/ online]]
 
:* '''LW''': Leland Wilkinson's ''The Grammar of Graphics'' (2005). ['''Free''' from [https://www.lib.uwo.ca/cgi-bin/ezpauthn.cgi?url=http://link.springer.com/book/10.1007/0-387-28695-0 Springer]]
 
:* '''LW''': Leland Wilkinson's ''The Grammar of Graphics'' (2005). ['''Free''' from [https://www.lib.uwo.ca/cgi-bin/ezpauthn.cgi?url=http://link.springer.com/book/10.1007/0-387-28695-0 Springer]]
 
:* ggplot2 book by creator Hadley Wickham (2016). ['''Free''' through [https://alpha.lib.uwo.ca/record=b6962637~S20 Western]]
 
:* ggplot2 book by creator Hadley Wickham (2016). ['''Free''' through [https://alpha.lib.uwo.ca/record=b6962637~S20 Western]]
Line 75: Line 75:
 
:** The dplyr package [https://cran.r-project.org/web/packages/dplyr/ documentation]. The "vignettes" are particularly good.
 
:** The dplyr package [https://cran.r-project.org/web/packages/dplyr/ documentation]. The "vignettes" are particularly good.
 
:** The Tensorflow Library (Python, C++) [https://www.tensorflow.org/]
 
:** The Tensorflow Library (Python, C++) [https://www.tensorflow.org/]
 +
:* Deep Learning Resources (courtesy Ethan Jackson)
 +
:** Tutorials on Word2Vec in Python. Learns semantic relationships between words in very large corpora by mapping each word to a high-dimensional word embedding. Semantic relationships are estimated using contextual frequency, i.e. how often a word appears given a context of other words.
 +
:***https://radimrehurek.com/gensim/models/word2vec.html
 +
:***https://rare-technologies.com/word2vec-tutorial/
 +
:**Some ideas about using t-SNE for visualization
 +
:***https://www.jeffreythompson.org/blog/2017/02/13/using-word2vec-and-tsne/
 +
:**Digit classification on MNIST dataset using TensorFlow
 +
:***https://www.tensorflow.org/get_started/mnist/beginners
 +
:**Autoencoders for MNIST in Keras (a very high level interface for deep learning libraries including TensorFlow)
 +
:***https://blog.keras.io/building-autoencoders-in-keras.html
 +
:**Convolutional neural networks for image recognition on CIFAR-10 dataset in TensorFlow. Great starting point for image classification using deep learning.
 +
:*** https://www.tensorflow.org/tutorials/deep_cnn
  
 
=== Topics (anticipated) ===
 
=== Topics (anticipated) ===
Line 190: Line 202:
 
* 26 Oct - '''Project Proposal Due 27 Oct at 5pm''' - Lectures: '''Guest Lecture by Dr. Kemi Ola''' on Visualization
 
* 26 Oct - '''Project Proposal Due 27 Oct at 5pm''' - Lectures: '''Guest Lecture by Dr. Kemi Ola''' on Visualization
 
** 31 Oct - Lectures:  
 
** 31 Oct - Lectures:  
* 2 Nov - Lectures:  
+
* 2 Nov - Lectures: Midterm Review/Q&A
 
** 7 Nov - '''Midterm'''
 
** 7 Nov - '''Midterm'''
* 9 Nov - Brainstorming: Ethan Jackson, *slot2*, Sachi Elkerton<br />'''9637 Slots 3:30pm-4:30pm''': *Roopa Bose*, *slot5*, *slot6*, *slot7*
+
* 9 Nov - Brainstorming: Ethan Jackson, *Zaid Albirawi* <br />'''9637 Slots 3:30pm-4:30pm''': Mahtab Ahmed, *Nick DelBen*
 
** 14 Nov - Brainstorming: Ashutosh Mishra, Brandon Glied-Goldstein, Jonathan Tan, Duff Jones, Patrick Carnahan, Nathan Phelps
 
** 14 Nov - Brainstorming: Ashutosh Mishra, Brandon Glied-Goldstein, Jonathan Tan, Duff Jones, Patrick Carnahan, Nathan Phelps
* 16 Nov - '''Project Draft Due 17 Nov at 5pm''' - Brainstorming: Kerlin Lobo, *slot2*, *slot3*<br />'''9637 Slots 3:30pm-4:30pm''': Ruoxi Shi, Valeria Cesar, Mingda Sun, Xindi Wang
+
* 16 Nov - Brainstorming: *slot1*, Gurpreet Singh, Erica Yarmol-Matusiak<br />'''9637 Slots 3:30pm-4:30pm''': Ruoxi Shi, Valeria Cesar, Mingda Sun, Xindi Wang
** 21 Nov - Brainstorming: Cole Fisher, Angela Zhao, *Xiaoyu Yang*, Nanditha Rao, Felipe Urra, *TianzhiZhu*
+
** 21 Nov - Brainstorming: Cole Fisher, Xiaoyu Yang & Sachi Elkerton, Felipe Urra, Tianzhi Zhu
* 23 Nov - Brainstorming: Mahtab Ahmed, Jumayel Islam, *slot*<br />'''9637 Slots 3:30pm-4:30pm''': *Rifayat Samee*, *Hao Jiang*, *Abdelkareem Jaradat*, *Debanjan Guha Roy*
+
* 23 Nov - '''Project Draft Due 24 Nov at 5pm''' - Brainstorming: Nanditha Rao, Jumayel Islam, Sabyasachi Patjoshi<br />'''9637 Slots 3:30pm-4:30pm''': *Hao Jiang*, *Abdelkareem Jaradat*, *Debanjan Guha Roy*
** 28 Nov - Brainstorming: *Yancong Wang*, Mohammad, Yanbing Zhu, Yu Zhu, *Gagan Verma*, *Zeyu Wang*
+
** 28 Nov - Brainstorming: Yancong Wang & Jiayi JI, Angela Zhao & Yanbing Zhu, Yu Zhu, Gagan Verma & Kerlin Lobo, Zeyu Wang
* 30 Nov - Brainstorming: *Marios-Stavros Grigoriou*, *slot2*, *slot3*<br />'''9637 Slots 3:30pm-4:30pm''': *Andrew Bloch-Hansen*, *Nima Khairdoost*, *Sana Ahmadi*, *Mohsen Shirpour*
+
* 30 Nov - Brainstorming: *Marios-Stavros Grigoriou*, Roopa Bose, *Paul Bartlett*<br />'''9637 Slots 3:30pm-4:30pm''': '''CANCELLED'''
** 5 Dec - Brainstorming: *slot1*, *slot2*, *Kun Xie*, *Nasim Samei*, *slot5*, *slot6*
+
** 5 Dec - Brainstorming: (Sanjay Ghanathey, Jenna Le, Tanvi Kumar), *Kun Xie*, *Nasim Samei*, *Jacob Hunte*, *Rifayat Samee*
* 7 Dec - Brainstorming: *slot1*, *slot2*, *slot3*<br />'''9637 Slots 3:30pm-4:30pm''': *Hengyu Yue*, *Zhongwen Zhang*, *slot6*, *slot7*
+
* 7 Dec - Brainstorming: *Nima khairdoodt*, *Sana Ahmadi*, *Mohsen shirpour and Mohammad Alavi*<br />'''9637 Slots 3:30pm-4:30pm''': *Hengyu Yue*, *Zhongwen Zhang*, *Yifang Liu*, *Andrew Bloch-Hansen*
  
 
* '''Project Document Due Friday 8 December 5pm'''
 
* '''Project Document Due Friday 8 December 5pm'''
 
* '''Reviews (graduate students only) Due Thursday 15 December 5pm'''
 
* '''Reviews (graduate students only) Due Thursday 15 December 5pm'''

Latest revision as of 18:49, 28 November 2017


Course outline for COMPSCI 4414A/9637A/9114A

The University of Western Ontario
London, Ontario, Canada
Department of Computer Science
Course Outline - Fall (September - December) 2017

From Dan: This is a very high-demand course that interests students in various programs across campus. I think this is great because the diversity of backgrounds assembled in the class makes for a better learning experience for all. (Myself included!) However, space is limited. Because of the volume of requests I receive, I am not able to manage a wait list. Students will have to monitor the registration website for available spots. However, all are welcome to sit in the room if there is space.

Objective

The objective of this course is to introduce students to data science (DS) techniques, with a focus on application to substantive (i.e. "applied") problems. Students will gain experience in identifying which problems can be tackled by DS methods, and learn to identify which specific DS methods are applicable to a problem at hand. During the course, students will gain an in-depth understanding of a particular (substantive problem, DS solution) pair, and present their findings to their peers in the class. Although this course does not assume prior machine learning or visualization knowledge, it does require students to show substantial initiative in investigating methods that are applicable for their project. The lectures give an overview of important methods, but the lecture content alone is not sufficient to produce a high quality course project.

This course is designed for students who:

  • Like to read - have a desire to understand substantive problems
  • Like to think - make connections between methods and problems
  • Like to hack - be willing to munge data into usability
  • Like to speak - teach us about what you found

Prerequisites

At least one undergraduate programming course (e.g. CS2035) and at least one statistics course (e.g. STAT1024.) This course entails a significant amount of self-directed learning and is directed toward fourth-year undergraduate and graduate students.

Logistics

  • Instructor: Dan Lizotte – dlizotte at uwo dot ca – Office MC363
  • Teaching Assistant: Brent Davis - bdavis56 at uwo dot ca - Runs Q/C Hour (see below)
  • Time: Tuesday from 2:30PM – 4:30PM, and on Thursday from 2:30PM – 3:30PM
  • Place: Middlesex College MC-105B
  • Question and Collaboration Hour: Tuesday from 4:30pm - 5:30pm Location MC 320
  • Communication: We will be using OWL for electronic communication.

Important Dates

  • Pick Brainstorming Slot by Friday, 6 Oct at 5pm
  • Project Proposal Due Friday, 27 Oct at 5pm
  • Project Draft Due Friday, 17 Nov at 5pm
  • Project Report Due Friday, 8 Dec at 5pm
  • Paper Reviews Due Friday, 15 Dec at 5pm

Register for a wiki account. You will need to use the wiki to let us all know about data sources you find, indicate which dataset you are using, and slot yourself in for brainstorming. Also, everyone should free to make improvements to any part of the wiki. (E.g. if you find some useful software or other resources.)

Slot yourself in for a brainstorming session in the Timeline portion at the bottom of this page before end of Friday, 6 Oct at 5pm or Dan will pick a slot for you.

Materials

  • Required Texts
  • JWHT: James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning with applications in R. New York: Springer. [Free through Western]
  • HTF: The Elements of Statistical Learning by Hastie, Tibshirani and Friedman. Expanded version of required text. [Free online]
  • LW: Leland Wilkinson's The Grammar of Graphics (2005). [Free from Springer]
  • ggplot2 book by creator Hadley Wickham (2016). [Free through Western]
  • Review if you need to catch up:
  • Other Resources

Topics (anticipated)

  • Introduction to Data Science
    • Definitions
    • Components
    • Relationships to Other Fields
  • Data Munging
    • Working with structured data: selecting, filtering, joining, aggregating
    • Web scraping
    • Simple visualizations
    • Sanity checking
  • (Re)-introduction to Statistics
    • Data Summaries
    • Randomness, Sample Spaces and Events, Probability
    • Random Variables, CDF, PMF, PDF
    • Expectation
    • Estimation
    • Sampling Distributions: Law of Large Numbers, Central Limit Theorem, The Bootstrap
    • Inference: Hypothesis testing, P-values, Confidence Intervals
    • Multivariate Statistics: conditional probability, correlation, independence
  • Supervised Machine Learning, Predictive Models
    • Supervised Learning
      • Regression
      • Classification
    • Reinforcement Learning and Sequential Decision Making
  • Evaluation
    • Variance: Test set, cross-validation, bootstrap
    • Bias: Confounding, causal inference
  • Unsupervised Machine Learning, Representations, and Feature Construction
    • Clustering
    • Dimensionality reduction
    • Domain-specific Feature Development
      • Images
      • Sounds
      • Text
  • Visualization
    • Topics to be determined

Evaluation

There will be a midterm test but no final exam. Each student will lead a brainstorming session, produce a proposal, draft, and report for a course project. Graduate students (9637) will additionally submit peer reviews of other class projects. For detailed requirements, see Project Guidelines.

Scholastic offences are taken seriously and students are directed to read the appropriate policy, specifically, the definition of what constitutes a Scholastic Offence, at this website: [2].

Daily Quizzes – 5%

Starting on the second lecture, there will be a very short quiz at the beginning of class covering the previous day's materials. The final quiz will be on 31 Oct. The lowest quiz mark will be dropped. Quiz marks will only be excused for medical reasons.

Midterm - 35%

Assessing competencies from the fundamentals taught in the first half of the class.

Brainstorming Session – 5%

Each student will prepare a presentation explaining an applied problem, as well as some potential data science methods that could be applied to the problem. The presentation should be no more than 10 minutes. We will then discuss the problem as a class, along with possible approaches for solving the problem using data science methods. The student is expected to be prepared to answer deep questions about the nature of their problem to ensure that they receive high quality feedback from the brainstorming session.

Project Proposal – 4414: 15% 9637: 10%

Document detailing the plan for the project. See Project Guidelines for detailed requirements.

Report Draft – 5%

A draft of the final report will be due approximately midway through the term. The purpose of the draft is to allow the instructor to provide feedback on the quality of the writing and the direction of the project.

Project Report – 35%

Each student will prepare a research paper detailing a substantive problem, the data available, the applicable data science methods, and empirical results obtained on the problem.

Peer Review – 9637 only: 5%

Each graduate student will prepare two reviews of their classmates' work.

Participation and Effort

Success of the course as a useful learning experience hinges on active participation and effort of the students. Students are expected to attend all classes and are expected to actively participate in the brainstorming sessions.

Accessibility and Support Available at Western

Please contact the course instructor if you require lecture or printed material in an alternate format or if any other arrangements can make this course more accessible to you. You may also wish to contact Services for Students with Disabilities (SSD) at 661-2111 ext. 82147 if you have questions regarding accommodation. Support Services Learning-skills counsellors at the Student Development Centre (http://www.sdc.uwo.ca) are ready to help you improve your learning skills. They offer presentations on strategies for improving time management, multiple-choice exam preparation/writing, textbook reading, and more. Individual support is offered throughout the Fall/Winter terms in the drop-in Learning Help Centre, and year-round through individual counselling. Students who are in emotional/mental distress should refer to Mental Health@Western (http://www.health.uwo.ca/mental_health) for a complete list of options about how to obtain help. Additional student-run support services are offered by the USC, http://westernusc.ca/services. The website for Registrarial Services is http://www.registrar.uwo.ca.

Missed Course Components

If you are unable to meet a course requirement due to illness or other serious circumstances, you must provide valid medical or supporting documentation to the Academic Counselling Office of your home faculty as soon as possible. If you are a Science student, the Academic Counselling Office of the Faculty of Science is located in WSC 140, and can be contacted at 519-661-3040 or scibmsac@uwo.ca. Their website is http://www.uwo.ca/sci/undergrad/academic_counselling/index.html. A student requiring academic accommodation due to illness must use the Student Medical Certificate (https://studentservices.uwo.ca/secure/medical_document.pdf) when visiting an off-campus medical facility. For further information, please consult the university’s medical illness policy at http://www.uwo.ca/univsec/pdf/academic_policies/appeals/accommodation_medical.pdf.

Timeline (Tentative)

  • 7 Sep - Lectures: Welcome
    • 12 Sep - Lectures: Data Preparation, Introduction to Statistics
  • 14 Sep - Lectures: Introduction to Statistics
    • 19 Sep - Lectures: Supervised Learning
  • 21 Sep - Lectures: Supervised Learning, Performance Evaluation
    • 26 Sep - Lectures: Performance Evaluation, Model Selection
  • 28 Sep - Lectures: Classification
    • 3 Oct - Lectures: Classification, Performance Evaluation for Classification
  • 5 Oct - Pick Brainstorming Slot by 6 Oct 5pm - Lectures: Nonlinear Classification
    • 10 Oct - Fall Reading Week
  • 12 Oct - Fall Reading Week
    • 17 Oct - Lectures:
  • 19 Oct - Lectures: Guest Lecture by Amanda Holden of SAS. Topic TBA.
    • 24 Oct - Lectures:
  • 26 Oct - Project Proposal Due 27 Oct at 5pm - Lectures: Guest Lecture by Dr. Kemi Ola on Visualization
    • 31 Oct - Lectures:
  • 2 Nov - Lectures: Midterm Review/Q&A
    • 7 Nov - Midterm
  • 9 Nov - Brainstorming: Ethan Jackson, *Zaid Albirawi*
    9637 Slots 3:30pm-4:30pm: Mahtab Ahmed, *Nick DelBen*
    • 14 Nov - Brainstorming: Ashutosh Mishra, Brandon Glied-Goldstein, Jonathan Tan, Duff Jones, Patrick Carnahan, Nathan Phelps
  • 16 Nov - Brainstorming: *slot1*, Gurpreet Singh, Erica Yarmol-Matusiak
    9637 Slots 3:30pm-4:30pm: Ruoxi Shi, Valeria Cesar, Mingda Sun, Xindi Wang
    • 21 Nov - Brainstorming: Cole Fisher, Xiaoyu Yang & Sachi Elkerton, Felipe Urra, Tianzhi Zhu
  • 23 Nov - Project Draft Due 24 Nov at 5pm - Brainstorming: Nanditha Rao, Jumayel Islam, Sabyasachi Patjoshi
    9637 Slots 3:30pm-4:30pm: *Hao Jiang*, *Abdelkareem Jaradat*, *Debanjan Guha Roy*
    • 28 Nov - Brainstorming: Yancong Wang & Jiayi JI, Angela Zhao & Yanbing Zhu, Yu Zhu, Gagan Verma & Kerlin Lobo, Zeyu Wang
  • 30 Nov - Brainstorming: *Marios-Stavros Grigoriou*, Roopa Bose, *Paul Bartlett*
    9637 Slots 3:30pm-4:30pm: CANCELLED
    • 5 Dec - Brainstorming: (Sanjay Ghanathey, Jenna Le, Tanvi Kumar), *Kun Xie*, *Nasim Samei*, *Jacob Hunte*, *Rifayat Samee*
  • 7 Dec - Brainstorming: *Nima khairdoodt*, *Sana Ahmadi*, *Mohsen shirpour and Mohammad Alavi*
    9637 Slots 3:30pm-4:30pm: *Hengyu Yue*, *Zhongwen Zhang*, *Yifang Liu*, *Andrew Bloch-Hansen*
  • Project Document Due Friday 8 December 5pm
  • Reviews (graduate students only) Due Thursday 15 December 5pm