CS 9863 – Empirical Research Methods
Course
Outl
Venue & T
|
Name |
Off |
Off |
|
Prof. Naz |
MC 381 or outs |
Catch me when
you can! |
|
NEW or RECENT |
Date |
Description |
|
☛ |
4-Jan-12 |
Click
here for the course material. (Restricted
access) |
|
|
|
|
|
|
|
|
|
|
|
|
This is a course
on “empirical research methods”. While
creativity is central to advancing scientific knowledge, conducting research
requires the use of rigorous qualitative and quantitative methods. Empirical research is a way of gaining knowledge by means of
direct and indirect observation or experience. Empirical evidence (the record
of one's observations or experiences) can be analyzed quantitatively or
qualitatively. Through quantifying the evidence or making sense of it in
qualitative form, a researcher can answer empirical questions, which should be
clearly defined and answerable with the evidence collected (usually called
data). Research design can vary by field of investigation and by the question
being investigated. Many researchers combine qualitative and quantitative forms
of analysis (also often called “mixed methods”) to better answer questions.
In some fields, quantitative research may begin with a research question
(e.g., “Is there a bias in the characteristics of the elicited requirements if
the analysts have no access to the technical details of the “existing” system’s
architecture?”) which is answered through the empirical study. Usually, a
researcher has a certain “theory” (rooted in existing literature or
experiences) regarding the topic under investigation. Based on this theory, hypotheses
are proposed (e.g., “The characteristics of the requirements elicited in the
absence of access to the existing system’s architecture will be user-centric."). Such a
hypothesis can then be tested with a suitable experiment – and either supported
or refuted. From the outcome of the investigation, predictions can then be
derived (e.g., “The characteristics of the requirements elicited in the absence
of access to the existing system’s architecture
will be more user-centric; whereas, those elicited with full access to
the existing system’s architecture may
be characterised by the system’s technical needs ."). Such predictions can
then be used to make decisions in actual work processes in industry, social
decision-making, manufacturing, medicine, etc. Note, however, that while one
such empirical investigation leads to some insight into the research question,
it is, after all, only one investigation. Thus, replicated studies may lead to
stronger evidence.
This course has its roots in the
field of Software Engineering (SE). However, we shall also touch base on
research methods in Computer Science (CS) and Information Technology (IT). Non-SE
students will have opportunity to apply the concepts of empirical research in
their own field of interest.
Example topics covered include:
· An integrated model of research for SE, CS
and IT
· Experiments
· Hypothesis
· Case studies
· Surveys
· Simulation
· Data gathering
· Research question
In addition to covering the topics listed above, we shall also discuss
topics such as: field differences between SE, CS and IT; key issues in thesis
research (e.g., background understanding, defining a research problem, research
design, effort estimation and (re-)planning, writing a proposal or thesis,
defending the thesis, research ethics, publishing, and lessons learnt.); and conducting
research involving industry;
The learning
outcomes of this course are that students should be able to:
1. put their
research into appropriate contexts.
2. conduct
research using rigorous methods.
3. exhibit
knowledge about research involving industry.
4. exhibit
knowledge about software tools involved in conducting research.
Students w
· Registered graduate student.
· IMPORTANT: The students are expected: to be self
motivated and to be a team player; to have good skills in various programming
languages; to have developed sizeable software systems; and to have some
knowledge of open source software projects, software tools, metrics, web
technologies, etc. (or be willing to learn about this).
· There is no particular text book for the
course. However, I have made a starter list of books, papers and websites of
interest. Students are expected to use library and other resources to learn
about quantitative and qualitative research.
· Lecture notes will be given as appropriate.
(1) Student evaluat
(2) The instructor reserves the r
(3) In the team project, a group member’s marks
(4) The grad
(5) Late subm
(6) If for any reason any evaluat
|
Component |
We |
Conf |
Dates (approx.) |
|
Literature
analysis on research methods, and presentation. |
30% |
Individual |
As per class
schedule |
|
Subject matter (domain)
literature analysis and Research gap identification |
30% |
Individual work |
Till term-end |
|
Project: empirical investigation |
40% |
Team work |
Till term-end |
|
Enrichment
Study (open topic) -- Bonus* |
20% |
Ind Team work (max.
2) |
Till term-end |
* Enrichment study is Optional (bonus of 20%). Yes, you can
“shoot” for 120% though the university will only record up to a maximum of
100%. More importantly, you will learn a great deal through an enrichment study
AND it will give the professor an insight into your capabilities, which will no
doubt he extremely invaluable when it comes to writing a letter of reference of
some significance. I highly recommend it!
We will occasionally need to send email messages to the whole class, or to students individually. Email will be sent to the UWO email address assigned to students by Information Technology Services (ITS), i.e. your email address @uwo.ca or to your Computer Science Departmental email address. It is each student’s responsibility to read this email on a frequent and regular basis, or to have it forwarded to an alternative email address if preferred. See the ITS website for directions on forwarding email.
However, note that email at ITS (your UWO account) and other email providers such as hotmail.com or yahoo.com establish quotas or limits on the amount of space available to you. If you let your email accumulate there, your mailbox may fill up and you may lose important email from your instructors. Losing email is not an acceptable excuse for not knowing about the information that was sent.
· for work representing 10% or more of the overall grade
in the course:
If you are unable
to meet a course requirement due to illness or other serious circumstances, you
must provide valid medical or other supporting documentation to your Dean's
office as soon as possible and contact your instructor immediately. It is
the student's responsibility to make alternative arrangements with their
instructor once the accommodation has been approved and the instructor has been
informed. In the event of a missed final exam, a "Recommendation of
Special Examination" form must be obtained from the Dean's Office
immediately. For further information please see: http://www.uwo.ca/univsec/handbook/appeals/medical.pdf
A student requiring academic accommodation due to illness should use the
Student Medical Certificate when visiting an off-campus medical facility or
request a Record's Release Form (located in the Dean's Office) for visits to
Student Health Services. The form can be found here: https://studentservices.uwo.ca/secure/medical_document.pdf
Please contact the course instructor if you require material in an alternate format or if you require any other arrangements to make this course more accessible to you. You may also wish to contact Services for Students with Disabilities (SSD) at 661-2111 x 82147 for any specific question regarding an accommodation.
Scholastic offences are taken seriously and
students are directed to read the appropriate policy, specifically, the
definition of what constitutes a Scholastic Offence, at the following Web site:
http://www.uwo.ca/univsec/handbook/appeals/scholoff.pdf.
For
The standard departmental
penalty for assignments that are judged to be the result of academic dishonesty
is, for the student's first offence, a mark of zero for the assignment, with an
additional penalty equal to the weight of the assignment also being applied.
You are responsible for reading and respecting the Computer Science
Department's policy on Scholastic Offences and Rules
of Ethical Conduct .
The
Back
to the top of the document.