EDIT 6900E - Research Methods in Instructional Technology

"Statistics in Education for Mere Mortals"

Summer, 2015

Lloyd Rieber, Instructor
lrieber@uga.edu
203 River's Crossing
706-542-3986

Quick Links: Course Procedures | Course Requirements

(Last updated on May 12, 2015 .)


Course Description

This course introduces you to the fundamentals of statistics. It is designed primarily for educational professionals, particularly instructional designers and developers. The course is also useful to anyone wanting a brief introduction to statistics, such as first-year education doctoral students about to take statistics as part of their graduate work. It is also a good refresher for education professionals who studied statistics in the past. The emphasis in this course is learning statistics by computing statistics. The cornerstone activity in this course is building Excel spreadsheets as a way to understand what all the various statistics mean and how they are derived. It is important that you go through the course in sequential order because the spreadsheets you build at the start of the course will slowly grow and become more complex.

The reason this course is for "mere mortals" is because it's designed for people who aren't, and don't want to be, statisticians or mathematicians. Instead, it's designed for ordinary people with ordinary math skills who want to get to the point of it all.  And, it's OK to have a little fun along the way too.

Things You Need to Already Know or Have

  • Mathematics: You need to know basic arithmetic
  • Microsoft Excel: You need to have access to either the Macintosh or Windows version and you need to already be able to do the following:
    • Enter data (and know the difference between text and numeric data)
    • Enter basic formulas and functions
    • How to fill formulas and functions across cells
  • Time and motivation!

This is an online class. A variety of synchronous (in real time) and asynchronous technologies (not in real time; e.g. email) will be used to teach this class. Of these, two deserve special notice: 1) Horizon Wimba - a virtual classroom which permits synchronous sessions and interactions between the instructor and students with 2-way Internet audio; and 2) Pre-recorded presentations of course content. (Click here for more information about the Horizon Wimba classroom.)

All academic work must meet the standards contained in "A Culture of Honesty." Students are responsible for informing themselves about those standards before performing any academic work. The link to more detailed information about academic honesty can be found at: http://www.uga.edu/honesty/ahpd/culture_honesty.htm

Please note that this course syllabus is a general plan for the course; deviations announced to the class by the instructor may be necessary.

Accommodations

This course follows the regulations outlined in the Americans with Disabilities Act. Call UGA Disability Services at (706) 542-8719 (voice) or (706) 542-8778 (TDD only) for information about architectural access and to arrange for sign language interpreters, assistive listening devices, large print, audio, or Braille. Students requiring special accommodation should contact the instructor as soon as possible.



Required reading

Leedy, P. D., & Ormrod, J. E. (2012). Practical research: Planning and design (10th ed.). Upper Saddle River, NJ: Pearson Education.
(Note: Also acceptable is the 9th edition published in 2009.)

Additional readings will also be assigned during the semester to supplement the text.


Course Goal

Participants in the course will become intelligent consumers and proficient users of educational research. Participants will investigate a variety of educational research studies using various methods (quantitative, qualitative, mixed methods), with the objective of being able to analyze and apply research in everyday contexts.

Course Objectives

At the end of the course, each participant will be able to:

  • Review and critique the existing research literature;
  • Demonstrate the information literacy and technology skills necessary to locate, gather, and synthesize information relevant to an original research project; and
  • Apply the research findings from the literature to an educational problem as demonstrated in the creation of a proposal for a development project with a purpose and design informed by the research literature, or a proposal to conduct original research.

Note: The course goal, objectives, and requirements have been designed to be relevant for professionals working in instructional technology, including K-12 schools, business and industry, and higher education contexts. For this reason, this course is practitioner-oriented. However, participants who are thinking about applying to a Ph.D. degree program may have other goals and objectives, such as learning how to prepare a complete and formal research proposal and even to conduct original research. For these individuals, it may be more relevant to discuss with the instructor an alternative course project in which an actual (though small scale) research study is proposed, designed, and perhaps even implemented and reported. Ph.D. applications typically ask for writing samples and this course provides good opportunities to develop a research manuscript as part of a portfolio submitted with a Ph.D. application.


Course Procedures

There are both synchronous and asynchronous aspects to this course. The primary course content is delivered asynchronously in two ways - textbook readings and pre-recorded presentations. One of the most important tools to access these resources is a special web site that has been created for you containing a Learning Plan for the course. This learning plan lists all course activities, along with due dates, in the general order in which they should be completed. A user account has been created for you. Your username is the same as your UGA MyID, but your password is the last 4 digits of your UGA Card Number (not your social security number). Think of your learning plan as your "headquarters" for completing the course.

We will meet at our assigned time online in a "virtual" live classroom (described more below). Prior to each live class each participant needs to:

  1. Read the assigned chapter/s in the Leedy & Ormrod textbook and any other assigned readings, and then...
  2. View a pre-recorded presentation of the assigned chapter/s.
  3. Read, view, or listen to any other assigned class resource (e.g. other readings, podcasts, etc.)

These pre-recorded presentations are designed and narrated by Lloyd Rieber and Greg Clinton. The average length of the pre-recorded presentations is about 45 minutes. These presentations are Flash-based and will work on both Windows and Macintosh computers. All of these chapter presentations can be found on the course learning plan. These required "readings, viewings, and listenings " need to be completed with care prior to the respective scheduled class - again, they are your main means for acquiring the course content.

For each class meeting, all participants will then meet online in the Horizon Wimba Virtual Classroom at our assigned time. Reading the assigned chapters, articles, etc., and viewing the pre-recorded presentations are crucial to having a successful experience in each scheduled synchronous class meeting. The instructor will prepare a special interactive session based on the assumption that all participants are fully prepared. If you do not "read and view" the material ahead of time, you will likely be confused and disoriented.

Each class is scheduled from 4:40-7:40 pm, however, for simplicity we will begin each class promptly at 5:00 pm, so please log onto the UGA Horizon Wimba server about 15 minutes prior to this time to ensure you are all ready to go. Each class will begin with brief class updates and time for questions and answers. The instructor will then conduct an interactive session on the topic scheduled for that day. The purpose of the interactive session is to explore general themes and difficult concepts of the weekly topic. Again, it is VERY important that all participants come to class having read the respective book chapter/s thoroughly (and any other assigned readings) AND having viewed the pre-recorded presentation/s.

An advantage of using the pre-recorded presentations is that a significant part of the scheduled class time will be yours to organize and use as you wish. During the first half of the course, this remaining class time is an excellent time to work on Research Design Activities (RDAs), provide feedback to your design buddy's RDA, or, if you are doing the course project with a partner, to meet with your partner to discuss or work on the course project. During the second half of the course, this time should be used to work on the required research project.

You should discipline yourself to work at least until 7:40 pm each class, even though the formal part of the class will almost always end much earlier.

Student Support for Horizon Wimba

UGA provides special support to students enrolled in classes that use the Horizon Wimba classroom. Students may get assistance by e-mailing hlive@uga.edu or calling Student Technology Support (STS) at 706-542-3333. The STS help desk is open from 9am-10pm Monday through Thursday, 9am-5pm Friday, and 1-7pm Saturday and Sunday.


Course requirements/evaluation

Element

Percent of Final Grade

Due

Research Design Activities (RDAs)

30%

throughout course

Buddy Feedback on Research Design Activities (RDAs)

5%

throughout course

Informal Activity - SDC - Systematic Data Collection
10%
11-April
Research Methods Knowledge Test
10%
11-April

Research Design Project (individual or in pairs)

40%

Pre-Recorded Presentation due 18-April;
2-page exec. summary due 25-April

Peer Critique of Research Design Project Presentations

5%

24-April (day before last class)

An evaluation rubric is provided for your reference, so you will know how you will be evaluated in this course.


Grading Scale

A 95-100%
A- 91-94%
B+ 87-90%
B 84-86%
B- 81-83%
C+ 77-80%
C 74-76%
C- 71-73%
D 61-70%
F Below 61%

 


Attendance/Participation (individual): Everyone is expected to attend each online class and be punctual (I will keep a record of attendance). A variety of in-class activities are planned. Many of these activities are group-based, so come prepared to interact. We will use many different online technologies to accomplish this, including the group discussion tools in eLC and Horizon Wimba. In many settings, educational research is a team effort. This requires an understanding of group dynamics and interpersonal communication. Finally, realize that if you are absent, even for valid reasons, you are still responsible for the material and assignments discussed in each and every class (the plan is to record each live class).

Informal Activity - SDC - Systematic Data Collection (individual): Purpose: To experience first-hand what it feels like to do collect data systematically on a topic of the participant's choice; To reflect on the role and value of research data to inform one's thinking or decision-making in practice.

As the name suggests, this is meant as an informal, fun assignment to gain some experience of what it feels like to actually do research on a topic of personal interest to you. Your task is to identify a subject or topic on which you have genuine curiosity and then collect data systematically on it. All you have to submit to get credit for this assignment is a brief written report (about 200 words) in which you describe the topic you chose, how you went about collecting data systematically, what you found, and a reflection of what you learned doing this activity. (If you choose to collect data on yourself, a family member, or any other person, be careful not to disclose any personal information in your reflection given that this reflection will be posted on the Internet.) You will give a brief 5 minute oral report about your experience during class.

We will brainstorm possible topics during class, but here are just a few to get you thinking:

  • Personal Finance: Keep track of every penny spent for a month;
  • Health: Begin an exercise program and chart your progress (Note: You should consult a physician before beginning any exercise program);
  • Health: Keep track of everything you consume for a week; monitoring your blood pressure;
  • Gardening: Plant some flowers from seed and chart their progress as they grow;
  • Nature: Take detailed observations on the birds visiting your home;
  • Nature: Chart the times of the rising and setting of the sun, or the shadow cast by the sun at a certain time of day, and look for relationships to the weather, birds, flowers, your moods, or the behaviors of family members or pets.
  • Pets: Begin a training program and chart your pet's progress:
  • Sport: Record data on a sporting event, either one you enjoy to watch or one you participate in regularly.

Research Methods Knowledge Test (individual): Purpose: To assess each participant's acquisition and understanding of core research methods facts and concepts.

All participants must master a core set of research methods knowledge gained predominately through reading the required textbook chapters, but also through viewing required pre-recorded presentations. Mastery is defined as attaining a score of 100% correct on a test of 75 multiple-choice questions (subdivided into four sections). No partial credit will be given. However, you may take each section of the test as often as you wish up to the date listed above. The best way to prepare for this test is by reading the textbook chapters well.

(Every question must be answered correctly during any one attempt on any of the four sections. If one or more questions are answered incorrectly on an attempt, that entire attempt for that section is discounted.)

Research Design Activities (individual): Purpose: To give each participant the opportunity to individually learn and implement the particular research design skill being introduced and discussed at that time; each RDA is focused on helping everyone understand equally the particular skill and process highlighted in the RDA.

RDAs are designed to enhance, extend, and support course content. These are completed individually and are meant to give you some initial practice in each of the major themes of the course. Feedback will be provided first by Design Buddies (selected no later than the second session of the class), then the instructor. You can revise these based on your buddy's feedback, at which time the instructor will evaluate them. These activities are meant to be "low stress," so if you find yourself sweating over them, you are missing the point. The purpose of each RDA is to give you some quick, initial practice applying the respective design skill. If you do not complete a specific RDA appropriately, you will have one opportunity to resubmit based on the instructor feedback.

Though you are under no obligation to do so, it is perfectly acceptable to refine any or all of the RDAs to make them part of the Research Project due at the end of the course. It is therefore wise to identify your project topic early on in order for you, or your team, to use the RDAs as the first step in your project.

A special RDA online workspace has been created exclusively for this class and can be accessed from the course learning plan. When you have finished your first draft of an RDA, your buddy will be notified via email and an automated notice appearing on his/her course learning plan that you are ready for feedback. Everyone is expected to review their buddy's RDA and provide feedback by the due dates listed on the course learning plan. You then have the option of revising your RDA based on your buddy's feedback. The instructor will then review every RDA (and the respective buddy feedback) and provide feedback. All RDA work and feedback will be generated, stored, and viewed online. All RDAs will be shared with the entire class (though names will be removed).

A total of three RDAs are planned based on the following topics:

  • Identifying a research problem and writing a researchable question (or problem statement);
  • Writing a literature critique;
  • Conducting a review of the literature.

Research Design Project (individual or in pairs): Purpose: To apply research to study, solve, or improve an educational problem.

Individually, or in teams consisting of no more than two people, you will complete a Research Project in which you apply research. We will use a real-world analogy for the preparation of this project, that of persuading some administrative, governing, or funding group to take action in the form of approving (and perhaps funding) your project idea. Using that analogy, imagine that a short, allotted time has been given to you to address this group. Your project will consist of two elements:

  • A 2-page executive summary (1 inch margins, 12-point font, single-spaced within paragraphs, double-spaced between paragraphs;
  • Presentation lasting absolutely no longer than 10 minutes.

Both elements need to describe or address the following: 1) Problem area or topic; 2) Review of the related literature; 3) Design of an approach you are taking to study, solve, or improve an educational problem.

The approach you are taking to solve or improve the problem can take one of two forms: An original research study proposal to collect new data on the topic; or a development project proposal to build or produce something on the topic with a design based on existing research.

Your presentation must be pre-recorded and made available to all participants in the course no later than April 18, 2012. (Tools and strategies for accomplishing this will be discussed in class.) The 2-page executive summary is due April 25, 2012.

Peer Critique of Research Design Project Presentations: Purpose: To watch and provide a brief critique of a subset of the presentations made by your classmates.

One of the time-tested benefits of this course is that participants tend to address very important and timely research topics in their final projects, resulting in an opportunity for the rest of us to learn a great deal. The requirements that all presentations be short and pre-recorded allow us to use our time flexibly and strategically to enjoy this benefit. Rather than be required to listen to every project presentation, each participant will instead be required to watch a subset that best matches their interests.

All participants must choose to watch at least 5 presentations of other classmates' research design projects and write and submit a brief critique of each (approximately 100 words for each critique) addressing the following points: 1) 1-sentence summary of the topic; 2) importance of the topic; 3) strengths and weaknesses of the project; and 4) persuasiveness of the presentation.

Details on how and where to submit these critiques will be announced and explained in class. All peer critiques are due no later than April 24, 2012 (the day before our last class).


Course Schedule
This general schedule is subject to change throughout the semester - the Web page containing the course learning plan will reflect any changes or updates.

Date
Topic   Readings & Pre-Recorded Presentations (read & view prior to class)  
11-January

Course Introduction; Demonstration of Online Technologies

UGA Gwinnett Campus (Room 118)

     
18-January

Course Introduction (con't); Overview of online technologies
What is Research?

 

Introduction, Chapter 1
Also read the syllabus well prior to class

 
25-January
Tools of Research

  Chapter 2  
1-February
Identifying the Research Problem

  Chapter 3
Published Research Article (distributed by instructor)
 
8-February
Conducting a Review of the Literature
  Chapter 4  
15-February

Face-to-Face Workshop on How to Conduct a Library Search (Benjamin Hall, UGA Gwinnett Librarian)

UGA Gwinnett Campus (Room 118)

     
22-February
Planning Your Research Project
  Chapter 5
Published Research Article (distributed by instructor)
 
29-February
Writing A Research Proposal
  Chapter 6  
7-March

Qualitative Methodologies: Qualitative Research & Historical Research

  Chapters 7-8
Merriam chapter; Creswell chapter
 
14-March
SPRING BREAK - NO CLASS
     
21-March

Quantitative Methodologies: Descriptive Research


 
Chapter 9
Published Research Article
(distributed by instructor)
 
28-March

Quantitative Methodologies: Experimental & Ex Post Facto Designs; Statistical Techniques for Analyzing Quantitative Data


 
Chapters 10-11
 
4-April

Quantitative Methodologies (con't)


 
Published Research Article (distributed by instructor)
 
11-April

Preparing a Research Report
Individual reports of informal activity on systematic data collection
(AERA Conference, Vancouver, April 12-17, 2012)


 
Chapter 12
 
18-April

Project work; Pre-Recorded Presentations due by end of day


     
24-April
Peer critiques of project presentations due      
25-April
Course debrief; discussion of peer critiques; 2-page executive summary of Research Design Project due      

 


Closing comments and cautions

This course, due to its strong application orientation, is highly activity-based. In completing the research design project, it is important that individuals or pairs identify their problem area early and pace their work appropriately. The research design project consists of many phases which build upon each other. Individuals or pairs who wait until late in the course to begin may experience "log jams" and may find it difficult to complete the project with high quality, thus risking a lower grade and, more importantly, less professional gain. Often, participants enter a course thinking that they can always take an "incomplete" if they decide they will not complete the course requirements on time. Keep in mind that I follow the university guidelines regarding an incomplete grade which reserve this for unforeseen circumstances or emergencies, not merely a failure to complete the work on time. I am confident that those who heed this warning will be able to complete the course with sufficient time to produce a high quality product while gaining personal and professional satisfaction.


Acknowledgements

This syllabus and the design of the course is adapted from courses taught by Dr. Janette Hill and Dr. Mary Ann Fitzgerald. I thank them very much for graciously offering their materials and expertise in the development of this course. I also acknowledge the efforts of Dr. Thomas Reeves -- his teaching of this course greatly informed the design and structure used by Dr. Hill and Dr. Fitzgerald. Finally, thanks also go to Dr. Michael Orey for sharing his ideas and experiences related to teaching this course.