EdTech 503: Module 7 Evaluation

Karrie Cox
EdTech 503 Topic 8 Discussion Board

ID Project Description:

After four forty-five minute lessons middle school students will be able successfully apply the scientific method through a ghost hunting WebQuest.

Part 5b Formative and/or Summative Assessment materials

Formative Assessment

Formative assessment will be utilized throughout the instruction in the form of asking questions and gathering information.  The instructor will visit and provide feedback throughout each lesson.  Also, the project is designed to build upon previous objectives; therefore, formative evaluation will be a part of each part of the lesson.  In addition, both formative and summative assessment will take place as learners are going back and forth between teacher and WebQuest view.

Summative Assessment

Summative assessment will take place using the concluding activity and it will be conducted by the learners. The rubric in Appendix D is what each learner will use to evaluate their assignments. In addition, learners will have the opportunity to ask questions during each lesson progresses, which is, in itself a form of summative assessment.

Formative and summative assessments

The measure of success will be whether or not students can write up a report of their research experiment and draw a conclusion.

  • Scientific Methods Evaluation Criteria (worksheet)

This is a reference for student to use when evaluating each ghost hunting website resource.

  • Website Content Evaluation Criteria (worksheet)

This worksheet is for student to use when evaluating each website.

  • Grading Rubric

The rubric is useful to assess complex student work, such as papers, essays, or presentations that can’t be evaluated with complete objectivity.  The rubric will be used for evaluating student’s final project report, website evaluation, ghost hunting website evaluation, MLA citations.  These assessments involve various levels from Bloom’s taxonomy to assess how well students met the learning objectives.

Part 6 Formative Evaluation Plan

Part 6a Expert Review

The SME will be Mrs. Sally Clarke, a teacher at Modoc Middle School.  Mrs. Clarke has 23 years of teaching experience and has taught science class for the last 20 years. She will be able to offer an objective opinion regarding the design and its utility with all students. It is anticipated that materials will be submitted to Mrs. Clarke by November 15, 2012 and that feedback will be received by December 01, 2012.  Mrs. Clarke’s contact sclark@modoc.k12.ca.us .  Sally will review the training materials, objectives, and instructional design plan and submit answers to an electronic survey (see Part 7 for a list of these questions) based on the instructional design plan.  Click here for survey

Part 6b One to One Evaluation

The purpose of this evaluation is to try out the instructional materials on a smaller scale.  There will be four members of the target audience used for this evaluation.  This group will be able to review the lesson and materials to see if there are any glitches that need to be fixed.  This also provides the opportunity to fix typos, link problems or any other issues that may be unclear to the target audience.  After participating in Ghost Hunting WebQuest, some questions that will be asked are:

  • Do you understand the concepts explained in the WebQuest?
  • Did you like how the information is presented?
  • Is there a logical flow?
  • Are the graphics appealing?
  • Did the worksheets help in the ghost hunting website review?
  • What was your level of confidence completing the WebQuest?
  • Were there any confusing parts?

Part 6c Small Group Evaluation

The errors from the one to one evaluation review will be fixed before this evaluation is given. This evaluation will be given to a larger mixed group of students within the middle school.  This step will see how the WebQuest performs since the last evaluation. This evaluation will be

gathered and analyzed to determine the degree of success experienced in real classrooms. Some of the questions at this point to ask are:

  • How confident are you working through the tasks of the WebQuest?
  • Did you find the information useful?
  • Were you able to understand all the steps of scientific inquiry?
  • What do you think could be improved about the instruction? Please explain.

Part 6d Field Trial

This stage takes into account the revisions made from the one-on-one and small group evaluations.  It determines the effectiveness of the revisions and looks at any problems that might arise in a real instructional setting.  It also uses a large enough group to take a mock class trial.  This field trial will include all middle school students, the science teacher at the middle school in one school district.  Afterwards, we will sit and discuss what worked and what did not work addressing all of the questions asked of our expert reviewer as to the appropriateness of the objectives, learning strategy, supplementary materials, handouts, and training environment.  At the conclusion of the lesson, the teacher and students will be asked some questions such as:

  • Did the lesson present information in a way you could understand?
  • Do you feel you had enough entry-level skills to accomplish what was expected of you?
  • Did you have enough time to complete the tasks?
  • Did you enjoy the lesson?  Please explain.
  • Do you feel the things you learned have real-life application?  Please explain.
  • For the teacher: How do you feel about the instructional materials? Was the lesson easy enough to implement as designed or are revisions necessary?  Please explain.

Part 7 Formative Evaluation Report

Part 7a Evaluation Survey or Rubric

The evaluation survey that will be sent to the Expert Reviewer, Sally Clark, is located here.

Learning   Materials:
Do you feel the learning materials are up to date? Yes
Are the learning materials appealing? Yes
Do you feel the learning materials are   sufficient and appropriate for the instructional goals? Yes
Goals and   Objectives:
Are the goals   and objectives accurate? Yes
Do any of the goals need to be changed? No
Are the goals correctly labeled w/Blooms taxonomy and the   learning types? Yes
Are the goals achievable with the amount of time and   learning materials given? Yes
Instructional Strategies
Do you feel that the lesson is supplantive enough in   nature to allow time to learn the goals in the allotted time? Yes

Part 7b Report the results of the expert review

Results are listed above in 7a.

Part 7c Comments on Change

Positive feedback: The overall results are positive.  She did note that Google Applications should be the only choice to use in their final report.

Suggestions for improvement: There could be more resources available for students to choose, or add the choice of finding their own ghost hunting resource.

This entry was posted in 1.1 Instructional Systems Design (ISD), 1.3 Instructional Strategies, 5.3 Formative and Summative Evaluation, AECT Standards, Courses, EdTech 503, Standard 5: Evaluation and tagged , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s