class: left, bottom, title-slide # Module 4: Creating a Plan ## EME6357: Evaluation of Instruction & Training in HPT ### Dr. Bret Staudt Willet ### November 10, 2021 --- class: inverse, center, middle #
**View the slides:** [bretsw.github.io/eme6357-module4](https://bretsw.github.io/eme6357-module4) --- class: inverse, center, middle #
<br> Evaluation Plan <br> Part 4 --- # Evaluation Management Plan <img src="img/plan.jpg" width="720px" style="display: block; margin: auto;" /> -- - Creating a guide for developing methodology and data collection --- #
Rubric <img src="img/system.jpg" width="480px" style="display: block; margin: auto;" /> - Format, Grammar, and Style (10 points) - Introduction (15 points) - Evaluation Management Plan (25 points) - Justification of Evaluation Questions (40 points) - Evaluation Design Measures and Instruments (70 points) - Evaluation Communication Plan (25 points) - Conclusion (15 points) - Group Participation and Contribution (100 points) --- # Management Plan Table <img src="img/4-management-plan.png" width="100%" style="display: block; margin: auto;" /> --- # Communication Plan <img src="img/4-communication-plan.png" width="100%" style="display: block; margin: auto;" /> --- # Group Contribution ### Score your fellow group members and yourself [Qualtrics Survey](https://fsu.qualtrics.com/jfe/form/SV_3pI5Umch9ZOYC8K) <img src="img/4-peer-grading.png" width="100%" style="display: block; margin: auto;" /> --- class: inverse, center, middle #
<br> Module 4 readings --- # Chelimsky (2008) <img src="img/tension.jpg" width="480px" style="display: block; margin: auto;" /> ### Tensions -- "Clashes" between: -- - Evaluative Independence -- - Political Requirements --- # Chelimsky (2008) <img src="img/self-directed.jpg" width="480px" style="display: block; margin: auto;" /> ### Suggestions -- 1. Expand the Design Phase -- 2. Include Public Groups in Evaluations, When Relevant -- 3. Lean Heavily on Negotiation --
**Key idea:** Work with your stakeholders --- # Hurteau et al. (2009) <img src="img/measure.jpg" width="480px" style="display: block; margin: auto;" /> ### Credibility of evaluation --
**Key idea:** Purpose of evaluation is to make **judgments** -- These judgments must be: -- - Legitimate -- - Justified --- # Hurteau et al. (2009) <img src="img/measure.jpg" width="480px" style="display: block; margin: auto;" /> ### Legitimate Judgment -- - the judgment refers to the evaluation questions/goals -- - the judgment is supported by criteria -- - the judgment is supported by a standard --- # Hurteau et al. (2009) <img src="img/Hurteau-et-al-fig2.png" width="100%" style="display: block; margin: auto;" /> ### Justified Judgment -- - justification of the criteria (i.e. warrants, backings) -- - justification of the standards (i.e. qualifiers) -- - documentation of the procedure used to synthesize the information into a judgment --- # Picciotto (2011) <img src="img/survey.jpg" width="420px" style="display: block; margin: auto;" /> ### Is evaluation a profession? -- - Prestige and status -- - Ethical dispositions -- - Expertise -- - Autonomy -- - Credentials --- class: inverse, center, middle #
<br> Looking Beyond the Course --- # Melissa's Reflections <img src="img/future-research.jpg" width="600px" style="display: block; margin: auto;" /> - Evaluation Principles - Evaluation Models - Case Studies --- class: inverse, center, middle # Your Reflections <div class="padlet-embed" style="border:1px solid rgba(0,0,0,0.1);border-radius:2px;box-sizing:border-box;overflow:hidden;position:relative;width:100%;background:#F4F4F4"><p style="padding:0;margin:0"><iframe src="https://fsu.padlet.org/embed/51jrfivtib4k6cvw" frameborder="0" allow="camera;microphone;geolocation" style="width:100%;height:480px;display:block;padding:0;margin:0"></iframe></p><div style="padding:8px;text-align:right;margin:0;"><a href="https://padlet.com?ref=embed" style="padding:0;margin:0;border:none;display:block;line-height:1;height:16px" target="_blank"><img src="https://padlet.net/embeds/made_with_padlet.png" width="86" height="16" style="padding:0;margin:0;background:none;border:none;display:inline;box-shadow:none" alt="Made with Padlet"></a></div></div> --- class: inverse, center, middle # Questions? <img src="img/question.jpg" width="480px" style="display: block; margin: auto;" /> **What questions can I answer for you now?** **How can I support you this week?** <hr>
[bret.staudtwillet@fsu.edu](mailto:bret.staudtwillet@fsu.edu) |
[@bretsw](https://twitter.com/bretsw) |
[bretsw.com](http://bretsw.com)