RUBRICS. 18 October 2018 Monthly Workshop Series

Transcription

1 RUBRICS 18 October 2018 Monthly Workshop Series

2 PRESENTER INFORMATION GALEN DAVIS Director of Faculty Development Learning House

3 LEARNING OBJECTIVES By the end of this session, you should be able to: Distinguish between different types of rubrics. Articulate the benefits of using rubrics. List the criteria of effective feedback. Describe a 4-step process for creating analytical rubrics.

4 AGENDA 1. Rubric Basics 2. Feedback & Practice 3. Building a Rubric

5 1. RUBRIC BASICS

6 KINDS OF RUBRICS HOLISTIC RUBRIC ANALYTICAL RUBRIC SCORING GUIDE

7 WHY USE RUBRICS? They help make feedback timely. They familiarize students with the highest level of achievement. They encourage critical thinking. They facilitate communication with others. They help refine teaching skills.

8 2. FEEDBACK & PRACTICE

9 ENGAGEMENT Student - Content Student - Student Student - Instructor

10 PROVIDE EFFECTIVE FEEDBACK Effective feedback is: Descriptive Constructive Actionable Timely Prioritized Personalized

11 WHAT IS PRACTICE? Practice is repeated action to acquire or refine a skill.

12 PRACTICE AND FEEDBACK Practice without feedback Feedback without practice

13 QUALITIES OF EFFECTIVE PRACTICE Deliberate Focused Appropriately challenging Frequent

14 FEEDBACK, PRACTICE, AND RUBRICS Feedback is essential for students to improve their skills. Students need opportunities to practice their skills based on your feedback. Rubrics lay the rhetorical groundwork for effective feedback and help identify specific skills in need of practice.

15 3. BUILDING A RUBRIC

16 RUBRIC CONSTRUCTION 1. Reflecting 2. Listing 3. Grouping and labeling 4. Applying

17 STAGE 1: REFLECTING Questions to consider: What s the learning objective? What skills are they developing? What is excellence? How can they demonstrate achievement? Are the materials adequate? Is it related to future assignments? Past?

18 STAGE 2: LISTING Questions to consider: What are the requirements? What objective does it address? What skills are essential? What components must be included? Assignment: In 7-10 pages, present a formal proposal for a video game that you think will be successful in today s market, based on recent successful games. Explain your reasons for its proposed success, and include a marketing strategy. Cite evidence for your claims. Assignment Goal(s): Develop an original video game design proposal. Identify the economic principles involved in successful video games. Articulate a viable and effective marketing strategy.

19 Assignment: In 7-10 pages, present a formal proposal for a video game that you think be successful in today s market, based on recent successful games. Explain your reasons for its proposed success, and include a marketing strategy. Cite evidence for your claims. Assignment Goal(s): Develop an original video game design proposal. Identify the economic principles involved in successful video games. Articulate a viable and effective marketing strategy. Articulates an original, creative video game idea. Identifies game genre. Describes narrative structure (if applicable). Describes key gameplay features. Articulates target platform (console, mobile, etc.). Provides a technical analysis (game engine used, etc.). Leverages the characteristics of at least 2 recent successful video games as evidence. Demonstrates an understanding of the difference between video game design and publication. Contains research that is cited appropriately. Develops an original, creative marketing strategy. Identifies a target market. Contains relevant market research. Identifies positioning of video game in the market. Discusses competitive analysis, including top performers in the genre. Estimates resources required (or a full budget). Identifies risks.

20 STAGE 3: GROUPING & LABELING Articulates an original, creative video game idea. Identifies game genre. Describes narrative structure (if applicable). Describes key gameplay features. Articulates target platform (console, mobile, etc.). Provides a technical analysis (game engine used, etc.). Leverages the characteristics of at least 2 recent successful video games as evidence. Demonstrates an understanding of the difference between video game design and publication. Contains research that is cited appropriately. Develops an original, creative marketing strategy. Identifies a target market. Contains relevant market research. Identifies positioning of video game in the market. Discusses competitive analysis, including top performers in the genre. Estimates resources required (or a full budget). Identifies risks. Categories Highest Level of Achievement Originality Articulates an original, creative video game idea. Develops an original, creative marketing strategy. Game design proposal Marketing strategy Identifies game genre. Describes narrative structure (if applicable). Describes key gameplay features. Articulates target platform (console, mobile, etc.). Identifies a target market. Contains relevant market research. Identifies positioning of video game in the market. Discusses competitive analysis, including top performers in the genre. Estimates resources required (or a full budget). Identifies risks. Research Leverages the characteristics of at least 2 recent successful video games as evidence. Demonstrates an understanding of the difference between video game design and publication. Contains research that is cited appropriately.

21 CRITERIA CRITERIA Categories Your rubric criteria should be: Measurable Essential Distinct Unambiguous Originality Game design proposal Marketing strategy Research

22 STAGE 4: APPLYING Needs work (1) Adequate (2) Excellent (3) Originality The game s narrative and gameplay rely on what exists in current titles. The marketing strategy has done before. Some elements of either strategy are borrowed, but has creative elements. Articulates an original, creative video game idea. Develops an original, creative marketing strategy. Game Design Proposal The proposal doesn t adequately describe the game or for what platform it s intended. The proposal either doesn t identify genre, adequately describe gameplay or narrative, or articulates target platform. Identifies game genre. Describes narrative structure (if applicable). Describes key gameplay features. Articulates target platform (console, mobile, etc.). Marketing Strategy The paper lacks a coherent marketing strategy and is missing (or severely lacking in) one of the following areas: a target market, relevant market research, positioning, competitive analysis, budget, or risks. The strategy is thorough, but is lacking in one or more of the following areas: a target market, relevant market research, positioning, competitive analysis, budget, or risks. Identifies a target market. Contains relevant market research. Identifies positioning of video game in the market. Discusses competitive analysis, including top performers in the genre. Estimates resources required (or a full budget). Identifies risks. Research Paper is indicative of minimal research, contains considerable citation errors. Only uses 1 video game as a reference, or conflates design and publication processes. Paper is indicative of an adequate amount of research and is largely cited appropriately. Leverages the characteristics of at least 2 recent successful video games as evidence. Demonstrates an understanding of the difference between video game design and publication. Contains research that is cited appropriately (MLA style).

23 Needs work (1) Adequate (2) Excellent (3) Score Comments Originality Game Design Proposal The game s narrative and gameplay rely on what exists in current titles. The marketing strategy has done before. The proposal doesn t adequately describe the game or for what platform it s intended. Some elements of either strategy are borrowed, but has creative elements. The proposal either doesn t identify genre, adequately describe gameplay or narrative, or articulates target platform. Articulates an original, creative video game idea. Develops an original, creative marketing strategy. Identifies game genre. Describes narrative structure (if applicable). Describes key gameplay features. Articulates target platform (console, mobile, etc.). 3 2 Marketing Strategy The paper lacks a coherent marketing strategy and is missing (or severely lacking in) one of the following areas: a target market, relevant market research, positioning, competitive analysis, budget, or risks. The strategy is thorough, but is lacking in one or more of the following areas: a target market, relevant market research, positioning, competitive analysis, budget, or risks. Identifies a target market. Contains relevant market research. Identifies positioning of video game in the market. Discusses competitive analysis, including top performers in the genre. Estimates resources required (or a full budget). Identifies risks. 3 Research Paper is indicative of minimal research, contains considerable citation errors. Only uses 1 video game as a reference, or conflates design and publication processes. Paper is indicative of an adequate amount of research and is largely cited appropriately. Leverages the characteristics of at least 2 recent successful video games as evidence. Demonstrates an understanding of the difference between video game design and publication. Contains research that is cited appropriately (MLA style). 2 Global Feedback

24 SCORING GUIDES Articulate only the highest level of achievement Provide a range of scores for each criterion

25

26 Criterion Description Score Comments Originality (2 pts) Game Design Proposal (4 pts) q Video game idea is creative. q Marketing strategy is creative. q Identifies game genre. q Describes narrative structure (if applicable). q Describes key gameplay features. q Articulates target platform. Marketing Strategy (6 pts) Research (3 pts) q Identifies a target market. q Contains relevant market research. q Identifies positioning of video game in the market. q Includes competitive analysis. q Provides resources required (or a full budget). q Identifies risks. q Leverages at least 2 recent successful video games as evidence for claims. q Demonstrates an understanding of the difference between video game design and publication. q Contains research that is cited appropriately (MLA style). Total

27 RUBRICS: TIPS Start with 3-scale rubrics Share/discuss with your students Try collaborating with your students Use for all summative assessments Share them with your colleagues Track skills across multiple rubrics Analyze the data Create programmatic rubrics

28 CONCLUSION

29 TAKEAWAYS Effective feedback is Descriptive Constructive Actionable Timely Prioritized Personalized Feedback requires practice opportunities.

30 TAKEAWAYS Rubrics have many benefits: 1. Providing timely feedback 2. Familiarizing students with highest levels of achievement 3. Encouraging critical thinking 4. Facilitating communication 5. Refining teaching skills

31 TAKEAWAYS Rubric construction has 4 stages: 1. Reflecting 2. Listing 3. Grouping and labeling 4. Applying

32 QUESTIONS AND DISCUSSION GALEN DAVIS Director of Faculty Development SOURCES Ambrose, Susan A., Bridges, Michael W., DiPietro, Michele, Lovett, Marsha C., & Norman, Marie K. (2010). How learning works: 7 research-based principles for smart teaching. San Francisco, CA: Jossey-Bass. Carless, D. (2007). Differing perceptions in the feedback process. Studies in higher education, 31(2), Gonzalez, J. (2014, May 1). Know your terms: Holistic, analytic, and single-point rubrics. Retrieved from Grant, M. R., & Thornton, H. R. (2007, December). Best practices in undergraduate adult-centered online learning: Mechanisms for course design and delivery. MERLOT Journal of Online Learning and Teaching, 3(4), Rucker, M. L., & Thompson, S. (2003, January). Assessing student learning outcomes: An investigation of the relationship among feedback measures. College Student Journal, 37(3), Stevens, D. D., & Levi, A. J. (2013). Introduction to Rubrics. Sterling, VA: Stylus Publishing.