Blog, News, Tweets

  • 0

ASSESSMENT UNTANGLED: A 3-Part series on Reclaiming Assessment

I thought I made up the word byzantizing* to explain the bollix** we have gotten into over tests, measurement, and assessment. Then I discovered this definition: “Byzantizing the algorithm implements the ordinary Paxos consensus algorithm under a suitable refinement mapping.” (Lamport, 2011). That’s when I realized I was onto something fundamental and consequential: Assessment must be transparent, understandable, and informative, for all learners.

In relation to assessment, byzantizing means that each of us sees and uses assessment through a different lens or pathway, sometimes as a winding road to follow, frequently a labyrinth to navigate, often as an endless tangle, occasionally something to decrypt, unravel, or break open.

DEFINITIONS:
Byzantine: Complicated, convoluted, intricate, multifaceted practice, situation, or system.
*Byzantizing: Making something more complicated than it needs to be.
**Bollix: To bungle or throw into disorder.
***Un-byzantizing: To make something less complex and complicated.

INTRO: RETURNING TO ASSESSMENT FUNDAMENTALS & ESSENTIALS:
BACKTRACKING TO BASICS

Derived from the Latin word Assidere, assessment means to sit beside and guide. Over time, this concept has become entangled with standardized tests, international comparisons, and other ambiguous measures.
Returning to its original meaning, assessment is something teachers can observe, describe, organize, compile, and most importantly, respond to.

If the purpose of education is to prepare students for the present and future, then learning how to learn must be a priority. In addition to core academic classes, skills for lifelong success include critical thinking and problem solving, as well as interpersonal skills such as empathy, decision making, and collaboration. The bigger question is this: How do we assess not only what students know and can do, but also how accurately and comprehensively they can assess themselves, gauge their progress, and respond constructively to learning challenges and outcomes?

At its core, assessment that sustains student success is informative and actionable for both learners and teachers. Rather than selected choice tests or structured essays or following step by step procedures, it is more practical and effective and informative to assess students throughout the process of developing mastery.

Keep in mind that the human body sends 11 million bits per second to the brain for processing, but the conscious mind can process only about 50 bits per second. Computers can collect and process mega-millions per second, which means that our brains are more apt to forget much of what was learned.

How long do you remember disconnected facts of history, formulas for chemical compounds, or the details of routine conversations or complex directions? Consider how Ebbinghaus shows this in his Forgetting Curve.

Remembering and forgetting begins in the amygdala, a tiny mass of gray matter in the center of our brain that regulates emotions and encodes memories. It can enhance learners’ attention and perception through positive experiences and affirmation. It also leads to a stressful fight or flight response that releases adrenaline that impedes learning and memory.

Consider these steps in un-byzantizing assessment in support of progress for all learners. They are elaborated in upcoming “episodes” of this blog.
STEP 1: Support and engage students in understanding the expectations, purpose, and intended outcomes of learning.
STEP 2: Plan, select, and design assessments that support the purpose, context, and process of learning as well as the learners’ dispositions and requisites.
STEP 3: Return to best practices, proven fundamentals, and the engagement of learners in assessment and as assessors.

Note: Steps 1-3 will be elaborated in subsequent postings on: Engaging learners in assessment, Relying on assessment as a learning strategy, and Transferring ownership and agency to learners.

REFERENCES AND RESOURCES
-Andrade H.(2019) A Critical Review of Research on Student Self-Assessment,
https://www.frontiersin.org/articles/10.3389/feduc.2019.00087/full
-Ferlazzo, Larry. (2016) Controversial Topics Should Not Be Avoided
https://larryferlazzo.edublogs.org/2016/11/05/controversial-topics-should-not-be-avoided-in-school/
-Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134
https://psycnet.apa.org/record/1999-15054-002
-Lamport, Leslie (2011) Byzantizing Paxos by Refinement https://link.springer.com/chapter/10.1007/978-3-642-24100-0_22

ASSESSMENT UNTANGLED
PART 1 of 3 Essential Steps for Reclaiming Assessment
Engaging Learners IN Assessment

In relation to assessment, byzantizing means that each of us sees and uses assessment through a different lens or pathway, sometimes as a winding road to follow, frequently a labyrinth to navigate, often as an endless tangle, occasionally something to decrypt, unravel, or break open.

Maze, Labyrinth, Solution, Lost, Problem, Challenge

SUPPORTING STUDENTS IN UNDERSTANDING LEARNING EXPECTATIONS, PURPOSE, AND INTENDED OUTCOMES

Numerous sources provide big-picture intentions and outcomes of learning. These standards may be more apparent to experienced educators than to students. As such, the complexity of “big picture” standards must be deconstructed to make them understandable and actionable by all learners.

For example,
Starting in 4th grade: CCSS.ELA-LITERACY.RI.4.8 “Explain how an author uses reasons and evidence to support particular points in a text.
In 5th grade,
CCSS.ELA-LITERACY.RI.5.8: “Explain how an author uses reasons and evidence to support particular points in a text, identifying which reasons and evidence support which point(s).”  
By 10th grade: CCSS.ELA-LITERACY.RI/9-10.8 that same standard is expressed this way: “Delineate the arguments and claims in a text, assessing whether the reasoning is valid and the evidence is relevant and sufficient.”

How is a learner to respond to that standard when asked about climate change or reinterpretation of historical events? It begins by unraveling standards into actionable learning steps.
Step 1
.
Students review and consider resource materials (self-chosen or teacher provided) for their source, author, purpose, perspective, and substantiation.

Step 2
.
Students prepare a diagram/chart that identifies similarities and differences in the source materials. They may also formulate questions about each resource to further validate the ideas and solutions.

Step 3
. Performance assessment: In a Socratic Seminar or Town Hall meeting, teams share their findings, question each other, compare responses, and analyze for objectivity, accuracy, and clarity. Each student then prepares their own summary by comparing the learning purposes with their learning outcomes. (Reference, Student Engaged Assessment, 2020, Greenstein and Burke)  They rate themselves, their team, and other teams, using a rubric (Reference: Assessing 21st Century Skills, 2012, Greenstein) that aligns with the purpose of learning and the intended outcomes (i.e., clarity, selection of resources, support for conclusions, organization, and presentation).

Here’s another example from Edutopia: https://www.edutopia.org/article/teaching-young-students-how-use-multiple-sources

APPLY YOUR LEARNING: DISCUSS with other educators the purpose and strategies for ensuring that students are aware of the learning goals, are familiar with the processes of learning, and understand the expected outcomes. How can you help students make these connections in your setting?

ASSESSMENT WITH BENEFITS: OUTCOMES OF STUDENT-ENGAGED ASSESSMENT
Self-assessment is an essential lifelong skill. The evidence on the effectiveness of student self-assessment on learning outcomes continues to grow. The skill transfers to adulthood, where it is beneficial to recognize and appreciate successes and challenges in personal and professional lives as well as identify areas for growth and improvement. Utilizing evidence and feedback to inform actions and decisions is a foundational life skill. From Heidi Andrade (2019) to the Kruger-Dunning Effect (1999), the evidence is clear.

REFLECTION ON and APPLICATION OF LEARNING
1. In relation to engaging learners in assessment, what are you doing well, and what are your priorities for improvement?
2. In what ways are you untangling assessments so that all constituents can understand and utilize them?
3. How can you assure that assessment of students is fair and accurate for all learners?
4. What steps can you take towards transferring ownership of assessment to students?
5. Select a content-area standard and begin to untangle it in ways that make it understandable and actionable to learners.

DEFINITIONS:
Byzantine: Complicated, convoluted, intricate, multifaceted  (system or situation), excessively complicated.
*Byzantizing: Making something more complicated than it needs to be. Obfuscate, muddle, convolute
**Bollix: To bungle or throw into disorder https://www.merriam-webster.com/dictionary/bollix
***Un-byzantizing: To make something less complex and complicated. Simplify, abridge, or streamline.

ADDITIONAL RESOURCES:
-Andrade H.(2019) A Critical Review of Research on Student Self-Assessment, Frontiers in Education https://www.frontiersin.org/articles/10.3389/feduc.2019.00087/full
-Ferlazzo, Larry. (2016)  Controversial Topics Should Not Be Avoided https://larryferlazzo.edublogs.org/2016/11/05/controversial-topics-should-not-be-avoided-in-school/
-Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134 https://psycnet.apa.org/record/1999-15054-002
-Lamport, Leslie (2011) Byzantizing Paxos by Refinement https://link.springer.com/chapter/10.1007/978-3-642-24100-0_22

 ASSESSMENT UNTANGLED
Part 2 of 3 Essential Steps for Reclaiming Assessment
Reframing Assessment AS Learning

In relation to assessment, byzantizing means that each of us understands and uses assessment through our own lens or pathway; sometimes it is a winding road to follow, frequently a labyrinth to navigate, often an endless tangle, occasionally something to decrypt or break open.

Text Box: Pixabay

RETURNING TO ASSESSMENT FUNDAMENTALS:  BACKTRACKING TO THE  BASICS

Derived from the Latin word Assidere, assessment means to sit beside and guide. Returning to its original meaning, assessment is something teachers can observe, describe, organize, compile, and more importantly, respond to.

At its core, assessment that sustains student success is informative and enlightening for both learners and teachers. Rather than selected choice tests or sequenced essays, it is more effective to continuously assess students in varied ways as they progress towards mastery. 

ALIGNING ASSESSMENT WITH PURPOSES OF LEARNING AND ABILITIES OF LEARNERS
Learning can be as simple as repeating the A, B, Cs or as complex as analyzing global rivalries. Learning, viewed through the lens of a taxonomy, typically follows a purposeful sequence. Whether you choose Bloom’s or Anderson and Krathwohl’s revision of Bloom’s, or another (Heick, 2013), there is consensus that learning proceeds from simple to complex and from passive to engaged, while also developing cognitive, social, emotional, and physical mastery. (Berger: Maslow Before Bloom, (https://www.edutopia.org/article/how-maslow-bloom-all-day-long)

Imagine you were required to display your knowledge and skills in a sport such as golf, preparing a unique cuisine, or leading a contentious meeting. Each of us may rely on explicit knowledge or skills that could be assessed through differing channels, i.e., written, illustrated, or demonstrated. Each learner begins with their own proficiencies. And they perform at their best when they have opportunities to display their learning at varying levels of mastery as well as through varied mediums. Some would even write a three-page essay if it meant they did not have to present in front of peers (or visa-versa). However, rather than emphasizing the medium or channel, it is more important to focus on the level/type of knowledge or skills being assessed.

CHOICE BOARDS are one way to assess through the taxonomy while giving students choices to present what they know and can do with their learning. Perhaps one learner is best at remembering and prefers to dramatically perform a soliloquy while another wants to persuade their school leaders that reading Shakespeare (except for “Othello”) is irrelevant in today’s world. He advocates and defends the reading of other classics such as 1984, To Kill a Mockingbird, or Diary of Anne Frank.

OFFER STUDENTS MULTIPLE PATHWAYS TO DISPLAY THEIR LEANING AT VARIED LEVELS OF A TAXONOMY 

Weighted Choice Board: Multiple Ways to Show Learning (Sticky Assessment, Greenstein, 2016, pg. 115)

2 Points: Remember4 Points:
Understand, Apply
6 Points:
Analyze, Evaluate,  Create
Make a word cloud using unit vocabulary Explain three main ideas from your learning to a Martian.                  Prepare a technology-based
summary.
Prepare flashcards for review of learningUse illustration/words to explain a key concept from your learning.Create an educational cartoon about the main ideas/points of your learning.
Prepare a dictionary of 5 new terms or concepts Write a mini-test that includes 3 types of questions or tasks that measure the learning intentions.Write and perform a 30-second public service announcement. Include 2 essential ideas and a defensible urge to action.

APPLY YOUR LEARNING: With your team, prepare a choice board that supports your curriculum, matches taxonomical expectations, and supports learners’ needs.

CONCLUSION: OUTCOMES OF STUDENT-ENGAGED ASSESSMENT = ASSESSMENT WITH BENEFITS
Self-assessment is an essential lifelong skill. The evidence of its effectiveness for improving learning outcomes continues to grow. (Andrade, 2019; Kruger-Dunning Effect,1999), These skills transfer to adulthood, where it is beneficial to recognize successes and challenges as well as identify areas for growth and improvement. Utilizing evidence and feedback to inform actions and decisions is a foundational life skill.

REFLECTION:

1. In relation to assessment, what are you doing well, and what are your local priorities for improvement?
2. In what ways are you untangling assessments so that all constituents can understand and utilize them?
3. How can you assure that assessment of students is fair and accurate for all learners?
4. What steps can you take towards transferring ownership of assessment to students?

DEFINITIONS:
Byzantine: Complex, convoluted, intricate, multifaceted, excessively complicated
*Byzantizing: Making something more complicated than it needs to be
**Bollix: To bungle or throw into disorder. https://www.merriam-webster.com/dictionary/bollix
***Unbyzantizing: To make it less complex and complicated. Simplify, abridge, or streamline.

ADDITIONAL RESOURCES:
-Andrade H.(2019) A Critical Review of Research on Student Self-Assessment, Frontiers in Education https://www.frontiersin.org/articles/10.3389/feduc.2019.00087/full
-Berger, Tom (2020) Maslow Before Bloom https://www.edutopia.org/article/how-maslow-bloom-all-day-long
-Ferlazzo, Larry. (2016)  Controversial Topics Should Not Be Avoided https://larryferlazzo.edublogs.org/2016/11/05/controversial-topics-should-not-be-avoided-in-school/
-Heick T, (2013) Alternatives to Bloom’s Taxonomy for Teachers  https://www.teachthought.com/critical-thinking/5-alternatives-to-blooms-taxonomy/
-Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134 https://psycnet.apa.org/record/1999-15054-002
-Lamport, Leslie (2011) Byzantizing Paxos by Refinement https://link.springer.com/chapter/10.1007/978-3-642-24100-0_22

ASSESSMENT UNTANGLED
Part 3 of 3 Essential Steps for Reclaiming Assessment
Ownership and Agency Empowers All Learners

In relation to assessment, byzantizing means that each of us sees and uses assessment through our own lens or pathway; sometimes as a winding road to follow, frequently a labyrinth to navigate, often an endless tangle, occasionally something to decrypt, unravel, or break open.

Labyrinth, Confusion, Confused, Way, Choose

OWNERSHIP AND AGENCY EMPOWER STUDENTS AS SELF-ASSESSORS who can monitor and modify their learning. Note that prior to this step, it is essential for students to understand the purposes, processes, and expected outcomes of their learning as well as acceptable ways to display it. For example, in place of a test, learners may expound on a prompt, illustrate a graphic, or add details to a checklist.

PURPOSE
____Clarity: Students can explain the learning intentions and goals in their own words.
____Understanding of purpose and process is evident in the student’s personalized learning plan, their steps in
         learning, and the anticipated results.
PROCESS
____Student’s learning plans and goals are focused, visible, and feasible.
____Includes opportunities and processes for self-regulation, support, and remediation.
____Students utilize strategies to monitor their learning, track progress, and extend learning.
OUTCOMES
____Students explain how their process and led to their outcomes and also suggest improvements.
____Students voice and choice in displaying learning strengthen self-confidence.
____Students develop skills for self-advocacy and personal responsibility.

APPLY YOUR LEARNING
Using the list above, rate yourself/your team, elaborate on each of the above criteria in your own setting, and/or make recommendations to enhance and empower learners as self-assessors.

OUTCOMES OF STUDENT-ENGAGED ASSESSMENT: ASSESSMENT WITH BENEFITS
Self-assessment is an essential lifelong skill. The evidence on the effectiveness of student self-assessment on learning outcomes continues to grow. These skills transfer to adulthood, where it is beneficial to recognize and appreciate successes and challenges in personal and professional lives as well as identify areas strategies for growth and improvement. Utilizing evidence and feedback to inform actions and decisions is a foundational life-skill. From Heidi Andrade (2019) to the Kruger-Dunning Effect (1999), the evidence is clear.

REFLECTION:
1. In relation to assessment, what are you doing well? What are your priorities for improvement?
2. In what ways are you untangling assessments so that all constituents can understand and utilize them?
3. How can you assure that assessment of students is fair and accurate for all learners?
4. What steps can you take towards transferring ownership of assessment to students?

DEFINITIONS:
Byzantine: Complex, convoluted, intricate, multifaceted, excessively complicated
*Byzantizing: Making something more complicated than it needs to be
**Bollix: To bungle or throw into disorder. https://www.merriam-webster.com/dictionary/bollix ***Unbyzantizing: To make it less complex and complicated. Simplify, abridge, or streamline.

ADDITIONAL RESOURCES:
-Andrade H.(2019) A Critical Review of Research on Student Self-Assessment, Frontiers in Education. https://www.frontiersin.org/articles/10.3389/feduc.2019.00087/full
-Ferlazzo, Larry. (2016)  Controversial Topics Should Not Be Avoided. https://larryferlazzo.edublogs.org/2016/11/05/controversial-topics-should-not-be-avoided-in-school/
-Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134 https://psycnet.apa.org/record/1999-15054-002
-Lamport, Leslie (2011) Byzantizing Paxos by Refinement. https://link.springer.com/chapter/10.1007/978-3-642-24100-0_22


  • 0

DEVELOPING STUDENTS AS SELF-ASSESSORS

First published at https://literacy6-12.org as Assessment Literate Learners

This image has an empty alt attribute; its file name is image.png

When I was asked to problematize assessment, I was puzzled. Does that mean to turn something that is not a problem into one, or rather, quantifying students’ mistakes and pursuing accountability?  Turning assessment into a problem implies that something has gone wrong when in truth, it has merely gone astray from its Latin root “Assidere,” which means to sit nearby and guide. Regrettably, assessment has been taken out of the hands of educationalists who accentuate improvement and been replaced by periodic testing that quantifies learning and generates numerical comparisons. As of yet, scoring technologies cannot distinguish between a learner’s lack of knowledge and their misinterpretation of the question, nor can they provide advice on remediation. Below are 3 steps that can.

STEP 1: REVISIT FUNDAMENTAL IDEAS and PRINCIPLES OF ASSESSMENT
While some believe tests and assessments mean the same thing, the definitions below illuminate noteworthy differences in purpose and process.

TESTs are periodic procedures that establish the capacity or performance of someone or something (Merriam-Webster). They are explicit strategies to ascertain and verify a learner’s skills and knowledge. (Wikipedia). Tests tend to be more standardized, analytical, and judgmental.

ASSESSMENTS are processes used throughout teaching and learning to check for understanding, monitor progress, identify lingering gaps, and guide improvement. They rely on varied practices to gauge learning such as rubrics, exit slips, fix the mistake, student reflections, and progress trackers. They are more adaptable and personalizable than tests. (Assessment Network)

STEP 2: INCORPORATE STUDENT SELF-ASSESSMENT to DEEPEN, ENRICH, and develop OWNERSHIP of  LEARNING
Classroom assessments generally offer more insights into learning than standardized tests. Student self-assessment further illuminates competencies and leads to higher-level thinking, problem-solving, and self-efficacy. (Panadero, Jonsson, and Botella, 2017)

Learners engaged in their own assessment increase self-awareness. Prompts such as “I used to think__, but now I know__.” encourage insights into learning. As Anisha, a 6th grader, says, “I used to think communication was just talking and writing, but now I know it also includes listening, looking, thinking, AND patience.”

Students rarely take tests once they exit the education system, but they continue to be evaluated on their proficiencies, initiative, productivity, and more. The ability to gauge, reflect, and modify thoughts and actions is indispensible at work and home, throughout the lifespan.

This image has an empty alt attribute; its file name is image-1.png

STEP 3: HELP STUDENTS “SOAR” AS SELF-ASSESSORS
Have you ever said or heard something like this? “I know you believe you understand what you think I said, but I’m not sure you realize that what you heard is not what I meant.” (Attributed to Allan Greenspan). Assessment can be like the Tower of Babel, where it is not easy to disentangle ever-changing and contradictory dialects. Mary Ann Burke and I have designed a straightforward and actionable acronym to support all learners as self-assessors. We call it S.O.A.R.

The  SOAR model connotes Student Ownership and Agency leads to Results. It puts Students at the center of assessment by purposefully transferring Ownership to them and facilitating their Agency in ways that improve the Results and outcomes of learning. Here’s how it works:

1.Put STUDENTS at the center of assessment by helping them clarify and visualize what they will be learning, compare that to what they already know and can do, describe how they plan to learn, and ways they can use their learning.
In Practice: Students complete an expanded KWL chart that includes: What I think we will learn, What I know now, What I want to know, How I will find out, How can I show/use my learning.

2. Offer opportunities for students to take OWNERSHIP of their learning purpose, process, and products. For example, let them decide how to organize, summarize, and display their learning using words, visuals, or performances.
In Practice: Rely on coherent rubrics, sequenced through the taxonomy, that align with learning intentions. For example: Explain the main idea in your own words, elaborate on the significance of 3 key steps/events, draw conclusions or critique it, and design/produce original products and ideas.

3. When students become AGENTS of assessment, they take greater charge/responsibility of their path, become participants in the learning process, and strengthen self-reliance. As learners develop deeper understanding, they gain self-confidence and become resources for each other.
In Practice: Learners explain or demonstrate their understanding of the main ideas, how the author captures the reader’s attention and extends learning for deeper meaning. They may also defend a position or suggest improvements.

4. The RESULTS of students being at the center of their own assessment become evident in learning outcomes.
In Practice: As traditional measures evolve into student-owned assessment, they take increasing responsibility, seek to alleviate problems, and generate original ideas and solutions.  Rather than relying solely on traditional test questions, learners can better reflect, investigate, analyze, and formulate ideas.

Using the SOAR sequence develops every students’ life-long self-assessment skills. In doing so, they become more accountable for their learning outcomes, analyze, can explain their misunderstandings, identify knowledge and skills in need of improvement, and self-correct their own learning. Indeed, these skills support all students in moving from academic distress to confident and successful learners.  

“Tell me and I will forget, show me and I may remember, involve me and I will learn.” Ben Franklin     

Greenstein, L., and Burke, Mary Ann (2020)  Rowman and Littlefield, “Student-Engaged Assessment: Strategies to Empower All Learners

Assessment Network: Toolbox and Blogs https://www.assessmentnetwork.net/blog/  and also https://www.assessmentnetwork.net/2017/02/5-assessment-myths/

Greenstein, L. (2018) MUSTs of Assessment: in Restorative Assessment, Corwin, 2017 https://us.corwin.com/en-us/nam/restorative-assessment/book258057

Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Education Research Review, 22, 74–98.

Boyer, M. (2019)Balancing Skepticism and Utility in Machine Scoring.  https://www.NCIEA.org/blog/essa/balancing-skepticism-and-utility-machine-scoring

ABOUT THE AUTHOR

Laura is a lifelong learner and educator who has taught and assessed from preschool to graduate school, across subject areas. Her passion for educational assessment began with her dissertation and is evident throughout her work as an author of 5 books on the topic, founder of and blogger at the Assessment Network, and mentor to many teachers and learners. Through her workshops, she brings fresh ideas on a range of assessment topics from standardized to classroom, including formative, authentic, multicultural, differentiated, brain-friendly, and balanced. (Sometimes, she even talks about standardized tests.)


  • 0

MORE A’s=ASSESSMENT FOR Learning

Less T’s=Tests & Measures of Learning

T, Letter, Alphabet, Alphabetically, Abc

Can you find the letters of the word TEST within the word ASSESSMENT? It’s okay to use the T twice. But, what is the real difference between an assessment and a test? Here’s a brief answer:

A TEST is a tool or technique that measures the outcomes of learning. It relies on recall of knowledge and the student’s ability to use that information correctly in completing specific questions or tasks. Generally, tests have higher stakes attached to them than assessments and are considered summative in purpose.

ASSESSMENT is typically used throughout teaching and learning to check for understanding, reveal progress, and address lingering gaps. It comes in many forms, such as rubrics, student reflections, and progress trackers. Assessment also provides a window into learning and tracks the development of knowledge, skills, and higher level thinking. The categories below describe the key ideas (framework), but please note that with small adjustments, many of these concepts can fit into other categories.

TRANSFORMING Student TESTING INTO ASSESSING

ASSESSMENT READY LEARNERS  

  1. Can explain the learning intentions and how learning outcomes will be assessed.
  2. Begin with what they already know. For example, before learning, students can record things they know/understand about the topic, then after learning, clarify and elaborate that list.
  3. Appreciate that missteps can turn into opportunities for improvement.
  4. Realize that assessment-stress is normal. Develop a plans and have strategies for managing it.
  5. Understand AND describe the success criteria at different levels of the rubric.
  6. Recognize where they fit on the assessment mindset spectrum from “I give up easily.” to “I consistently work hard” or “It helps if I have specific directions” to “I like to figure things out myself.”
  7. Acknowledge that in the long run, progress is more important than one single grade.

STUDENTS ENGAGED IN ASSESSMENT

  1. Begin learning by annotating their learning intentions, explaining their initial level of mastery, and describing what they expect to learn about the topic.
  2. Prefer opportunities to annotate their answers rather than take selected choice tests. Peggy says, “Well, there are two meanings of the word wind, and I wasn’t sure whether the question was about the wind pulling the kite upward (Choice B) or about the person flying a kite who should wind the string more tightly. (Choice D)”
  3. Rely on rubrics that elaborate the clarity and depth of responses. For example, “Gave it my best guess” to “I explained different ways to solve the problem” or “I created an original pathway for learning.”
  4. Illustrate their answers to questions (for example, about a historical event or scientific process) or prepare a graphic to display a comparative analysis of readings, viewings, or concepts.
  5. During learning, complete quick check-ins such as a “minute quiz,” where students offer briefs insights into their current understanding and/or ask questions to clarify and develop their learning.
  6. Summarize portions of learning rather than waiting until its conclusion. This works with many topics ranging from historical events, poetry, or the periodic table.

STUDENTS AS OWNERS OF ASSESSMENT

  1. In place of multiple-choice tests, students summarize their learning by using and explaining selected terminology and concepts associated with the purposes of learning.
  2. Complete exit slips with questions such as “What was easiest/hardest about learning” or “Explain 2 other ways to learn this.”
  3. Pretend they are explaining their learning to an extra-terrestrial: What is most important to transmit  and how would they do it?
  4. Rely on a scoring rubric before they begin the assessment. During and after, they compare their work to an exemplar and describe what they would change or what is still perplexing.
  5. Review their returned assessments and summarize learning with “I used to think_____ but now I know______.”
  6. Have opportunities to self-correct their assessments and annotate what they did or didn’t know before learning and questions they still have about the topic.

STUDENT AS AGENTS OF ASSESSMENT

  1. Self-grade by using a rating scale to compare their learning outcomes to each of the “unit’s” learning intentions/instructional objectives.
  2. Score their own assessment using a different colored pen/pencil with annotations of what was easy, confusing, or what they would do differently next time, and why. Alternatively, students can do this when a teacher-graded assessment is returned.
  3. Take a quiz that includes right and wrong answers or just several incorrect answers, then correct and explain the mistakes, missteps, and oversights.
  4. When assessments are returned and reviewed, students annotate their mistakes and missteps by explaining why/how they made the gaffe, what they now know, and/or how to fix it.
  5. Rely on “Choice Boards” for assessment where students can select one way to show their understanding, one way to apply their learning, and one original idea they have on the topic.

___________________________________________________________________________________________

ENRICHMENT
TAKE A QUIZ: Part 1 at assessmentnetwork.net/2020/01/quiz-on-testing-assessment-and-measurement/
QUIZ PART 2: https://bit.ly/3iWW408
Read about Assessment With Benefits at assessmentnetwork.net/2020/08/assessment-with-benefits/
Learn More: https://www.assessmentnetwork.net/
Prepared by Laura Greenstein at the Assessment Network, where everything is freely available


  • 0

RENOVATE, REHAB, or RESTORE ASSESSMENT Complex Choices in Uncertain Times

Volkswagen, Vw, Camper, Bus, Monster Truck, Truck, 3D
Carpenter, Work, Tool, Board, Saw, Go, Wood, Build

Over time, new words have been invented, and old words redefined. Dictionaries add thousands of words each year. Consider these from Merriam Webster: HATERADE and ADULTING, and the redefinition of terms such as WOKE, SALTY, and SHADE.

Ideas, practices, and resources in educational assessment also continue to be modified. Like a house, assessment can be remodeled in multiple ways:               

  • RENOVATE: Renew, modify, or modernize, for improved functionality
  • REHAB: Update, revamp, and revitalize, for current requirements and usage
  • RESTORE: Revert to substantiated processes and practices that still work.

Few would trade their technologies for a chalkboard, while others would readily modify testing from selected choice and computer-based to student demonstrations of knowledge and skills.

With an old house, decisions come down to purpose, usefulness, and functionality: Glaze the windows or replace them; repair the old furnace or get a heat pump. Facts, finances, and preferences typically guide these decisions.

Similarly, educators have repeatedly renovated the symmetry and content of curriculum and testing. From the ideas of Horace Mann (1820s) to John Dewey (1920s) and policies of OBE (1990s), NCLB (2001), and ESSA (2015,) the pace and focus of disruptive mandates have increased. But it makes no sense to demolish the whole house because of a leaky roof.

Rather than razing education, toss what is no longer functional or suitable (a.k.a Marie Kondo), keep what is working, and fine-tune what has potential. Here are three alternatives to ongoing demolition that often leads to periods of controversial reconstruction.

RENOVATE ASSESSMENT: Replace praise and rewards with self-directed student identification of learning goals, challenges to overcome, and steps towards improvement. As feasible, allow learners to decide how to display learning outcomes: i.e., words, images, diagrams, actions. Janessa may write a poem about digestion or a historical period while Jasper prepares a flow chart of the sequence. Consistent and dependable scoring of organization, accuracy, depth, and clarity of content assures fairness.

REHAB ASSESSMENT: Update teaching and learning by incorporating multiple modalities and pathways for learning and assessing. Students can summarize with a 3-2-1 (3 facts, 2 ideas, and 1 lingering question), or prepare a matching or Jeopardy-type review. In the classroom, puppets can be repurposed to produce an original play, reenact scientific discoveries, or solve math problems. As with renovation, scoring criteria must be consistent across displays of learning.

RESTORE ASSESSMENT: Being a visual learner, I prefer 3-dimensional globes and models of the solar system to google maps. I also find joy in a beautiful analog clock for displaying the time. While ‘sit-and-git’ learning may work briefly to introduce a new theory or communicate vital information, brains learn best when they are actively involved.  Memory develops, not from soaking up facts, but from deeper thinking and productive actions.

Oversized Chellis Wall Clock

We may live in the information age, but effective and enduring learning is built on problem-solving, critical thinking, adaptability, and accountability. Standardized tests rarely measure those skills but, in the classroom, students can learn to sequence their steps as they solve a problem. (both mathematical and real-world), rely on multiple levels of thinking and learning, and chart their own pathways towards improvement.

Readings for Enrichment

https://pdfs.semanticscholar.org/056c/bfcb2a9dc9b67a7acadd896849e6393cfdc3.pdf
https://ssir.org/articles/entry/education_is_changingits_time_assessment_caught_up

https://www.frontiersin.org/articles/10.3389/feduc.2019.00064/full
Prepared by Laura Greenstein Ed.D. at AssessmentNetwork.net


  • 0

MORE A’s, LESS T’s

Megaphone, Speaker, Speak, Loud, Communication

MORE Assessment AS/FOR Learning
LESS Tests/Measures OF Learning

  • In the early 1900s, the few who attended school and succeeded at the 3Rs received a diploma (less than 10%).
  • By 1940, 50% of young adults completed their high school education.
  • Today, 86% of the U.S. population receives a high school diploma, and 35% earn a bachelor’s degree.
  • In 1965, ESEA was enacted and led to over 50 years of continuously evolving standardized testing and benchmarks under NCLB and ESSA, including NAEP, SAT, Regents, PARCC, SBAC, PISA, and more.

Over time, we misplaced the crucial understanding that tests and measures OF learning are not the same as assessments FOR and AS learning (gauges, insights, and responses to learning outcomes.) The word assessment is derived from the Latin Assidere, meaning to sit beside another. The intent being to appraise learning, and then respond, redirect, and resolve learner’s misunderstandings, gaps, or missteps. Rather than rating and ranking students, teachers, and schools, the long-term emphasis of assessment must continue to be on improving learners’ comprehension and skills.

Rely on these three R’s of assessment AS and FOR learning: Relevant, Retained, and Responsive.

1. Relevance of the assessment to the learning purpose and process as well as the learner. For example, during learning, students can (individually or in small groups) match subject area terminology cards with definition cards. Alternatively, they can create the cards or provide illustrations or examples for others to explain.

2. Retention of learning can be increased through engagement (i.e., active and multimodal learning), retrieval practice during learning, and “meaning-making” via formative assessments that support students in making real-world connections. Encourage students to summarize their emerging understandings visually (i.e., concept maps), auditorily (i.e., word games), and/or physically (i.e., demonstrate it to another).

3. Responsiveness and self-regulation in managing and re-solving assessment outcomes. Provide opportunities for students to give and receive focused feedback in a risk-free setting, elaborate or add details to their answer, or explain why they still believe their answer is correct. (i.e., “Well, the word crane can be a powerful bird or a machine to lift things.”)

Pooja Agarwal, in an ASCD Education UPDATE (March 2020), explains another essential R, Retrieval. She points out that if a learner does not use what they learn, the learning does not last. Her recommendations for  supporting retrieval include:

  • Begin a new lesson in a unit by asking students to share what they learned or accomplished in the last class. (I suggest electronic sticky notes so students can agree/disagree, elaborate, or group ideas.)
  • At intervals, have students briefly stop their reading or viewing to retrieve and record learning. (Consider using empty outlines, where a framework or incomplete sentences are provided for students to work on during retrieval pauses.)

Agarwal concludes by explaining that the best learning isn’t about what you are trying to get into students’ minds, but rather how can you routinely and feasibly draw it back out. (Education Update, March 2020)

Putting R between the A and T leads to the ART of Assessment, where assessment supports better retrieval and more relevance than testing.


  • 0

ASSESSMENT SIMPLIFIED: 3 Steps for Student Success

FROM EARLY INSPIRERS including Plato (The Republic) and Socrates (Socratic Method) to 19th and 20th-century trailblazers and practical innovators such as John Dewey, Mary Mcleod Bethune, John Holt, Maria Montessori, Jean Piaget, and Abraham Maslow, educators have continuously relied on the prior experiences and accrued knowledge of others. (Learn more at 12 Pioneers in Education)  

THROUGH 21st CENTURY ACTIVISTS, educators continue to build on the expertise of “influencers,” including Linda Darling Hammond, John Hattie,  Malala Yousafzai, and National Academies Press. We also depend on resources, practices, and ideas whose sources we may not know, such as Khan Academy, Ted Talks, Flipped Classrooms, and Gamification.

INNOVATION CAN FALL SHORT: According to Jill Barshay (2020), only 18 Percent of recent educational innovations raised student achievement. Michael George (2019) explains that successful teaching and assessment do not have to depend on a continuous supply of new pedagogy. Many things can work depending on the context, content, and process: i.e., who is teaching, how and what is being taught, the learner’s ability to construct meaning, and the expected outcomes.  Thus, a caveat on innovation: Be sure that facts, evidence, and data are verified and validated. As the Queen of Hearts declared, “Why, sometimes I’ve believed as many as six impossible things before breakfast.”

As the meaning of a 21st-century education is continuously redefined (i.e., growth mindset, competency-based, project-based, cooperative, authentic, or virtual), the availability of knowledge and ideas continues to expand. At the same time, there are myriad ways to access, construe, and evaluate it. Rather than rushing into the newest innovation, it is more meaningful to return to the foundations of assessment. Consider how you can make it simpler and more straightforward by relying on these three steps:
 
1. INFORM: Articulate and Explain Content and Purpose 

Clarify, model, and display the learning intentions and routines of assessment. In their own words, students describe what they think they will learn, currently know, are curious about, and ways they may be able to use,  personalize, and show their learning.

When Gregor says, “Wow, I can use this to calculate each player’s average scores,” or Mariska says, “I think I will be okay with the addition but may need help with division,” their teacher notes each of their concerns and follows up on them during learning. Insights can be gleaned before learning (entrance slips), during (sticky notes), and after learning (3-2-1 activity). (Reference: Book 1)

2. ENGAGE: Build Meaning and Form Connections

Encourage and engage learners in striving towards mastery of their learning through multiple pathways and practices. Confirm that students are ready to learn; then support them in identifying their steps forward. Provide opportunities for exploration, practice, reflection, and tracking of progress.
 
Keenan decides to write a rap comparing penguins to gulls, while his twin sister Keanna chooses to illustrate (using words and pictures) their similarities and differences. Both can rely on a rubric that includes accuracy of vocabulary, clarity of comparison, and resourcefulness.

Think about ways you can use a mnemonic such as SOAR, for understanding the importance of engaging students as assessors. It stands for “Student Ownership and Agency leads to Results.” (Reference: Book 2)

3. ASSESS: Before, During, and After

Before, During, and After Learning: Assessments embedded throughout learning can guide students in identifying their starting point, monitoring progress, and fine-tuning evidence of learning. These also serve to address lingering misunderstandings and smooth the path to success. (Reference: Book 3)

When learning begins with a pre-assessment, students can later complete a similar post-assessment, score themselves, identify successes, and take steps towards improvement. In doing so, they develop a mindset of progress, a willingness to try new ways, and an understanding that learning is a lifelong process that requires persistence and flexibility that leads to success.

REFERENCES

Barshay, Jill (2020) The ‘Dirty Secret’ About Educational Innovation. The Hechinger Report https://hechingerreport.org/the-dirty-secret-about-educational-innovation/
And these resources:
Book 1. What Teachers Really Need to Know About Formative Assessment, ASCD (2010)
Book 2. Student Engaged Assessment: Strategies to Empower All Learners. Rowman and Littlefield (2020)
Book 3. Sticky Assessment: Classroom Strategies to Amplify Student Learning, Routledge Eye on Education (2016)
Also: Restorative Assessment: Strength-Based Strategies That Support All Learners, Corwin (2018)

NEVER STOP LEARNING-CONTINUOUSLY ASSESS YOUR PROGRESS


  • 0

Assessment with Benefits

ASSESSMENT DEFINITIONS typically include these key ideas: 
  *Gauges the outcomes of teaching and learning.
*Gathers and utilizes information about students’ knowledge and skills.
*Depends on reliable data.    

A more comprehensive definition of assessment: It relies on gathering, analyzing, and using evidence and information from multiple sources about student outcomes in ways that best support students, inform instruction, make educational decisions, and improve learning outcomes.

Assessment is most effective when it benefits both the giver and receiver. What if there were ways to document the “return on assessment?”  This chart describes the practice, evidence, and outcomes when students are engaged IN the process of assessment as well as the benefits when they are empowered AS assessors.

ENGAGING LEARNERS
 IN ASSESSMENT
EMPOWERING LEARNERS
AS ASSESSORS                    
TEACHERS ROLE Reconsider traditional “measures” of learning: Rely on practices that involve students in the process and methods of assessment. i.e., They write the questions.STUDENT RESPONSIBILITIES Depend on validated research and best practices of student-engaged assessments to develop learners’ confidence, readiness to be assessed, and outcomes.
Share explicit learning intentions that students deconstruct into actionable and attainable learning processes and outcomes.Explain their goals, their learning intentions, and how they developed a personalized plan and process.
Offer a practical and predictable path for learning. Anticipate the need for flexibility and support. i.e., incorporate a “Learning Tracker.”Describe the path they planned and followed, what went as expected, and times that they needed to be flexible, backtrack, or take detours.
Incorporate progress and growth indicators such as checklists and rubrics for students to add to as they monitor progress throughout learning.Routinely display descriptions and documentation of their progress as well as areas for improvement.
Display exemplars of varying levels of achievement of goals: Have students compare and evaluate the exemplars.Present explicit evidence of learning and describe how their outcomes aligned or deviated from the learning intentions and plan.
Provide goal-based and actionable feedback that describes ways to resolve misunderstandings as well as close lingering learning gaps.For continuous improvement, students rely on and evaluate their use of feedback that is timely, relevant actionable, and user-friendly.  
Involve students in assessing their incoming skills and knowledge, how they will monitor progress, and feasibly evaluate the outcomes. i.e., assess pre & postPresent and explain where their learning started, the steps they took, and the quality of their final outcomes.

Based on the book: Student-Engaged Assessment:  Strategies to Empower All Learners by Laura Greenstein and Mary Ann Burke
Learn more at Assessment Network


  • 0

The Ups and Downs of Using Technology for Long-Distance Assessment

Life is often about considering choices, weighing options, and making decisions. From your favorite coffee to style of exercise, it is practical to think about your goals: Do you need a caffeine boost or a moment of relaxation or are aiming for endurance or strength?

Technology is not the learning, rather it is a resource for learning. Good intentions are not a substitute for being purposeful in achieving your goals. Nor is persuasive marketing the best guide to technologies for assessment. There’s a spectrum of substantiated advice and opinions on using emerging technologies for assessing learning.
Here’s a brief summary:

The Upside of Technology for Assessment       

  • Differentiates content and pacing for individual students.
  • Offers students enrichment and/or tutoring on specific subjects and topics.
  • Provides data that can be quantified, such as achievement of explicit benchmarks.
  • Facilitates creativity and production of original ideas and artifacts.
  • Reinforces reward centers of the brain encouraging continuous engagement.

The Downside of Technology for Assessment   

  • Modes of learning (i.e., visual, auditory, kinesthetic, social) are abridged.
  • Physical activity and the development of interpersonal skills may be hindered.
  • Real-time interaction, reflection, feedback, and questioning during learning are limited.
  • A narrowing of learning modalities may result in lower retention rates.
  • Reinforces reward centers of the brain, encouraging yearning for more screen time.

Deciding Who, When, Where, and How to Use Assessment Technologies

Decisions should be based on the learners’ requirements and the learning intentions. The lower end of the taxonomy; recall, understanding, and sequencing of steps is well-supported by technology.  Assessment of upper levels, such as analysis, evaluation, and generation of original ideas and products, requires more precision.

Technology itself may help a child build knowledge, but it cannot make children more logical. It does have the potential to be transformative when teachers and students are prepared to constructively choose, use, and evaluate the technology and learning outcomes. Technology is not a panacea for learning, nor a cure-all for raising test scores, but rather is most effective when it blends the best of teachers and machines. The emphasis must be on thoughtful adoption and valid implementation of appropriate and substantiated technologies in support of instructional aims.

Also see the May 2018 blog: https://www.assessmentnetwork.net/?s=technology+means+or+end


  • 0

Returning to School 5: Knowing What Students Know

You will also find these “RETURNING TO SCHOOL” blogs in the Toolbox


  • 0

Returning to School 4: Developing Students As Assessors

In their upcoming book (Rowman and Littlefield, June 2020), Mary Ann Burke and Laura Greenstein explain the importance of developing students as self-assessors. Key ideas include:

  1. Confirm that students understand the purpose and intentions of learning.
  2. Guide and support students as they develop plans for monitoring their learning.
  3. Incorporate practical processes for tracking their own progress as well as responding to oversights and misunderstandings.
  4. Encourage the use of feedback from multiple sources, including self-reflection, teachers, peers, and source material.

Heidi Andrade (2012) encapsulates the importance of developing students as self-assessors this way: “When assessment is student-focused, it centers on students’ strengths, needs, and interests; involves students in setting goals; promotes learning through growth; monitors progress; and determines how to address any gaps” (p. 2).

With practice and support, learners take on increasing responsibility for their learning as well as the appraisal of learning. In turn, this leads to the development of life-long skills such as responding and resolving learning challenges, recognizing that mistakes can be learning opportunities, enhancing problem-solving skills, and increasing independence and resourcefulness.

PREPARING STUDENTS FOR ASSESSMENT 

_____ 1. Ask students to explain learning targets in their own words.  
_____ 2. Incorporate checks for understanding throughout learning.
_____ 3. Acknowledge and encourage each student’s strengths and skills.  
_____ 4. Help learners appreciate mistakes as opportunities for improving. 
_____ 5. Have students recognize the connections between learning
intentions and outcomes.
 _____ 6. Provide feedback that is focused and actionable.
 _____ 7. Incorporate opportunities for self-scoring and self-correcting

TRANSFERRING RESPONSIBILITY: ENGAGING STUDENTS AS SELF-ASSESSORS
Determining whether students are prepared to learn begins with cognitive and emotional readiness to learn, mastery of academic foundations, understanding of expected processes and outcomes of learning, awareness of personal strengths and struggles, and access to a playbook of strategies and resources for reviewing and fine-tuning learning. Below is an example of a rubric for student self-scoring and self-reflection.

KEEP THESE IDEAS FOR DEVELOPING STUDENTS AS ASSESSORS AT THE FOREFRONT:

  • Assessment is a strategy for furthering learning.
  • Comprehensive assessment requires the use of varied methods for multiple purposes.
  • Engaging students IN assessment and AS assessors is imperative.
  • When you must rely on summative scores, there should be no surprises for teachers or students.
  • Refocus Assessment AS a form of learning rather than solely a measure OF final outcomes.
  • Rely on multiple viewpoints of assessment, from a close-up lens to far-reaching implications.
  • Remember that assessment is not only an ending. It can also be a beginning.

Andrade, H. 2012 https://studentsatthecenterhub.org/resource/assessing-learning-the-student-at-the-center-series/

Assessment-ready learners understand assessment routines, engage IN assessment, and serve AS assessors throughout learning.


Recent News

The Institute of Educational Sciences (IES) continues to be a reliable source for research and data on numerous topics in education. Learn more about it here https://www.youtube.com/watch?v=l-aBA0GklOQ

Ideas for making annual testing more meaningful

answer-question-2

https://www.edweek.org/ew/articles/2019/01/09/is-it-time-to-kill-annual-testing.html?cmp=eml-enl-eu-news1&M=58722125&U=83632&UUID=fa7d6e5558ed809b770d91848c643ca0

 

Assessment-Literate Educators

7 Things Assessment-Literate Educators Need to Do. (including: Balanced, Intentional, & Aligned) from NWEA/Advancing Assessment Education https://www.assessmenteducation.org/blog/seven-things-assessment-literate-educators-need-when-creating-quality-assessments-partone/

 

Overused Buzz Words

In this edweek article, from Larry Ferlazzo’s Classroom Q and A, the most overused words in educatioin include: at-risk, data-driven, rigor, 21st century skills, flipped and more. Read about it at https://bit.ly/2Llwhyl

SCAN “The Journal for Educators”

Showcasing innovation in education

scan-nsw

View All News >

Recent Tweets