markdown source builds

Auto-generated via {sandpaper}
Source  : 5e15cc5
Branch  : main
Author  : Toby Hodges <tobyhodges@carpentries.org>
Time    : 2022-06-08 13:10:26 +0000
Message : Merge pull request #59 from carpentries/09-stay-on-target

Initial draft of the 'Stay on target' lesson

09-formative-assessment.md

@@ -4,28 +4,6 @@ teaching: 30
 exercises: 35
 ---
 
-- With learning objectives you have defined your *intended* curriculum.
-- What learners leave with after the lesson/workshop (*attained* curriculum) will be a combination of *implemented* and *hidden* curriculum.
-  - Implemented curriculum: the concepts, relationships, and skills that are explicitly covered in your lesson.
-  - Hidden curriculum: the additional things, not directly addressed in the content, that people learn about the topic from your lesson/the way it is taught.
-    - You can use Instructor Notes to guide Instructors on some of the important hidden curriculum to consider e.g. to encourage them to model certain practices.
-- [The goal of the remaining steps of lesson development is to ensure that the attained curriculum matches the intended curriculum as closely as possible](https://f1000research.com/documents/9-1377).
-- Assessments are a way to determine whether the objectives you defined for the lesson/a section of the lesson have been reached
-  - Formative assessments during the workshop
-  - Summative assessments at the end.
-  - For short-format workshops, formative assessments are usually more valuable
-    and easier to implement in practice.
-    They help you maximise the value of the workshop for learners while they are there.
-  - They also help with *metacognition* -
-    the awareness a learner has that they are succeeding in learning something new.
-- Exercises are one important type of formative assessment
-- Mental models and misconceptions
-  - 27+15=42 MCQ example from Instructor Training
-  - In addition to the prior knowledge we want learners to have they also have knowledge that can lead to misconceptions. 
-  - It is important to detect misconceptions as early as possible
-    and formative assessments should help you do this
-- Learners get feedback about what they have misunderstood - guided practice
-
 ::::::::::::::::::::::::::::::::::::::: objectives
 
 - Explain what is meant by the intended and attained curriculum of a lesson.
@@ -42,6 +20,61 @@ exercises: 35
 
 ::::::::::::::::::::::::::::::::::::::::::::::::::
 
+
+As we have seen previously, defining objectives for a lesson (or a teaching episode) can help to focus your content on the most important learning outcomes and outline the scope of your lesson project. With learning objectives you have defined your **intended (or planned) curriculum** - what you set out to accomplish with your lesson. The skills and knowledge your learners actually leave with and can demonstrate after the workshop having followed the **implemented curriculum** in the classroom is called the **attained curriculum**. **Implemented curriculum** includes the concepts, relationships and skills that are explicitly covered in your lesson and translated into classroom practices - i.e. the teaching and learning activities that should lead to your learners attaining knowldge.
+
+::::::::::::::::::::::::::::::::::::::  callout
+
+## Hidden Curriculum
+
+There is one more curriculum at play here - **hidden curriculum** includes all unintended curricular effects that influence learning but are not explicitly  addressed in the lesson content - e.g. (unofficial) social and cultural norms, behaviours and values that are transferred by instructors to learners, often unconsciously. These are all the additional things that people learn about the topic from *the way* your lesson is taught, rather than from its official content. You can use Instructor Notes (covered in more detail in ["Preparing to Teach"](18-preparing.md) episode) to guide instructors on some of the aspects of the hidden curriculum, e.g. to encourage them to follow certain tried and tested practices.
+
+:::::::::::::::::::::::::::::::::::::::::::::::::: 
+
+The goal of the remaining steps of lesson development is to ensure that the attained curriculum matches the intended curriculum as closely as possible. To do so, you need to develop assessments to ensure progression towards your learning outcomes.
+
+::::::::::::::::::::::::::::::::::::::  callout
+
+## Useful reading
+
+Useful further reading: [Course design: Considerations for Trainers – a Professional Guide](https://f1000research.com/documents/9-1377).
+
+::::::::::::::::::::::::::::::::::::::::::::::::::
+
+
+## Assessements
+
+In order to measure progress and evaluate if and what learning occurred - we use various types of assessments:
+
+ - **formative assessments** - used to detect changes in learner performance *during*
+instruction, to provide feedback and insight into the learners' developing mental models of the topic taught and to identify any old or developing misconceptions. 
+- **summative assessments** - used to verify whether learners achieved
+the stated learning objectives after instruction.
+
+**Summative assessments** sum up what learning has been achieved after 
+training (e.g. via exams). They give valuable
+data about learning attainment by individuals and entire cohorts but are not used to guide further progress. They may not be as suitable for short courses, but may be necessary for those that give marks/grades or certificates of completion. 
+
+**Formative assessments** are applied throughout a course and with different purposes: they provide a way to move [new information from working memory to long-term memory](https://carpentries.github.io/instructor-training/05-memory/index.html#using-formative-assessment-to-support-memory-consolidation); they can inform instructors' decisions about how to modify instruction to better promote learning; they also inform learners about changes they may need to make to improve their learning. Ideally, they should be used often (e.g. after every 15-20 minutes of teaching), providing opportunities to instructors to change pace and refocus  learners’ attention. For short courses, formative assessments are usually more valuable and easier to implement in practice than summative assessements - they need not be complex or time-consuming, just informative enough about learning for both instructors and learners. 
+
+The most effective way to test learner understanding is  to do such assessments in class - they engage all learners and allow instructors to check learners' confidence with the content and its delivery, can help you deal with any potential misunderstandings as soon as they arise, and maximise the value of workshop for everyone. Such formative assessments also help with *metacognition* -
+the awareness a learner has that they are succeeding in learning something new. 
+Any instructional tool that generates feedback and is used in a formative way to check for learners' understanding can be described as “formative assessment”. For example, 
+
+- reflection at the end of a session to help process learning - e.g. asking learners to write down things they learned, things they want to know more about and any questions they still have
+- concept maps - asking learners to reflect by drawing a diagram or writing down a list of new concepts and skills they’ve learned and (optionally) how they connect with previous knowledge
+- minute cards - gauging learners’ satisfaction and understanding using agreed signals (e.g. raising different coloured post-it notes to indicate that the pace is too fast/slow, that they completed/have not completed an exercise).
+
+Many other formative assessment tools can be found in Briggs’ list of ["21 ways to check for student understanding"](https://www.opencolleges.edu.au/informed/features/21-ways-to-check-for-student-understanding/).
+
+Exercises are one important type of formative assessment. We will now have a look into exercises that perform misconception checks and ask students diagnostic questions; we will cover a few other types of exercises that help with retaining 
+new knowledge in one of the later episodes.
+
+## Detecting Misconceptions
+
+Detecting and correcting [misconceptions](https://carpentries.github.io/instructor-training/02-practice-learning/#misconceptions) and fixing learners' incorrect/broken [mental models](https://carpentries.github.io/instructor-training/02-practice-learning/#building-a-mental-model) is as important as presenting your learners with new knowledge and correct information. _Why is it important to identify misconceptions as early as possible?_ When mental models are broken, learning can occur slower than you might expect. The longer a prior incorrect model is in use, and the more extensively it has to be "unlearned", the more it can actively interfere with the incorporation of the new correct knowledge (since it will contradict the misconceptions already present in the mental model). 
+
+
 ::::::::::::::::::::::::::::::::::::::  challenge
 
 ## Exercise: misconceptions (5 minutes)
@@ -56,6 +89,27 @@ the topic you are teaching.
 
 ::::::::::::::::::::::::::::::::::::::::::::::::::
 
+
+[Multiple choice question (MCQ)](https://carpentries.github.io/instructor-training/02-practice-learning/#using-formative-assessment-to-identify-misconceptions) exercises are types of a formative assessment that can help you target anticipated misconceptions. When designed carrefully, each incorrect answer in a MCQ will have diagnostic power and provide valuable insight into how a mental model is broken. For example, suppose we are teaching children multi-digit addition. An example of a well-designed MCQ ([borrowed from The Carpentries Instructor Training](https://carpentries.github.io/instructor-training/02-practice-learning/#using-formative-assessment-to-identify-misconceptions)) in this case could be: 
+
+> Q: What is 27 + 15?
+> 
+> a) 42
+> b) 32
+> c) 312
+> d) 33
+
+The correct answer is 42, but each of the other answers provides a valuable insight:
+
+> b) they do not understand the concept of a carry and are throwing it away completely
+> c) they understand the concept of a carry and know that they cannot just discard the carried ‘1’, but do not understand that it is actually a ten and needs to be added into the next column - they are treating each column of numbers as unconnected to its neighbours.
+> d) they understand that they need to carry ‘1’ but are adding it to the wrong column.
+
+Their diagnostic power means that each of the wrong choices helps an instructor figure out precisely what misconceptions learners had adopted and in which ways their mental models are broken. As a result the instructor may decide to review a particular concept or change the pace of instruction. At the same time, learners get feedback about what they have misunderstood and what they need to focus their study efforts on - we call this **guided practice**.
+
+When designing a lesson, for diagnostic assessments you can think about problems or questions from previous training events and what people struggled with, or think about your own misconceptions in the past or ask colleagues about their experiences. You should aim to create all your assessments before you have written the explanatory content of your lesson ([backward design](https://en.wikipedia.org/wiki/Backward_design)). These assessments will guide your lesson design process by knowing exactly which knowledge you'd expect from your learners at any point in the lesson.
+
+
 ::::::::::::::::::::::::::::::::::::::  challenge
 
 ## Exercise: designing a diagnostic exercise (20 minutes)
@@ -96,7 +150,10 @@ Share your feedback in the collaborative notes document.
 
 :::::::::::::::::::::::::::::::::::::::: keypoints
 
-- First key point. Brief Answer to questions. (FIXME)
+- The goal of lesson development is to ensure that the **attained curriculum** matches the **intended curriculum** as closely as possible.
+- Assessments are a way to determine whether the objectives you defined for the lesson have been reached.
+- **Formative assessment** happens *during teaching* and provides feedback both to an instructor and a learner - about progress and whether learning of new concepts occurred but also about any misunderstandings and misconceptions which can hinder further learning.
+- It is important to detect misconceptions as early as possible and formative assessments (such as multiple choice questions) can help us with this.
 
 ::::::::::::::::::::::::::::::::::::::::::::::::::
 

md5sum.txt

@@ -12,7 +12,7 @@
 "episodes/06-long-break.md" "3a4802231bb8e44cc6c132d86afb7f78" "site/built/06-long-break.md" "2022-02-01"
 "episodes/07-infrastructure.md" "214a94c9f53145a0007c58b6d812cd08" "site/built/07-infrastructure.md" "2022-02-25"
 "episodes/08-short-break.md" "05d1044278ce40ab59d9397db1f0e383" "site/built/08-short-break.md" "2022-02-01"
-"episodes/09-formative-assessment.md" "59592d86c6c382b3c7427c6955fbf6c8" "site/built/09-formative-assessment.md" "2022-03-08"
+"episodes/09-formative-assessment.md" "bc67c7c812c9852bfdcc395c416c6afd" "site/built/09-formative-assessment.md" "2022-06-08"
 "episodes/10-wrap-up1.md" "f481560937fd48d9e1bbe47c911de78c" "site/built/10-wrap-up1.md" "2022-06-01"
 "episodes/11-exercises.md" "50ed5c1c50689616240f571269e0bf0e" "site/built/11-exercises.md" "2022-05-26"
 "episodes/12-short-break.md" "05d1044278ce40ab59d9397db1f0e383" "site/built/12-short-break.md" "2022-02-01"