Scenario Village Proctoring

- Contributing writer: Amanda Westervelt, Portland Bureau of Emergency Management, Operations Specialist -

Proctors are a critical part of the scenario village exercise experience. Proctors support survivor volunteer actors, observe the players as they work through the exercise, evaluate demonstrated skills, identify areas for improvement, deliver injects, provide simulated effects and responses, and monitor the safety of all participants during the course of the event. At the end of the exercise, a proctor provides the NET players with constructive criticism and positive reinforcement.

Every Scenario Village exercise should include at least two proctors, and preferably more. There are several different proctor roles, and an exercise with few proctors will mean each individual proctor taking multiple roles.

Preparing to Proctor

Before heading to Scenario Village, bring a clipboard, paper, and something to write with. Before the exercise begins, make sure you:

• Know the scenario: Maybe an earthquake just happened, we are on a typical city block, several survivors are scattered throughout the village with various injuries, they need assistance, and here comes a NET team…

• Know the objectives of the exercise: Why is the exercise coordinator doing this? Generally this is to provide a team of NETs and opportunity to practice ICS, radio, search & rescue, and medical triage skills.

• Know the NET players’ objectives: Is this an easier scenario for first-time players? Or is this a more complex scenario for a team that wants to really practice a very specific set of advanced skills? You’ll want to know what you should be evaluating.

• Familiarize yourself with the Village if you haven’t been there before. You can download a map HERE.

• Do a safety walk-through before the actors come in.

• Ask the Exercise Coordinator if there will be any injects, and if you are providing them; when, where and how. Injects could be gas release sounds or an announcement that an aftershock just occurred, etc.
• Know any simulations you’ll need to provide. For example, telling players if they touch a “live” electrical wire and have to sit out for 5 minutes due to injury, or you may pretend to be the operator if a player pretends to call 911.

Once you have this information, you can choose to create a checklist of critical tasks – specific actions that are required for players to meet their goals, formally known as capability targets. By creating a checklist in advance, you become a more thoughtful, objective, and consistent evaluator. Since teams may run through this exercise two or even three times in a session, consistent evaluation will clearly show where they improve over time. The formal HSEEP Exercise Evaluation Guide for search, rescue, and triage can be found here. Feel free to use it, or to develop your own checklist format.

Prep and Safety Briefing for Players

The safety briefing is given by a proctor before the Players move from the lobby to the staging area. It should not take more than a few minutes. Remind Players:

1. To sign in if they haven't already done so.
2. To yell "REAL WORLD" to stop the exercise if they observe anything unsafe taking place (they should trust their gut too).
3. (If we brought the beads)...wear Mardi Gras beads if you do not want to be photographed.
4. To do a sharp instrument check...are you sure you don't have any on you?
5. Not to carry Survivor Volunteers down stairs. But instead, to let them stand and walk down and then resume the patient carry.
6. Have a flashlight for darkened areas. If you don't have a flashlight, don't go in.
7. What the different lanyard colors mean.
8. To leave PPB Training in better shape than we found it; don't leave any garbage or anything like that, or we don't get invited back. We are guests here.
9. The basic exercise flow: they'll stage. go into the village, assess, and render aid.
10. Not to take too long for assessment. And acknowledge people you see who need help even if you're not rescuing them yet...don't just ignore them. Talk about "response tempo".
11. If this is a mixed group, indicate the Team Leader.
12. To have fun, do not stress; it's only a FAIL if someone is hurt in the exercise. Otherwise, this is the place to make mistakes.
13. There will be a hotwash at the end.

...

Prep and Safety Briefing for Survivor Volunteers

The safety briefing is given by a proctor before the Survivor Volunteers move from the lobby to the staging area. Be sure to leave adequate time for questions. Let Survivor Volunteers know:

1. To sign in if they haven't already done so.
2. To yell "REAL WORLD" to stop the exercise if they observe anything unsafe taking place (they should trust their gut too).
3. (If we brought the beads)...wear Mardi Gras beads if you do not want to be photographed.
4. To do a sharp instrument check...are you sure you don't have any on you?
5. They should never be carried down stairs. But instead, let them stand and walk down and then resume the patient carry.
6. What the different lanyard colors mean.
7. To leave PPB Training in better shape than we found it; don't leave any garbage or anything like that, or we don't get invited back. We are guests here.
8. The basic exercise flow: staging, going into the village, assessing, and rendering aid.
9. Get ready for the frequent "Hurry up and wait" of being a Volunteer Survivor.
10. There will be a hotwash at the end and they are welcome to participate and offer how things went from their perspective.
11. Situation with lunch and refreshments.

...

Hotwash

The Scenario Village hotwash is an opportunity for all participants to decide how they think the exercise went. It is important not to frame in terms of "success" or "failure" since this is a practice response. What is more important is what people learned.

Begin by affirming their hard work. Often, no matter what happened during the exercise or how well they performed, volunteers feel like they failed...be sure to disabuse them of that notion.

Thumb: Something that went well

Index finger: Something you'll remember for next time

Middle finger: Something that went not great

Ring finger: One relationship you're going to keep from this network

Pinky: One thing you promise to do as a result of this exercise

• Organizational roles and responsibilities are clearly identified
• I understood my role in the response
• The incident objectives were met
• Participants communicated clearly
• I brought the right gear with me