Showing posts with label exercises. Show all posts
Showing posts with label exercises. Show all posts

Tuesday, April 28, 2015

The Human Element

We spend millions of dollars on new equipment and somewhat less on training our people who operate the equipment.  That is understandable.  The problem is that we spend even less on training Key Decision Makers, who, arguably, are extremely important during a disaster or incident.

Decision makers are responsible for the following:

  • Planning
  • Information Management
  • Tracking and controlling resources
  • Communicating
  • Making decisions
Let's look at these roles in detail:
  • Planning:  Who made the plan?  Do we even know if it works?  Will it work in the worst case scenario?  Is the plan accessible or even followed during a disaster or an event?
  • Information Management:  How do decision makers get experience managing large quantities of information outside of a disaster?  Practice makes perfect, but how do you have realistic practice for something as dynamic as information management?
  • Tracking and controlling resources:  Doing this during an actual event is much harder than during a tabletop exercise.  Also we bring people in to the EOC who are experts in a particular domain (police, fire, EMS, etc.) - what OTHER training is required to give them the expertise to employ and make decisions in other domains?  What about operating in an EOC environment?  The military has a one-year course to help officers transition to a Staff Officer role - what are we doing? Tabletop exercises allow us to "talk" about what we would do, rather than actually "doing" it.
  • Communicating: One of the most prevalent problems is communication issues between the responders, the EOC and other agencies and departments.  How do we get better at this? Tabletop exercises don't really allow effective and realistic practice for communications and Live or Full Scale exercises are costly and can only be run infrequently.
  • Making Decisions:  How do you give someone the confidence that they are making good decisions during a disaster or emergency?  They need practice, but realistic practice is very difficult outside of an actual event.
So herein lies the problem.  We have people in the EOC who play key roles, who have come from the field and may or may not have experience operating with other organizations.  The current training methods are wanting or very costly, and the decisions they are expected to make have a very large impact on the overall response.  

How do you solve this problem?

Luckily about 35 years ago, the military came up with a training methodology for key leaders that can be modified and brought over to the EM world.  

No, we don't have to train to be tank commanders or naval task force commanders.  This training methodology is called Constructive Simulation and it has the potential to greatly assist training key leaders and decision makers.  The military realized that it was hugely expensive to run large scale "functional" exercises to train leaders.  Even though everyone was in the field, these exercises also always had some limitations on training.  The other leader-focused training was Tabletop exercises.  Sound familiar?

Constructive simulation uses a computer to play the part of the "field" (Police, Fire, EMS, civilians, the disaster/emergency event, the buildings and terrain).  The EOC personnel interact with the on-scene personnel exactly how they would in real life - by telephone, radio, email, etc..   The on-scene personnel, instead of controlling ACTUAL resources in the field, control the resources in the computer.  They watch what is going on, report back to the EOC and implement any instructions.  From the viewpoint of the EOC, the training is nearly 100% realistic.  

Constructive simulation exercises cost much less to run (about as much or less than a Tabletop) but provide vastly improved training.  We ran a country-wide exercise in Jamaica last summer and they said that they learned much more during the two day Constructive Simulation exercise as they had during two previous functional exercises for which they paid $7M.

Constructive simulation bridges the gap between expensive functional exercises that can only be run infrequently and tabletop exercises, which are great as a walk-through, but are not realistic or extremely effective.


Sunday, July 4, 2010

How to Plan a Public Safety Exercise in 5 Easy Steps – Part 1/2

Pocket watch, savonette-type.Image via Wikipedia

One of the biggest failures in the actual execution of training for public safety managers (or for anyone, for that matter) can be traced back to the lack of a plan.  Everyone’s time is valuable, so why waste it?  A little bit of planning can alleviate most of the issues and produce a positive training event and an experience that will gain you esteem and compliments from your peers.  Fortunately this is no secret and the steps are easy:

Step 1 – Establish Training Goals

What are you trying to teach?  Often people hold exercises for the simple reason that “it was scheduled” and then improvise the exercise design and content.  Mistake!  If you haven’t checked, first why not see if your organization has some training goals.  If you are fortunate, there will be clear training goals set out, complete with measureable objectives.  For instance, you may be working up toward next year’s TOPOFF exercise and your organization (or your superior organization) may have a plan to that end.  Work with it!  If there is no plan, then it is up to you.  Why not do a little research and find out what your organization is bad at doing and design an exercise to improve that.  Even if your organization works great together, why not stretch things and make the goal to work better with other organizations.  This leads in to the next point – establishing your training audience.

Step 2 – Determine the Training Audience

Who needs the training?  Everyone should undergo training, but you need to focus your training to a particular audience to provide the best benefit.  What I often do is divide the group of people to be trained into two groups – the Primary Training Audience, which is the small group that we are designing the training SPECIFICALLY for, and the Secondary Training Audience, who is everyone else who is attending the training event, but who are not the specific focus of the training.  What this does is add laser-sharp focus to your goals and objectives.  It either improves training for the Primary Training Audience, in which case it is necessary, or it improves training for the Secondary Training Audience, in which case it is non-essential and would ONLY be included if it DOES NOT impact the training or resources going toward the Primary Training Audience.  This seems harsh, but trust me, it is the ONLY way to separate the wheat from the chaff.  The good ideas (the ones that support the Primary Training Audience) get included and the well-intentioned, last minute, good but not great ideas don’t end up impacting the event.  If you are Draconian in disallowing stuff that detracts from or does not add to the Primary Training Audience’s training, then you WILL have a good training event. 

Step 3 – Hold an Initial Planning Meeting (at least two months before the event!)

The best training is a group effort with well-motivated and involved people who believe in what they are doing.  You need to invite the right group to the Initial Planning Meeting, and this means doing some research.  Who can you rely upon to complete tasks?  You need some “do-ers”.   Who needs “buy-in”?  In many cases you are going to have to forge together a number of working groups of people who, in the worst case, don’t want to work with you and are too busy.  The best case is that they want to help you and have some time to help you.  Plan for the worst, and hope for the best and you will do well. 
In preparation for the meeting, you should publish an agenda ahead of time to the agencies or groups who will be attending, monitoring and assisting with the exercise.  You need buy-in from everyone, so you might as well state it up front.  You also need to be clear that it is going to be a working meeting, so people who come should be prepared to make decisions on behalf of their department or group and that they will be participating in the planning.  You should publish with your agenda a tentative date or a few dates for the exercise event, as well as the planned participants - the groups, agencies, departments – as well as the overall training goals and objectives.  Solicit feedback prior to the event and try to iron any issues with the basic plan out prior to the planning conference – or else you will waste the whole session deciding what that training objective is or whether or not you are having an exercise at all.  

You should try to get the following out of the Initial Planning Meeting:

  • Exercise Concept and Training Objectives - How long is the exercise?  Where will it be held?  Do the dates work? Break down the training objectives to at least one more level of detail.  You need to know more detail about your goals in order to design the exercise properly.  This is so important that for large exercises this portion is often conducted as its own meeting.
  • Initial Groups of Master Scenario List Injects – what types of informational problems are going to be provided?  These should link directly to training objectives.
  • Basic Scenario Overview – What is the constructive (time and space) side of the exercise going to look like?  What is the emergency (or emergencies) that the participants need to interact with in order to accomplish the training objectives
  •  Outcomes – what is the training going to achieve?  After the training is over can we draw a line directly between the outcomes and the training objectives?
  •  Goals for the Exercise – Perhaps there are one or more goals that the exercise is trying to achieve (over and above the training objectives).  “Establish a working relationship with Department X” or “Involve Agency Y” in training are examples of this.
After you have hammered all of these items out and have some good agreement amongst the participants, you will now see that what lies in front of you is a bunch of work. You probably need or organize the work either as formal committees (with a formal schedule of meetings) or as informal working groups (with a formal schedule of meetings and milestones). The point is that unless it is a very simple exercise or you are a tireless worker with nothing else to do, there is probably more work here than one person can accomplish.  Here are some examples of the working groups needed:

·         Administrative Working Group – working out the details of the venue, feeding, travel, accommodations, administrative instruction, contracting, work parties for setup and teardown (if required), bookings, etc.
·         Scenario Writing Board – the group of people who are going to create the exercise.  What types of subject matter experts are needed?  Where will they come from?  Who will create the Master Scenario List injects?  How will the constructive side of the exercise come together?  Where is the scenario?  How do we find out about which assets will be involved?  All of these details (and more) need to be discussed.
·         Exercise Control Working Group – The exercise control working group is in charge of the overall exercise.  How it all works out in the end is dependent on this group and how they create the overall exercise – Their aim is to ensure the exercise meets the training objectives.  This group is usually small and members sit in on the other working groups.  This group will also be instrumental in choosing the tools to be used and the contractor(s) to be hired for the exercise.
·         Personnel Group – someone needs to coordinate the invitations for other departments and agencies, managing the big wigs who will be attending and their interaction with the exercise, the invitations to the subject matter experts, finding suitable observer/mentors to work with the training audience, and so on.

These groups should set objectives, schedule and milestones and meet as frequently as required to ensure the work is being done.  Often the meeting can be a simple teleconference where the products are shared beforehand and the meeting focuses on any issues with the products and what needs to be done next. 

In the next blog in this series I will focus on the two remaining steps – the Mid Term/Master Scenario Events List Meeting and the Final Planning Meeting.

Keep Training!

Bruce  
Enhanced by Zemanta

Friday, July 2, 2010

Why Simulation is Important for Emergency Responders

A beach after an oil spill.Image via Wikipedia
Calling all Emergency Operations Center (EOC) staff...

When was the last time you had a good exercise that tested your abilities? Was the exercise realistic? What did you learn?

I have seen a number of "bad" exercises. Some of the worst have been tabletop exercises where the participants drink their own "bathwater". Everyone gathers around a table, discusses a scenario, nods their heads for a while and goes home...what does that have to do with reality? I think everyone knows that emergency events fall into two categories - the "USUAL" where it happens every day and people are quite comfortable about dealing with them and "UNUSUAL" where the "fit hits the sham".

Unusual events seem to have these characteristics:
  • Multi-agency response
  • Large risk to life
  • Cross-jurisdictional
  • High potential for loss
  • Outside of "normal" response
So how do we train for these types of events? Everyone is busy, time is at a premium and the "day job" simply gets in the way. So we set aside time to conduct an exercise. As discussed above, an exercise needs to be easy to run, not cost a lot, bring REAL value to the training and not take a lot of time.

Live exercises are good, but they cost a lot, take a lot of time and you can't run them realistically because there are limits to what you can do in training. I think that live exercises alway need to be run, but perhaps only occasionally (once every other year) to PROVE that everyone knows their job during unusual events.

Tabletop exercises are cheap and easy to run, but provide poor training. Sure it is better than nothing, but no-one is ever certain that the decisions that are agreed upon around the table are the right decisions. We rely on subject matter experts who attend the tabletop to tell us that the decisions we made were right...but they don't really know, other than through their experience, which won't cover every situation.

If we look next door at the military, they train all the time with simulation tools and have been doing so for years. Here is why they use simulation:
  • Live exercises cost too much and are hard to run
  • Tabletop exercises don't provide quality training
  • Simulation gives training flexibility to practice nearly any eventuality
  • Good simulation tools teach good lessons
Any of this sound familiar? So why is it that the Emergency Response/Public Safety is slow to embrace these technologies. I think we believe we are too busy doing the "USUAL" to worry about the "UNUSUAL", and that if we talk about the "UNUSUAL" once a year or so at a tabletop, that is "good enough".

The problem is that the UNUSUAL always comes back to bite you, and the bite may include loss of life, loss of property, slow response or ineffective response. Look at the hatred that British Petroleum (BP) has garnered in the Gulf of Mexico oil spill. They were just doing the USUAL - they had a cut and paste emergency response plan, they went through the motions, attended the safety briefings, etc.. The problem is that the public demands better...for the same price...without spending any extra time.

How do we do more with the same resources? CONSTRUCTIVE SIMULATION may be part of that solution.

Constructive Simulation is different from first person simulators where you look at the computer screen and see the world in 3D. Instead, you typically see a top-down map of the area and vehicles and persons responding to the event, just like a 911 operator with a map.

Constructive simulations usually allow you to run events that are much more complex and difficult than a live event...AND they provide feedback for decision makers. If someone wants to move fire trucks from a mutual aid partner to the disaster location, these trucks take the same amount of time to move from X to Y as the real trucks. Miracles don't happen. Responses get tested and feedback is provided so that everyone can learn from their mistakes.

Constructive simulations aren't perfect - a computer program is not going to solve all of your emergency response issues. All constructive simulation will do is take a group of effective individuals and their equipment and teach them to work more effectively as a team.

In the next bog, I will describe how a constructive exercise works...

Look forward to your comments!

Bruce
Enhanced by Zemanta