Telling Ain’t Training – Pt 3: Training the Right Way

Overview

The first two posts in this series talk about what we generally encounter as trainers – what we might define as failures in ourselves or our learners. I also cover a few techniques you can quickly in implement for existing trainings or those instances when you need to supplement content. This chapter and post focus on building the correct foundation to avoid those altogether.
Take a moment to consider the quote above.
What does it mean? In essence, there are a set of guidelines that allow us to build effective trainings independent of the learning styles of participants. Let’s take a look at what they are.

Six Guidelines for Creating Successful Trainings

The Why We’ve talked about this quite a few times but it bears repeating. Learners need to know why they’re learning the content. If he/she/they places high value on the training and content, they are more likely to engage and retain information.
The What Do you know what you’re teaching? Can you articulate this what using specific learning objectives? They should be listed on the course description. Maybe on the syllabus or in the classroom. This sets of end goal for you and your learners.
The Structure “Humans seek order (pg 75)” is something I have come to realize working in operations and even more so as an educator. Order allows participants to quickly grasp patterns as well as connect previously held knowledge to newly-learned information.
The Response How do you plan to add interactions your sessions? Response refers to the way in which learner’s respond to learning the content you’re presenting. According to research, as well as Stolovitch and Keeps, this can take the form of “answering a question filling in a blank labeling something solving a problem making a decision or even discussing and arguing (pg 76)”.
The Feedback Feedback is information that learners receive about how on or off target they are. It comes from the facilitator or instructor, or from other environmental components (e.g. think about a chemical reaction during a science experiment or a red ‘x’ or green check mark during an online quiz). Research indicates that feedback should be immediately relevant to the task. Personal criticism, perceived or otherwise, decreases performance. Additionally, it should also be timely frequent and specific.
The Reward What does the learner get for successfully completing a task? Rewards work the same way as they did in childhood; they motivate learners to continue a desired behavior. The actual reward will vary but as long as a reward is perceived as valuable to the learner it will be a successful tool for a motivation

 

Telling Ain’t Training – Pt 2: Blame Isn’t the Solution

You’re Really Good at That! (Or How You Become a Trainer)

When I took my first position as a trainer over 10 years ago, I had no idea how complex it would be. In hindsight I can see how ill-prepared I was to create meaningful trainings. This isn’t to say they were terrible or ineffective, or that I wasn’t good at my job. It does mean that I had a lot to learn. Like many of you, my first job as a trainer resulted from being identified as an ‘expert’ in what I did. The criteria for this varies, but in most cases, your manager is impressed by the work you’re doing or you’ve been doing it so long that you know all the ins and outs of a system, process or business. In some industries you’re called a subject matter expert (SME). In others, your title might include Lead, Head or another similar attribute. These are words that signal that you’re well-versed in your craft. By being labeled any of these, you’ve been selected to pass your knowledge and methods on to the ‘next generation’ or maybe even your peers.

I’m Good at My Job, I Swear

You’re excited and you have tons of ideas, tips and tricks to share. You sit down and think about all of the things that make you good at your job. The final outcome is a training outline or version 1 of a training manual. Armed with your knowledge and any class resources you’ve put together, you deliver your first training session and…you bomb.
Your audience is confused, you’re frustrated and everyone is resentful of what they perceive as time wasted.
You take a moment to reflect, attempting to figure out what went wrong. I’ve been there, believe me. In these situations, our minds can start to use blame as a way to rationalize everything.
Maybe I’m not that good at my job or perhaps Simon just wasn’t trying hard enough. Our brains lead us to believe that somewhere along the lines, someone messed up.
This isn’t entirely untrue, but it assumes that the failure was a result of a person, rather than a system. If we remove you (the person) and the learners as the root cause of the failure, then you are left with content and delivery. Let’s start by looking at the three critical components of communication when designed a training.

Where’s the Breakdown?

The first two, defined by Stolovitch and Keeps as declarative and procedural knowledge, constitute the majority of your content. The third is the idea of Adult Learning principles and it deals with how you choose to relay those first two components to your audience.
  • Procedural: You process customer returns everyday for 2 years. It’s second nature to key in code 555 in order to bypass the three standard welcome screens. It takes nothing at all to complete the entire logging and refund event in 3 minutes. This is procedural knowledge. You can think of it as all of the manual tasks you can complete without thinking about it. For me, a good example is knitting a washcloth.

Take a moment and think about a task that you can do without putting too much thought into it. This excludes things like breathing and blinking!

  • Declarative: Now if I asked you to talk me through, how accurate do you think your first try will be? How long to do you think it will take you to describe it so that I can replicate the process flawlessly? The is called declarative knowledge.
Many experts (like you and me) rely on procedural knowledge to do our jobs. Translating procedural knowledge into declarative knowledge often breaks down, which can lead to that familiar feeling of failure for both parties.
To further complicate this, in trying to teach others to work the way that we work, we sometimes forget that adults have their own feelings and experiences related to learning new things. We can’t just say ‘do it exactly this’ and not expect push back, especially from those who have already done the job before.

 How Can I Improve My Trainings?

  • According to the authors of Telling Ain’t Training, an effective way to set the stage for your trainings is to address positive and negative experiences related to the topic at the start of the session. This will:
    • Diffuse a situation by acknowledging past experiences of the participants and
    • Allow you to gauge what participants know and how they approach problem solving.
  • Establish the why and how of the trainings. As discussed in other posts, relevance is extremely important to adult learners. They need to know why they are learning this content and how it can be immediately applied to make their jobs easier and/or more efficient. You also want to discuss how they’ll be learning to do these things.
  • Here’s where the Adult Learning Principles come in:
    • Integrate real world scenarios as a way to demonstrate practical application to your learners. This also allows them to participate and share their experiences in similar situations.
    • Include a resource list that participants can refer back to. This can include detailed (or simplified!) explanations of content covered during the course, or further reading related to the topic.
    • Consider Task Mapping – During an Instructional Design course I took in graduate school, I chose to create a training for managers based on their job description. The posting included things like ‘budgeting’ but because many people are promoted into the position, it’s not an inherent skill. By task mapping, I was able to uncover assumed prerequisite knowledge and build from that level before moving onto budgeting; for example, an understanding of financial terminology, a intermediate grasp of Excel and formulas and understanding of profit margins.

The next time you design a training, clearly define what you need to teach your learners and then use the suggestions above to decide how you’re going to do it. Throughout the process, be conscious of what you’re doing vs what you’re saying when outlining or developing content. Read it out loud to yourself and, if possible, ask someone else (a non-SME) to follow along. If they can’t, rework the areas where they get stuck until you have a resource that is thorough but easy to understand and follow along.

Stay tuned for my next post which explores the best ways to build a strong foundation for all your training needs!

Program Evaluation in Adult Learning Environments

A Little About this Project

Although this case study focused on my role and the product my company was selling, the key components of evaluation remain the same. As you read through this article, consider how you currently evaluate success in your role and in your company. How does it compare to what is discussed below? How robust is the evaluation process at your company? Is there any room for improvement? Ready, let’s start!

Evaluation – Defining Anticipated Outcomes

The evaluation is possibly the most critical aspect of running a program. Because not all problems can be adequately addressed while a program is running, it is imperative that an evaluation process is built into the creation of any program, regardless of the length. This allows you to gather participant data that’s outside the scope of personal success and instead gather data on other equally important components of what makes a program successful. Soliciting this information during or after a course allows program stakeholders to revisit their initial assumptions about what the course or program should accomplish and what it takes to reach those goals. By committing to the creation and implementation of an evaluation plan, you are committing to the continued success of your program.

Philosophy of Evaluation

Whereas assessments should focus on the role of the instructors in ensuring student success, the evaluation should be thought of in terms of gauging program health. The in-class assessments let us know if participants are grasping content and if not, what we can do to adjust our approach. There are other aspects, such as whether the program meets participant expectations, that are not captured through project rubrics or other classroom assessment techniques. This is where the concept of evaluation comes in.

Once complete, it’s important to review the program in its entirety to discover whether the program has served its purpose, whether there are areas of improvement that can be addressed prior to the start of the next program run and whether the program, in its current iteration, provides value to stakeholders. To do this, evaluations need to be:

  • Objective: You, the instructional designer, facilitator or other stakeholder, have invested a substantial amount of time in developing this program. It may be hard to hear that it’s not working the way it’s supposed to. It’s important that fear not keep you from asking those hard, direct and neutral (non-leading) questions.
  • Actionable:Regardless of the way it is collected, evaluation data must be actionable. At times, we may fall into the trap of asking participants completely subjective questions that do not have clear action items associated. Conversely, asking objective questions that only allow for a yes or no may not give you any useful data around suggested improvements.
  • Targeted: Know what you’re evaluating ahead of time and why. While you may be tempted to ask participants how they felt about the location of the school, unless you have the ability to change that, it may be a waste of time – yours and the participant’s – to include it. Questions related to program goals, instructional quality, course content and overall satisfaction all fall under the category of things your stakeholders will want to know. A rule of thumb is to determine key health metrics at the outset of the program and ask questions that speak to those items.

Which aspects of the program are being evaluated and how?

As discussed, what you intend to evaluate should be established prior to the start of the program. This is especially crucial if this is a pilot, as it is likely that there will be areas requiring immediate refinement. For this course, four core areas were identified. In order to determine whether this course was effective, we will evaluate whether participants:

  • Are learning what we expect them to learn
  • Believe the content is delivered in a way that is accessible and easy to understand
  • Can make clear connections between the content they are learning and the content’s relevance to their everyday lives and,
  • Would recommend this program, including the setup, content and instructors, in the future

Feedback will be collected via exit tickets (surveys), administered by the instructor at the end of each session. These surveys will consist of four questions. The exit tickets are meant to be a section by section snapshots evaluating the immediate impact of the course. At the completion of the course, a more comprehensive end-of-course survey will be administered.

Sample Evaluation #1 – Exit Tickets

Purpose Evaluate the quality of content and instruction at the end of each session
Deliverable Survey (hosted in Google docs) – the same form is used throughout the course, differentiated by the submission date.
Questions
  1. In one sentence, summarize the most important concept you learned today (Open text)
  2. The material covered during this session is immediately applicable to my job (Likert scale)
  3. The material covered during this session was presented in a clear and approachable manner (Likert scale)
  4. Is there anything else you’d like to add? (Open text)

Sample Evaluation #2 – End of Course Survey

Purpose Evaluated the quality of content and instruction of the overall program
Deliverable Survey (hosted in Google docs)
Questions Overall Experience

  1. Would you recommend this course to a friend of colleague? (NPS)
  2. What is the most important reason you gave us that score?

Content

  1. The material covered throughout this course met my expectations (Likert Scale)
  2. The material covered throughout this course was relevant to my job (Likert Scale)
  3. The material covered throughout this course is immediately applicable (Likert Scale)
  4. I understood what the requirements were for all of my assignments (Likert Scale)
  5. Is there anything you’d like us to know about the content? (Open text)

Delivery

  1. The instructor presented in a way that made the material easy to understand (Likert Scale)
  2. The instructor provided meaningful feedback (Likert Scale)
  3. I had the tools and resources I needed to participate in class and complete assignments (Likert Scale)
  4. Is there anything you’d like us know about the delivery (Open text)

 

What happens to the data?

During the Course

During the course, data collected from the exit tickets will evaluate whether the content is relevant and immediately applicable for participants. In addition, it will evaluate delivery techniques and allow program facilitators to provide supplemental materials in areas where the content is lacking. In the event that the issue lies with instruction, alternative methods can be explored, including but not limited to the introduction of blended or self-directed learning tools, additional AV equipment or even a change of venue. The purpose of the evaluations at the end of session and end-of-course is to cover as many modifiable external components as possible and establish a plan of action to be implemented during the current cohort or for the next.

After the Course

All data will be aggregated in an Excel file and used to create a dashboard that identifies trends, weaknesses and strengths of the program. The exit tickets and end-of-course survey responses will be coded and categorized into Content, Delivery, Tools and Environment and then into stages based on the length of time it will take to implement. Quantitative and qualitative data will be used to drive decisions around revising content and/or delivery methods and whether any additional financial investments will need to be made for tools or program development. Finally, data collected will inform what kind of training, if any, would benefit the instructor based on feedback around delivery. A timeline will be established for all improvements and the changes will be communicated to stakeholders, as well as future and former participants.

 

Community Spotlight: Grace Institute

Introduction

Grace Institute is a non-profit organization that has provide job readiness training to women for more than one hundred years. Originally a school run by nuns, the agency has since transitioned into a workforce development program geared towards the current job market. The program is tuition free but requires a 20 week commitment, Monday through Friday from 9:00am to 4:00pm.

Participants receive training in 4 core components and spend the remaining time interacting with industry professionals who volunteer their time. The women in this program are from all walks of life – some had full times for 30 years and were suddenly laid off with no plans for the future. Some of the participants are underemployed and want to find a career, rather than a job.

It’s important to note that Grace Institute focuses on job and career fit over placement. As such, they teach participants self-evaluation and reflection. Volunteers from partner corporations come in to speak to them, both to give them an idea of where their skills can take them, but also to open up new thoughts on career paths. In institute also places strong emphasis on adult learning strategy, structuring the environment and classrooms to incorporate collaborative learning, open dialogue and critical thinking.

Agency Overview

Grace Institute was founded by W.R. Grace, an Irish immigrant, in 1897. When he began running his business, he employed many immigrants. The wives, sisters and daughters of these employees generally lacked the skills to compete in the job market. The institute was created to provide workplace skills for these women. Originally run by nuns, the organization has always been geared towards practical skills – in the early 1900s, this was sewing, cooking and other domestic tasks. As the marketplace changed, so did the course offerings.

Grace institute is focused first and foremost on providing immediately applicable job skills to women in need. The courses cover both hard and soft skills with the intention of helping women find long term and fulfilling careers.

Formerly a school, the agency has made a conscious shift towards being recognized as a workforce development program. As part of this shift, the attendees are known as participants instead of students. The program itself is run as a business casual corporate environment – from the clothing, to the settings to the fact that the women clock in every morning, all in preparation for working in a professional setting. One of the participants described it as a “completely holistic approach”.

Changing with the Times

Up until this year, the 136 participants were split across 4 sections, all receiving the following 4 classes; Business Writing and Communication, Office Technology, Keyboarding, and Professional Development.  The necessity and set up of each course is continually evaluated to determine whether the skills are still relevant in the current job market. At the moment, Grace Institute is implementing Salesforce to track job placement and retention among alumni. They intend to use that data to modify current courses or develop new ones. This year, the agency began a pilot program in one of the 4 sections to prepare selected participants for the role of Patient Services Representative (PSR) in the Healthcare field. By evaluating the job market, the Directors determined that there was potential for better job placement by focusing training to meet the needs of this field. To join the PSR section, current participants must sit through an application and interview process, much like when they were first admitted to the program.

The institute is tuition free, save for a $75.00 registration fee and a $75.00 books/technology and materials fee. There is a strict admissions process to ensure that the women that are accepted will be committed to successfully completing the program. Grace Institute is a non-profit that does not receive any government funding. To remain tuition free, the Grace family accumulated a sizable endowment which is now approximately $30 million dollars. Until 2012, the organization was pulling 100% of its operating costs from this. Since then, they have hired Jessica James, Director of Development, to cultivate relationships with business and procure grants from organizations such as The Robinhood Foundation, The Pinkerton Foundation and The Blackstone Group. Additional funding and support comes from corporate partners. These businesses provide volunteers who come in to teach business skills or discuss their path to success. They’ve even had members from Google come in for a day long team building exercise that taught IT skills to the participants. Recently, the agency received a $100,000.00 donation from American Security that financed a new computer lab, including approximately 100 computers. The hope in building these relationships is to raise donations, provide industry insight to participants and allow networking opportunities that may lead to employment opportunities. Last year, Macy’s place 25% of their graduates in Merchandising roles.

Instructional Overview

The tour was led by the Director of Development, Jessica and two participants on the path to graduation. These women, Tolou and Rose, were passionate about the program and effusive in sharing the impact it had has had on their lives. There were also two representatives from another organization, ParentJob.net, who were touring Grace Institute in hopes of establishing a partnership.

Walking into the classrooms, it’s easy to see that these are all mature, professional and dedicated women. Even without an instructor, they are all working on something, no one is on their phones and they were immediately engaged when we walked into the room. Rose and Tolou were eager to talk about the projects they’ve been working on and there were examples of collaborative learning projects on every wall.

The women is this program generally range from 18 to 65 in age. Previously, one of the 4 sections was comprised of all young adults, who make up about 30% of attendees. With the addition of the PSR section, that group has been integrated into the other sections, increasing the diversity of age across the remaining groups. Regardless of section, all participants take the same core classes together. Age, race, language and past work experience vary greatly and has very little bearing on placement. There are lawyers, teachers, stay at home moms, and accountants. Some of the participants are fresh out of high school. Some, like Rose, have been employed for 26 years but were unhappy, and some, like Tolou, had been out of the job market for over 10 years and found that her skills were sorely outdated.

While we stopped into a few different classrooms, only one of them was in session and we were unable to speak to the instructors. We observed the first day of the PSR course, which was an overview of what the field and the position were. Once completed, PSR-track participants should be fully equipped to provide customer care in settings such as hospitals, urgent cares centers, and medical offices. Grace Institute is partnered with Weil-Cornell, LIU, and New York Presbyterian and has recently partnered with CityMD for job placement.

Based on the conversations prior to the classroom tours, I was surprised to see the instructor using a PowerPoint presentation to deliver initial information. The first slide we were shown was a diagram of all the tasks associated with someone in a PSR role. She briefly went over the content while participants took notes, but there wasn’t any open dialogue or question/response that would get participants actively involved.  Although she related the information to herself by saying, “At my core, I am a PSR and I have PSR duties”, she didn’t elaborate further or provide any personal details about the job she does. However, we only observed the lesson for a few minutes, so I cannot fully evaluate the facilitation method.

The course that I found interesting, and that the participants said they found most valuable, was the Professional Development course. Tolou and Rose spoke passionately about how it affected their way of perceiving themselves, others and the world around them. It’s unfortunate that we weren’t able to observe it as I think it would provide a better representation of the agency’s prescribed method of teaching adult learners. Below, I briefly detail some of the more interesting aspects of the 2 of the courses and how they are taught.

  • Keyboarding – This class is taken in a group setting but it is differentiated per learner. A typing test is given at the beginning of the program to determine the participant’s average typing speed (WPM). A goal is then set to add 15 WPM to that initial number, i.e if you began at 40 WPM, by the end of the program, you should be at 65 WPM. Participants use a software that gauges where they are and then helps them to reach their goal. This allows students to go at their own pace, eliminating frustration and undue competition.
  • Professional Development – This class provides many soft skills needed in the workplace but rarely discussed. They cover etiquette, verbal and non-verbal communication, self-confidence, and cultivating your business persona. To prepare for job searching at the end of the program, participants engaged in a mock interview with 45 volunteers from different companies, who provided them with valuable feedback.

In terms of participant evaluations, every class provides tests, and at least 2 progress reports. Technology courses also use ProveIt.com to assess progress. There are two full time social workers on staff to provide counseling to participants who are struggling either in the program or in their personal life. If it is determined that she won’t be able to complete the program, she is counseled out. The average program completion rate is 75%, with last year exceeding that at 87%. Their processes seem to work – 80% of their graduates are place within 1 year.

Closing Thoughts

This visit left me extremely impressed with Grace Institute and what they have accomplished. They have been in operation for over 100 years and they have evolved to continue their mission in an ever changing world. It isn’t easy to balance providing a much needed service to communities and operate as a business, but they do it well. I think this starts with their mission as a workforce development program and their admissions process. From the very beginning, participants are given an orientation. If they apply, they can expect to be interviewed, take aptitude exams, pass the TABE test and be evaluated for risk factors to determine if this is the best time and/or fit for them. If an applicant is not admitted, they are referred to other agencies that provide similar services. While they can’t accept everyone, they provide motivation and resources to anyone who comes to their doors.

The other take away for me was the level of support provided by the staff and fellow participants. I have been very interested in building positive and open learning environments and that feeling is prevalent at Grace Institute. There’s a floor to ceiling whiteboard in the halls where participants write motivating messages to each other. Every Friday they have something called Friday Forum where they watch TedTalks, discuss their growth and ask questions. Every Tuesday and Thursday, they have something called ‘Food For Thought’, wherein a corporate volunteer visits to give insight into his/her field. There are open computer labs, free periods to catch up on work, and a community center to catch up with fellow participants. The women here are treated like adults in a working environment and, regardless of their background, their experiences and opinions hold value and are respected by everyone in the organization. So many of the things I witnessed have already gone in my toolbox and the visit has introduced me to a completely new way to approach workforce development.

Exploring Diversity to Engage in Meaningful Conversation

Diversity is more than a word; it’s a conversation. It requires definition, context, perspective. It has been applied to groups, to initiatives, to companies, to food, to ecosystems. Diversity can and does mean so many different things that in this day and social media age, it’s all but a prerequisite to unpack the term before you can ever begin talking about it.

I took a multi-culture and diversity course while completing my graduate degree. The first assignment consisted of completing a 2 sided diversity wheel that asked about you as a person and you as a construct. I know, I know, but stick with me. We were paired randomly with a partner and then asked to share as much as we felt comfortable sharing. At the end, we wrote brief introductions of our partner and shared it with the rest of the class.

I learned a few things about myself, things that I’ll likely discuss in another in-depth post. More importantly, I learned a great deal about the assumptions that are made when talking to other human beings. For example, by some accounts, our species is all we have in common. By others, looking alike is all it takes to be alike.

As a member of my company’s ERG program, I was finding it difficult to get real, deep, and frankly uncomfortable, conversation going. We were going in circles, talking about ‘us’ as women, as one homogeneous group that shares the same experiences. To some degree, that’s the truth. I’ve been cat-called, I’ve been judged for my gender, I’ve been challenged because of it. I also know, however, that my experience as a woman of color, as a person who is on a different education or career track, as someone who grew up in NYC, means that I don’t necessarily share the same perspective as the woman sitting next to me. This doesn’t make one of us better than the other but ignoring these differences can divide us.

Below is a workshop I delivered in a small group setting. I’ve expanded the initial exercise to open up conversations about what diversity and culture are, as well as to have participants identify their own knowledge gaps and look for ways to further explore them.

Understanding Your Learner

This is the first in a series building on the core concepts explored in Telling Ain’t Training. Click here to read the rest of the series.

Understanding Your Learner – What’s Your Approach?

When designing trainings, how often have you considered the learner? And in what capacity? Do you think about your delivery method? What about the classroom environment? A dozen things might go through your mind as you work off of your mental checklist. Before we get there let’s take a moment to think a little differently about what training means and align on what it should accomplish.

Telling Ain’t Training starts with a few key points centered around understanding your learners before they even step foot into your classroom, chief among them the tenant that we should be building trainings for the needs of the learners; investigating their roles, responsibilities and prior experience in order to build content that’s meaningful and relevant for them.

What Do You Want to Accomplish?

According to the authors, what we do falls into three categories:

  • Training – Is the goal to teach participants how to complete a step-by-step task?
  • Instruction – Is the goal to teach participants how to react in a situation with one or more variables?
  • Education – A culmination of life experiences and learning principles that go beyond reproducing or inferring; the road to expertise.
The purpose of training, instruction and education is to transform the learner, not transmit data. We want the learner to be able to apply what has been communicated and not just repeat it back.

Find Your Center of Focus

There’s a maxim repeated at the beginning of the book – educators must be “learner centered, performance based.” This encompasses not just your delivery but also the content you build, where you build it, and how you interact with participants. Lose sight of this and you risk losing your credibility and your learner’s interest and respect.

Learner Centered Means Adapting

How we learn is part of our genetic make up. Garden’s Theory of Multiple Intelligences tells us that we need to negotiate different senses and learning types in order to really make teachings stick. The question is how to cater to an audience you’ve never met. Educators can take advantage of what we know about the human body to build flexible courses that are designed to engage different types of learners.

Think About It!

Humans can store massive amounts of data. The issue lies in retrieving it. Assuming that it’s relevant to the learner, then organization is the key. Consider the acronym PEMDAS and the mnemonics My Very Educated Mother Just Served Us Nine Pizzas. Can you remember what they mean? If the answer is yes, when was the last time you needed to use that information? Chances are you haven’t consciously thought about either in a long time but the information still lives on. That’s the power of organization coupled with effective teaching and the human brain.

This, of course, doesn’t mean the classes where we learned these pieces of info were perfect but rather that someone stumbled upon a great memory technique that may or may not have translated into other parts of the curriculum. For example, I can’t readily recall most of what I learned in Earth Science but I vividly remember Algebra. The teacher included hands on and group activities, employed a reward system and used visuals and audio cues to draw connections between prior knowledge and newer, more complex pieces of information.

Put it in practice!

Make a list of ways you can engage your audience. Include exercises and content that appeal to the following:
  • Musical-rhythmic and harmonic.
  • Visual-spatial.
  • Verbal-linguistic.
  • Logical-mathematical.
  • Bodily-kinesthetic

Using Inter-team Collaborations to Promote Critical Thinking Skills

This is part of a 3-part series focusing on applying adult learning theory in the workplace. To see the other articles, view A Brief Intro to Adult Learning Theory and Self Directed Learning as a Training Solution

Current Problem

Teams across 15 campuses are finding it increasingly difficult to track information and share it with the stakeholders. In addition, there is a lack of standardization in the way programs are run, further complicating alignment and adoption of initiatives to solve this problem.

Proposed Solution

Many of these conversations have started with ‘we can’t’ or ‘we don’t’. We can’t change this system or we don’t use this method. I usually ask probing questions to get to the bottom of these opinions. Is the ‘can’t’ related to something tangible? Is the ‘don’t’ due to a lack of structure or something else? Until a problem can be broken down into it’s smallest parts, a holistic fix cannot be created. Asking teams to think critically about their current processes will force all parties to honestly evaluate the problems they face. I highly recommend using this list of Socratic Questions to get past the surface issues. Much like the worksheet found at the bottom of this page, you can create an evaluation worksheet asking similar guiding questions to reach a conclusion.

Why Promote Critical Thinking?

Human beings draw conclusions from past experience – personal or otherwise. We can become entrenched in views because we have had positive and negative experiences that influence what we think will happen. Perhaps we’ve were involved in an unpleasant outcome related to group work that prevents us from trying something new. Conversely, maybe we heard of a new technology and we want in on it because everyone else is raving about it. Either way, it’s necessary to break down and evaluate this feelings or instincts in order to make logical and well informed decisions. Even if they result is less than stellar, you have begun a process of evaluation that allows you to continue build until you reach success.

What Does it Look Like?

Start by creating a list of specific issues that your team is trying to tackle. If you are a manager, create your own and allow teams to do the same. For each issue, have team members brainstorm about the root causes and 2-3 possible solutions.  You can have participants fill out the worksheet to the right, use the template at the bottom of this page, or create your own.

It is unlikely that everyone will have the same answers, or answers that get to the bottom of the problem. Ask team members to share their view of the problem then use Socratic Questions to whittle it down to it’s simplest form. This might look something like this:

Stated Problem: There aren’t enough people or resources available to complete this project

Follow Up Questions

  • Can you give me an example of a time when this was apparent?
  • Can you describe the scope of the project? In what ways can we leverage the strengths of you and your team members to solve this problem?
  • How can we look at this another way?
Do the same for each section of the worksheet until there is a clear idea of what actionable steps can be taken to begin to solve the issue.

Once that has happened, have teams pair off with members of other teams to get feedback on how they handled similar situations. The idea is to have fresh perspectives challenge existing perceptions and require the problem solvers to re-evaluate, explain and if necessary, defend their beliefs and next course of action.

Will this work for me?

  • There is a question or issue that requires deeper exploration in order to resolve
  • You are looking to engage your audience and get them involved through intellectual contributions
  • You  need to change long held thoughts or processes but are facing resistance (change management)
  • You want to empower your audience to go beyond surface knowledge and use their skills and experience to develop their own ideas

Want to try it out? Use this PDF template to build a framework for applying any adult learning strategy to your current work.

A Brief Intro to Adult Learning Theory

There’s a lot of info about learning theory in the early years, but what about for adults?

That’s the first question every adult educator should start with. Unlike K-12 education, there aren’t strict governing bodies that inform every decision made in adult education. Instead, our community depends on years of independent and industry research as the basis for our practice. This means that there isn’t just one, or two, or even three ways in which we believe adults learn. In fact, on a whole, facilitators of adult education haven’t entirely agreed on what that term actually means. They have agreed, however, that a few key concepts are consistent when teaching adult learners.

Adult learners are looking for:

Can you break that down for me?

Of course! We’ll go piece by piece so that you can get an idea of how these seemingly simple components come together to form the complex field of adult education. Before we continue, remember that no one component is inherently more important than the other and there a billion other factors that determine why a student showed up to your class. Also, keep in mind that each learning situation is based on the circumstances and abilities of the instructor, the learners and the environment in which you teach.

Relevance of Content

Do you remember sitting in pre-calculus and desperately wondering why you were learning it? What’s the likelihood using advanced math in your everyday life? It didn’t really matter because someone decided you needed to learn it and so you did. Or I assume you tried to. If you’re like me, you didn’t retain anything after algebra because it held no relevance to you.

There are so many reasons someone shows up to your classroom; job mandated training, skill building for employment, individual pursuit of knowledge. Regardless of what got them there, your students are looking to learn something that means something. It’s important for you, as an educator, to identify that reason in order to ensure the success of your students.

Immediately Applicable Skills

Skills don’t always have to be manual, but for most adult learners, they do need to be immediately applicable. That means that what you teach today should be translatable to what your student does tomorrow.

Regardless of your audience, your content should aim to teach practical skills or knowledge in a way that is easy to relate to. Learners should know why they are being taught the content and how they can expect it to help them in their personal or professional lives.

Involvement in the Process

The most prevalent classroom structure in K-12 is teacher as leader. This means that the teacher, or person at the front of the room, makes all decisions about what and how content is learned. This can lead to passive learning, in which your audience only learns what you teach them with no consideration for their own interests, strengths or preferences.

Involvement level can vary based on any number of factors;  subject matter, government guidelines, time constraints, program structure and audience composition are just a few. Although it may initially sound challenging, there are simple ways to get everyone involved and invested in what is being taught. Having your learners share what they want to learn during the course or what projects they would like to work on, and then integrating that feedback into your lesson are just to examples of how this could work.

Acknowledgement and Inclusion of Prior Experience

One major difference between K-12 and adult education is that children are assumed to have no prior experience to build upon. This is not the case with adults, as discussed by Paulo Friere and to some extent, John Dewey.

The model of ‘educational banking’ does not translate well to higher education because adults are not empty vessels. They carry with them many years a experiences that shape the way they view the world and approach every situation. In order to keep them engaged, it’s important for educators to acknowledge this fact and look for ways to incorporate those experiences into the lesson. Asking learners to apply what they are currently learning to past experiences is an easy way to include student experiences in the classroom and help them understand the value of the content being taught.

Flexibility in the Way Content is Taught

We’re all familiar with the saying ‘one size doesn’t fit all’. That same idea applies to education. Although your learners need to learn the same content, it is unlikely that everyone will learn the same way at the same speed. There are several theories that address this including Gardner’s Theory of Multiple Intelligences, McClusky’s Theory of Margin and work done by Malcolm Knowles.

Although we have the benefit of technology, finding a video on Youtube or a link through Google does not guarantee learning. When we talk about the way content is taught, consider whether you are incorporating active learning techniques or content that integrates different learning styles.

This is part of a 3-part series focusing on applying adult learning theory in the workplace. To see the other articles, view Self Directed Learning as a Training Solution   and Using Inter-team Collaborations to Promote Critical Thinking Skills

Self Directed Learning as a Training Solution

Current Problem

Where I currently work, we are finding that our instructors need and crave more targeted professional development. As mentioned in the Methodology section, adults want to know that what they are learning is relevant and has immediate application. If there is something that an instructor needs to know to do his/her job, then it is our responsibility to provide it. As a relatively new company, our resource library is limited and does not necessarily address the different skill gaps of our instructors, nor the levels at which they need to address them. In other words, we aren’t practicing differentiated learning. We are taking a one size fits all approach that leaves some instructors feeling lost and others feeling stagnant.

Proposed Solution

At the very simplest – build a searchable repository of professional development resources and pair this with the observations and assessments that are already happening. Ensure that all instructors across all campuses have access to this database and leverage instructor and employee knowledge to further populate it.

It’s extremely important that the resources you provide are accessible, relevant and accurate. Forgetting these simple guidelines can result in frustration (why do I need to learn this?), confusion (what does this mean/this contradicts something else), and resentment (I have to pay/drive an hour out of my way for this information) from learners.

Why Self Directed Learning?

You’re covering a few bases with this approach, most of which are covered in other parts of this site. Above all else, you are providing adults with actionable and applicable items. They can pursue as little or as much as they want to in order to meet the benchmarks set forth by their managers. They can also choose to expand their knowledge outside of the provided resources and are encouraged to improve their in class practice with the support of their instructional leaders.

In a classroom setting, this can be a useful tool for students who often finish early and crave additional knowledge. Conversely, it’s also a great tool for a student who is having trouble grasping a concept that everyone else has mastered. The missing information may be critical to the student’s success, so it cannot be glanced over. Instead, you can provide articles, textbooks, videos or other resources to allow the student to learn the concept on his/her own.

What it Looks Like

For me, this looks like a centralized web-based system that is managed by the instructional leaders across all campuses. Because this will be used by all instructors and is part of the message and culture of the company, it’s important that the information submitted is vetted and that it aligns with what you want to see in the classroom.

For you, this depends on the systems and process already in place for learning. Do you have a learning management system (LMS) like Canvas, Blackboard, Oracle or Schoology? If you answered yes, there might already be add-ons or functionality that allow you to build resource libraries. You may also be able to create videos, quizzes and other assessments that are specific to the goals of your course.

If you answered no, you can still create a system that ticks those three boxes. If you are working in an offline environment, have a listed of links, books, videos, etc to provide to students. Or, if you have books or articles in the classroom, suggest the student has a look during the break. You can also build a simple website, like this one, to act as an extension of the classroom materials.

How can I make this work for me?

SDL is best used when:

  • There are small or simple tasks the audience needs to know before you can move forward. This is sometimes called pre-work and has been used in as a requirement for trainings and classes.
  • A learner is struggling during class but you are unable to a)spend anymore time on the subject, b) provide the depth of knowledge necessary for understanding or c) adjust the lesson to address his/her preferred learning style.
  • A learner is excelling and requires more stimulus to remain engaged in the lesson.

Community Spotlight: Brooklyn Workforce Innovations

bwi_logo_copyBrooklyn Workforce Innovations isn’t a well-known name here in New York City. There aren’t advertisements on the subway, or anywhere on the streets of Brooklyn. A Google search doesn’t even place them in the top 50 results for NYC workforce centers. Without diligent searching, you’re not likely to come across them at all. It seems that that’s the problem with workforce centers. They provide a much needed service that the public doesn’t know exists.

I met with KenTara John, Program Coordinator for the Brooklyn Networks program at Brooklyn Workforce Innovations (BWI). Having obtained her undergraduate and graduate degree, Ms. John’s story is not an unfamiliar one. Those degrees didn’t get her where she expected. Working in non-profit organizations wasn’t enough to make up for the debt she accumulated and the skills she gained weren’t what she needed to maintain or flourish in the workplace.

During our class discussions, one sentiment became clear – workforce centers exist because college is not the path for everyone. Whether it’s a lack of education, a challenging home life or dissatisfaction with their current jobs, adults turn to workforce centers to help them create opportunities for growth. This is where organizations like Brooklyn Workforce Innovations come in.

 

Organization Overview

The stakeholders vary depending on the funding sources. In general, stakeholders include community based organizations, parole offices, schools, youth programs, substance abuse programs, HR administrators, ex-convicts, unemployed candidates, underemployed candidates, and New York’s Workforce 1 Career Center.

The programs at BWI focus on practical and immediately applicable skills. Unlike a traditional college, their programs culminate in a certification, not a degree. These certifications are transferable, generally opening up access to a broader range of opportunities. One of the motivations of participants is that completing a program at BWI provides you with a skilled trade or as Ms. John explained, “Something someone can’t take away”. The certificate is a tangible and measurable representation of the skills participants learned during the program. BWI’s include:

  • Brooklyn Networks: Which leads to a career in voice and data telecommunications cable installation
  • Red Hook on the Road: Which helps students get their commercial driver’s license (CDL)
  • Brooklyn Woods: A woodworking and fabrication program
  • Made in NY PA Training: Part of NYC’s initiative to cultivate diversity in the film industry
  • NYCHA Resident Training Academy: A sector-focused training program that leads to job placement within local housing developments

Ms. John is the Program Coordinator for the Brooklyn Networks. Spanning six weeks, the program is hosted at New York City College of Technology (CUNY). It’s an installation program that focuses on cabling for network, data and security. Upon completion, participants sit for the BISCI exam, a credentialing exam that tests theoretical and practical components.

Although all of the programs through BWI are practical or technical programs, all curriculum focuses on both hard and soft skills and places equal weight on each. There is a high demand for candidates to demonstrate situational judgement, a skill that has been flagged by employers as missing, even in college graduates.

Participant Demographics and the Selection Process

The screening and selection process for Brooklyn Networks is rigorous.  The selection process consists of multiple steps. The first is an orientation that is held weekly throughout the year. Candidates are required to take the TABE, an exam that gauges math and reading levels. To be eligible for Brooklyn Networks, candidates must be able to pass on an 8th grade level. Approximately half of the candidates fail this exam. They offer retests for those who score between the 5th and 7th grade levels. If they fail that, Ms. John recommends that they take additional courses and then reapply.

The next step is an interview with one of the program staff that asks personal questions about their current situation and the motivations behind joining the program. It’s important that candidates are interested in the field and aren’t just looking for a quick way to make money. There’s a high level of accountability on the participants; they’ll be responsible for completing HW and projects, maintaining consistent attendance, and remaining professional. Ms. John has identified that this as a ‘big risk program’ because many participants have not had this kind of responsibility, especially if they did not complete HS.

If the participants move forward from there, extensive documentation is required by the state and federal government and by some stakeholders. Following that, there is a drug screening. If candidates fail, they aren’t allowed to reapply for one year. The screening is not a surprise. On the contrary, candidates are notified so that they have a chance to get clean before it happens. Once those steps are complete, applicants ‘try out’. They come in on a Monday, go over the details of the program and then attend sample classes on Tuesday and Wednesday. Finally, the director and program instructors evaluate overall performance and interview responses. This committee selects 15 participants and those that are accepted start the next day.

The most interesting portion of this visit was the level of detailed that went into preparing the candidates. The selection process is extremely discerning but there’s a quota to meet, which can affect the way the program is run. However, Ms. John demonstrated true interest and compassion in seeing candidates and participants succeed. Given the background of participants, I believe this can make a world of difference for those who have faced discouragement.

Program Structure and Outcomes

The Brooklyn Networks program is five days a week, from 9-5. There’s an exam every week and 2 to 4 HW assignments each night. The week is structured to include practical and professional skills. There are 3.5 days of lab training and 1.5 days of job readiness training.

Student progress is closely monitored by the instructor, who is responsible for curriculum and homework.

Because of the strict policies, rigorous curriculum and expectation setting, the pass rate for the certification exam is 91%. Unlike course work, the BICSI is graded pass or fail. To ensure that students are prepared above and beyond the requirements of the exam, the level of rigor in the classroom is much higher than what is required.  Upon successful completion of the program, BWI offers job placement assistance for two years. There is also a follow up 60, 90, 180 and 365 days after graduation to gauge candidate success in the field.

Social Impact

Beyond providing job applicable skills, BWI aims to empower participants to aspire to higher levels of personal success. It shows participants that they have the drive and discipline to complete their GED or get a college degree. For others, it’s a way to excel beyond cultural expectations. Ms. John shared a few of these stories, including a female Muslim graduate who was told by her family that she couldn’t complete the program because she’s a woman. She also shared the story of Pete Rosado who said he always wanted to travel the world but ended up in prison, doing traveling of a different kind. In spite of his background, Mr. Rosado graduated and is now Lead Tech at his company.

In addition to the individual impact on the graduates, BWI and other workforce centers have the opportunity to equalize pay within their industries. All graduates from Brooklyn Networks has a starting wage of $12-$13, regardless of gender or race. Employers may have the option to pay more, but they cannot pay any less, which is at odds with how traditional hiring works.

Challenges and Looking Forward

Although BWI has been around for 15 years, they face some common problems. Outreach and recruitment was more robust in 2013 but changes in the economy have affected the number of applicants. In turn, this has impacted the quality of applicants and the program. With no official outreach process, they rely on referrals and word of mouth to source candidates. Other issues include alumni data tracking, getting women to complete the training, student engagement that helps prevent burnout and withdrawals, external dependencies, and lack of reliable record keeping systems. Additionally, attendance is particularly challenging due to the backgrounds of participants. If a student misses enough classes, they will need to leave the program, regardless of the reasons. Students who are counseled out are encourage to reapply once their schedule stabilizes.

Ms. John and I spent time to discussing the struggles associated with tracking student data. Above all else, being able to measure the success of the students during and after the program is the biggest challenge that many training programs face. We swapped stories and ideas about how to improve our current systems and I was surprised to hear that they have no real process for storing records and it is mostly paper based. Given the frequency at which technology is changing, I believe this lack of integration (which was also present when reviewing the outreach process) has the potential to be detrimental to BWI’s programs. For all the work they are doing, further investment in technology and outreach would make a huge difference in program quality and reporting.

Scroll to top