“Searching For Measurement Processes And Best Practices: Key Steps to Building an Effective Diversity Measurement System” Part 1.

 

Measurement Graphic

Building an Effective Diversity ROI Measurement System

Copyright 2017 by Dr. Edward E. Hubbard. All Rights Reserved. President & CEO, Hubbard & Hubbard, Inc.

Although interest in measuring the effects of diversity has been growing, the topic still challenges even the most sophisticated and progressive diversity departments. Diversity Professionals and Practitioners know they must begin to show how diversity is linked to the bottom-line or they will have difficulty maintaining funding, gaining support, and assessing progress. But where do they start? Well, I will weigh in on this topic with a few thoughts in a “two-part” analysis of this dilemma. In this segment (Part One), I will give an overview of a 5 step process to consider and highlight some key background issues. Part Two will detail each step of the 5-step process including possible diversity metrics, formulas, and suggestions.  Although measuring Diversity Return on Investment (DROI®) impact is not an exact science, there are a number of valid techniques, tools and reliable methods for translating business performance gains into tangible financial results that C-Suite executives will support and embrace. Let’s get started by addressing the fundamental question…

Can diversity be measured?

Before we look at what to measure, I’d like to address the concern some practitioners have about the validity of measuring diversity results. Some practitioners seem to believe that quantifiable and quality-based measures cannot be applied to the diversity implementation process or a diverse work culture. Others believe that diversity is not a business-focused activity, simply another form of affirmative action regulatory compliance. However workforce and market place demographics make diversity a business and customer issue, as well as a global competitive issue!

Regardless of the events that led to this conclusion or whether this subjective position is valid or not, the fact that the position exists and that some diversity professionals and other business people support it creates major problems. In particular, it sets managing and leveraging diversity apart from the rest of the organization. While peers in other organizational areas are focusing on metrics that reflect their contribution such as sales, reduced costs, profits, income and expenses, those implementing the diversity process often limit their discussion of diversity’s contribution to increased awareness, improved feelings, and increased satisfaction among work groups. Only a select few really show demonstrated, evidenced-based results of Diversity’s impact on organizational performance.

As a result, diversity is not taken seriously. Fewer managers support it in actual practice, such as, sending their workforce to be trained, using Diversity in potential alternatives to solve business unit and customer problems, etc. Even fewer managers structure their workforce to leverage its richness through teaming, implementing strategic partnerships to penetrate key ethnic customer markets, and so on. We know from current organizational practice that diversity initiatives often experience less management support than other business initiatives.

Hubbard & Hubbard, Inc.’s Seven-Level Diversity ROI Analysis Framework teaches Diversity & Inclusion Professionals how to analyze and build credible Diversity ROI performance solutions grounded in scientific processes and analytics which show a measurable, evidence-based  difference on the organization’s bottom-line. These value-added outcomes are reported showing ratios such as “Benefit-to-Cost”, “Payback Period”, “Diversity Return on Investment”, “Return on Expectations”, and more. Our copyrighted Diversity and Inclusion ROI Sciences® also include at least 10 different methods and “isolation processes” which highlight Diversity and Inclusion’s contribution verses all other contributors to the outcome.

Why is having an isolation technique important? This is necessary because you will often get asked: “How can you prove that it was Diversity and Inclusion that generated the value-added outcome”? A question this question prompts for me, for example, is “How can you prove that it was Sales that generated the revenue increase”? On the Sales side the reality could have simply been a case where three competitors dropped out of the organization’s market and the business gained new customers. The displaced customers were all looking for a new source to supply their needs and the Sales department increased Sales with no real “Sales” effort.

Using Diversity and Inclusion ROI Sciences® allows the C-Suite, the Board, and other stakeholder to appreciate Diversity & Inclusion’s value beyond Representation. The business case for Diversity and Inclusion can be difficult to make when the Diversity & Inclusion organization can’t credibly show there is something on the other side of the “equal” sign demonstrating that it produces real tangible value that is measurable based upon the investment made in D&I.

How Would this Situation Play Out in your Organization??

Suppose the C-Suite announced that Sales are down in key growth markets, operational processes to meet customer expectations have broken down, and three major competitors have gained 40% of the organization’s market share. Question: Would you be prepared to show how utilizing Diversity and Inclusion can help solve these problems or would you say that’s a Sales, Marketing, and/or Operations problem. Would Sales, Marketing, and/or Operations even want your involvement? Would they view your potential Diversity and Inclusion perspective or contribution as “relevant” to solving these problems?

The Diversity ROI and HH Diversity and Inclusion ROI Sciences® methodology can assist Diversity & Inclusion Practitioners with the means to demonstrate their value and address these “real” business issues. The solutions can be addressed with Diversity and Inclusion processes that go well beyond “Representation”. They must show how to drive tangible financial business performance using Diversity and Inclusion strategic methods.  It’s probably a good bet that when Sales, Marketing, and Operations begin to approach the problem, they will have analytics, metrics, and other sciences of their disciplines to offer solutions that can be measured using solid Sales, Marketing, and Operations sciences. Over the last 30 years, Hubbard & Hubbard, Inc. has developed and applied a set of Diversity and Inclusion ROI Sciences® globally in a wide variety of industries with success. We know and have definitive ROI-based evidence that Diversity and Inclusion Practitioners can deliver on this value proposition with the right skill and competency set.

I’m not suggesting that measurement and sciences are the sole solution to Diversity’s acceptance into the corporate landscape. But measurement of results is a useful tool that allows the Diversity Practitioner to talk the language of other managers and top management. Remember Diversity and Inclusion efforts are not conducted in a vacuum. They are part of an organizational system of processes, activities, and events aimed at delivering “value”, “impact” or both.

Building a measurement system 

The creation of an effective Diversity measurement system and “best” practices cannot be a mechanical modeling exercise. It must be preceded by an inspection and utilization of basic business principles. It must focus on organizational and departmental strategic thinking as well as an assessment of business needs, goals, objectives and the desired quality of work-life. Developing the actual measures is easy compared to the amount of time that should be spent thinking about what is important to the organization’s strategic business objectives and the expectations of the Diversity measurement process.

Key steps to building an effective measurement system

Creating an effective Diversity measurement system and process that embodies these concepts involves at least five critical steps:

  • Review the Strategic Business Plan for Needs
  • Formulate Research Questions
  • Design the Study Methodology, Metrics, and Analytics
  • Collect and Analyze Data
  • Implement Solutions and Communicate Results

Each step in the process logically builds on the previous step which generates an evidenced-based framework that creates a “Best Practice” method for proving Diversity’s link to performance. In the next segment (Part Two), we will explore each step in detail and provide suggestions for their effective use.

Dr. Edward E. Hubbard Short Bio

Dr. Edward E. Hubbard is President and CEO of Hubbard & Hubbard, Inc., (http://hubbardnhubbardinc.com), Petaluma, CA, an international organization and human performance-consulting corporation that specializes in techniques for applied business performance improvement, workforce diversity measurement, instructional design and organizational development.

The Ohio State University awarded Dr. Ed Hubbard the Alumni Distinguished Achievement Award for 2017. In April, 2012 Dr. Hubbard was an honoree at the Inaugural International Society of Diversity and Inclusion Professionals Legends of Diversity Ceremony in Rio Grande, Puerto Rico where he received the Legends of Diversity Award for establishing the “Diversity ROI Analytics” and “Diversity Measurement Fields/Disciplines”. The American Society for Training and Development (ASTD) inducted Dr. Ed Hubbard into the prestigious “ASTD New Guard for 2003”. The July/August 2007 Issue of Profiles in Diversity Journal featured Dr. Hubbard as the “Diversity Pioneer” in Diversity Measurement.

Dr. Hubbard serves on the Harvard Business Review, Diversity Executive Magazine and Strategic Diversity & Inclusion Management (SDIM) magazine Editorial Advisory Boards.

Dr. Hubbard is an expert in Organizational Behavior, Organizational Analysis, Applied Performance Improvement and Measurement Strategies, Strategic Planning, Diversity Measurement, and Organizational Change Methodologies.  Dr. Hubbard earned Bachelors and Masters Degrees from Ohio State University and earned a Ph.D. with Honors in Business Administration.

 

Moving from Activity to Results: What the ‘C-Suite” Really Wants From Our Diversity Efforts

Numbers and the Bottom-line
Business is and always has been a numbers or a bottom-line results game. With the advancements in information processing technology, today’s executives have access to a range of data which is nearly infinite in its depth and breath. There is almost nothing that a computer can’t process at incomprehensible speeds producing the opportunity for “big-data” analytics on just about anything. Computers are churning numbers out on sales volume, accounts receivable and payable, production efficiency, market penetration, customer buying preferences, as well as making suggestions about what you should buy next and hundreds of other subjects including projections for the future. The numbers tell management how much something costs, how many units are being produced and sold, how long the lead time is for delivery of parts or products. They are not only descriptive, they are also predictive. In short, they drive the business.

 

Diversity and Inclusion executives as well as other diversity professionals face many challenging audiences when it comes to demonstrating diversity’s contribution and value; however some of the toughest audiences are in their own company’s or client’s C-suite. Most executives enter these meetings with at least two perspectives. First, they are wondering are you credible and confident enough to be here? In very short order these executive will form an impression of you and make assumptions about your department/organization’s performance based upon the results you have produced for the organization. Were these results tangible and performance based? Is there clear evidence that it was your Diversity initiative that generated these outcomes? What else could have contributed to this result?

Second, did the results you produced help the organization take advantage of an opportunity, meet a need, and/or solve a business-related problem? In other words, did your department’s Diversity initiatives produce outcomes that add measurable value in financial and other terms? Executives listen for impact and want to know there is urgency and opportunity around the topic you are presenting to them. To keep your meeting with them focused, you must consider how your measurement conversation states a clear takeaway upfront and tells them what your efforts have accomplished in ROI terms as well as delineate what you need from them.

Demonstrating a Diversity ROI (DROI®) Causal “Chain of Impact”
A successful meeting offers “direction”. Once they hear your message, executives will want to know how you can prove the results were delivered and what you plan to do next. The Diversity ROI (DROI®) methodology you use to produce the results must give them a step-by-step roadmap so they buy into the claims you make about the results. The Hubbard Diversity ROI (DROI®) methodology for example, provides seven levels of analysis using “evidence-based” outcome approaches that demonstrate a “causal chain of impact” to the results generated. These analysis levels include:

  • Level-0: Business Needs/Performance Analysis
  • Level-1: Reaction, Satisfaction, and Planned Actions Analysis
  • Level-2: Learning Analysis
  • Level-3: Application and Behavioral Transfer Analysis
  • Level-4: Business Impact Analysis
  • Level-5: Benefit-to-Cost; Diversity Return-on-Investment Analysis
  • Level-6: Intangibles Analysis

This allows C-suite and Board-level executives to follow the step-by-step actions taken that are linked to the results produced from the Business Needs/Performance Analysis phase through to their development, implementation and ROI impact. You will know the conversation was successful and had “impact” if it ends with the executives taking action in concert with your intended objectives and what is in the best interest of the organization.

It is much easier to achieve this success if your Diversity initiatives contain specific measures, Key Performance Indicators (KPIs) and other analytics that are measurable as well as linked and aligned with issues and challenges important to the business. These numbers can be validated by showing current and actual historical data that reflect the impact of the results and their reported value by others who apply and have success using the Diversity-based solutions you develop. They can also be compared to internal and external benchmarks that give a C-Suite executive comparative data to judge the outcome’s relative performance and contribution value. One of the Hubbard Metriclink® Diversity ROI Monitoring and Benchmarking Services for example, helps organizations track, monitor, and measure and assess the global impact of their Diversity progress in the following Global Benchmark Areas and much more:

  • Market Share ROI
  • Diversity Training, Education and ROI Impact
  • Vision, Goals, and Policies
  • Diversity Communications
  • Performance Improvement Training and Career Development
  • Community and Government Relations
  • Products, Services, and Supplier Relations
  • Marketing and Customer Services
  • Performance Improvement
  • Diverse Workforce Innovation and Creativity ROI
  • Leadership and Accountability
  • And at least 15 other areas

Using this approach, C-Suite executives can compare the results your Diversity interventions have achieved against local and global performance benchmarks. This will help set Diversity and Inclusion measurement standards for future performance and best practices in the organization’s competitive marketplace.

Why Now?
In the past decade, a variety of concurrent and other forces have driven additional focus on measuring the impact of Diversity and Inclusion programs and interventions including measuring the financial contribution and ROI. These forces continue to challenge old ways of defining an intervention’s or program’s success.

Diversity Intervention Failures
Almost every organization encounters unsuccessful Diversity interventions and programs – interventions and programs that go astray, costing far too much and failing to deliver on promises. Project disasters also occur in other parts of business organizations as well as in government and nonprofit organizations. Many critics of these projects suggest these failures could have been avoided if 1) the project is based upon a legitimate need stemming from a comprehensive business and performance needs analysis from the beginning, 2) adequate planning is in place at the outset, 3) data is collected throughout the project to confirm that the implementation is on track, and 4) an impact study is conducted to detail the project’s contribution. Unfortunately, these steps are unintentionally omitted, not fully understood, or purposely ignored; thus, greater emphasis is being placed on the process of accountability.

Shifting to Evidence-Based, “Science-based” and Outcome-based Diversity Management Approaches
It is critical for our profession (Diversity and Inclusion) to begin immediately moving to fact-based or evidence-based Diversity management and measurement. This means applying Diversity and Inclusion measurement sciences as a “performance improvement technology”, not merely a cobbling of diversity programs and interventions focused solely or primarily on talent management and pipeline challenges. Evidence-based Diversity management proceeds from the premise that using better, deeper logic, facts and prescriptive and predictive analytic methods to the extent organizations and their employees are able to drive business outcomes and objectives is a much more effective and efficient approach. This allows the organization to strategically utilize scarce resources. It is based on the belief that organizations must face the hard facts about what works and what does not work, and reject poorly designed and non-evidence based Diversity and Inclusion initiatives that often pass for sound advice and solutions. This will help organizations perform better in the long run. This move to fact and “Diversity ROI Sciences-based®” approaches supports the expansion to a comprehensive set of success analytics and measures, including financial ROI, and leads to better organizational decisions regarding methods to drive business performance outcomes.

Executive Appetite for Diversity ROI (DROI®) Value
Providing monetary contribution and Diversity ROI (DROI®) reporting is receiving increasing interest in the executive suite. Top managers who watch budgets continue to grow without specific accountability measures are frustrated, and they are responding to the situation by requiring functions to show their value and worth. They are beginning to demand ROI calculations and monetary contributions from departments and functions that previously were not required to produce them, especially given the current economy. As a consequence, in some subtle and not-so-subtle ways, Diversity departments that do not show their value are experiencing:

  • Budget cuts out-of-line with cuts made in other department
  • Whole positions or talent resources being eliminated or transferred to other departments
  • CDO reporting relationships changed to report into the Human Resources function instead of a direct line relationship to the CEO, President, Board or as a member of the C-Suite
  • Access to key influential people and resources diminished due to poor internal brand image and lack of credibility in the results delivered
  • Perceptions of Diversity and Inclusion as not really essential to core business drivers, operational processes and market needs

For years, these function and department heads had convinced executives that their processes could not be measured and their activities should be taken on faith. Well…the era of “faith-based” Diversity interventions is over and has been for some time. Executives no longer buy that argument; they are demanding the same accountability from these functions as they do from sales and production areas of the organization. These major forces are requiring organizations to shift their measurement process to include the financial impact and ROI. When Diversity and Inclusion organizations incorporate these Diversity ROI (DROI®) processes and strategies as a standard part of their practice and performance outcome delivery, they are viewed as truly credible strategic business partners. As a result, Diversity intervention outcomes are valued as core to the organization’s business and its success! Let me know what you think at edhub@aol.com.

* “DROI®” and “Diversity ROI Sciences-based®” are registered trademarks of Hubbard & Hubbard, Inc., All Rights Reserved.

Dr. Ed Hubbard is the President & CEO of Hubbard & Hubbard, Inc., and recognized as Personal Success Coach and Mentor as well as the Founder of the Diversity Measurement and Diversity ROI Analytics fields. Dr. Hubbard is an expert in Organizational Behavior, Organizational Analysis, Applied Performance Improvement and Measurement Strategies, Strategic Planning, Diversity Measurement, and Organizational and Individual Change Methodologies. He holds a Practitioner Certification and Master Practitioner Certification in Neurolinguistic Programming (NLP), a Neuro-science discipline. Dr. Hubbard earned Bachelors and Masters Degrees from Ohio State University and earned a Ph.D. with Honors in Business Administration.

For more information about the Hubbard Diversity ROI Institute, log onto http://www.hubbardnhubbardinc.com/certification-workshps.html

“Evaluation, Reliability, and Validity: How Credible are Your Diversity Initiative Assessments of Progress and Results?”

Performance MeasurementEvaluation is a task that every Diversity Practitioner will face at one time or another. No matter what your role such as Trainer, Consultant, Chief Diversity Officer (CDO), Council Member, ERG/BRG Leader, etc., conducting an evaluation to assess key aspects of your Diversity and Inclusion initiatives is inevitable.

Two Definitions of Evaluation

People do not always agree on one definition of evaluation. Following are statements that reflect two different definitions:

  • “Evaluation is the systematic process of collecting and analyzing data in order to determine whether and to what degree objectives have been or are being achieved.”
  • “Evaluation is the systematic process of collecting and analyzing data in order to make a decision.”

Notice that the first ten words in each of the definitions are the same. However, the reasons-the “Why!”-for collecting and analyzing the data reflect a notable difference in the philosophies behind each definition. The first reflects a philosophy that as an evaluator, you are interested in knowing only if something worked, if it was effective in doing what it was supposed to do. The second statement reflects the philosophy that evaluation makes claims on the value of something in relation to the overall operation of a Diversity intervention, project, or event. Many experts agree that an evaluation should not only assess program results but also identify ways to improve the program being evaluated. A Diversity program or initiative may be effective but of limited value to the client or sponsor. You can imagine, however, using an evaluation to make a decision (the second definition) even if a program has reached its objectives (the first definition).

For some, endorsing Diversity Evaluation is a lot like endorsing regular visits to the dentist. People are quick to endorse both activities, but when it comes to doing either one, many Diversity Practitioners are very uncomfortable.

Evaluation: An Essential Element of Success

Evaluation is an absolutely essential ingredient when you are attempting to close performance gaps or improve performance. It is the only way to determine the connections between performance gaps, improvement programs, and cost-effectiveness. Evaluation is one of the most cost-effective activities in diversity performance improvement, because it is the one activity that, if applied correctly, can ensure success. It is often resisted, however, because of the fear that it could document failure. Evaluation is the process that helps us make decisions about the value of all the activities we have been engaged in and whether they are a worthwhile investment for the organization. Without systematic evaluation we are left with “wishful thinking” or self-service impressions that are often wrong and sometimes dangerous.

All evaluation studies must satisfy two criteria: reliability and validity. Establishing these criteria up front will help you communicate your expectations to the C-Suite and any vendors who deliver programs and assist in your Diversity initiatives. Reliability, the simpler of the two, requires all evaluation methods give the same results each time we measure. This protects you against measures that change constantly and produce different results every time they are used, because of the measuring instrument. Reliability is relatively easy to achieve, yet its importance is often overlooked. To overcome this you must utilize specific Diversity science procedures and instruments for measuring the aspects of Diversity performance and goal achievement that are reflected in the initiative’s objectives, strategies and the organization’s performance gaps. Next, you have to standardize these procedures such that they measure in the same way every time. These activities can be perfectly compatible with the way correctly designed Diversity initiatives are structured and administered.

The second criterion, validity, requires that all evaluations measure exactly and only what it is supposed to be measuring. This criterion is one of the requirements most often violated in Diversity performance and other assessments. For example, if we attempt to measure the amount of knowledge employees gained in a Diversity Competency Training program using a “Reaction” form that asks them how much they learned, the results will indicate how much employees “think” they learned, not how much they “actually” learned. Reaction forms too often report high amounts of learning when little occurred and vice versa (Clark, 1982). Consequently, training reaction evaluation could be reliable but not valid in these cases, because the actual results were the opposite of what the invalid instrument reliably reported! If the instrument reported the same invalid result each time it was used, it is still reliable—which is why we need both reliability and validity for all evaluation activities.

An example of a valid measurement of learning would be a Diversity competency problem-solving exercise or memory test (provided they represented the knowledge and skills the participants learned during the training. The more you make use of Diversity sciences and research evidence about the event being measured, the better your chances of for validity. Performance evaluation systems such as the Hubbard 7-Level Evaluation Methodology, integrates these approaches in the process.

Conducting a comprehensive Diversity Evaluation is the only true way to know if Diversity and inclusion programs or initiatives are delivering the outcome results expected by key stakeholders. It is essential that Diversity Practitioners master critical Diversity and Inclusion evaluation methods using technologies that are rooted in Diversity ROI® science. Why? Because the perceived value and credibility of what we do to be seen as a true Business Partner and Professional depends on it!

Diversity Process Consulting or Intervention Consulting: How Do We Demonstrate Our Unique Value?

Building an Effective Diversity Measurement System

 

The creation of an effective Diversity measurement system and “best” practices cannot be a mechanical modeling exercise. It must be preceded by an inspection and utilization of basic business principles. It must focus on organizational and departmental strategic thinking as well as an assessment of the desired quality of work-life. Developing the actual measures is easy compared to the amount of time that should be spent thinking about what is important to the organization’s strategic business objectives and the expectations of the diversity measurement process.

 

Key steps to building an effective measurement system

 

Creating an effective Diversity measurement system and process that embodies these concepts involves at least five critical steps:

  • Review the Strategic Business Plan for Needs
  • Formulate Research Questions
  • Design the Study Methodology
  • Collect and Analyze Data
  • Implement Solutions and Communicate Results

 

Each step in the process logically builds on the previous step which generates an evidenced-based framework that creates a “Best Practice” method for proving Diversity’s link to performance.

 

With proper training and skill/competency development, one of the more critical roles a Diversity Practitioner and Professional can perform is that of a Diversity Performance Consultant/Technologisttm. This role in the Hubbard & Hubbard, Inc. Diversity Discipline Framework requires the Practitioner to design, develop and deliver or evaluate diversity performance solutions; maintain and apply an in-depth working knowledge in any one or more of the diversity performance improvement areas of expertise; take a disciplined approach to assessing individual and organizational effectiveness in the midst of collective mixtures of differences and similarities, diagnose causes of diversity tensions from differences, similarities and complexities, and recommend a set of interventions; as well as design solutions to improve diverse workforce performance and/or solutions to improve the organization’s performance.

 

I have always viewed Diversity ROI & Inclusion methods as “performance improvement technologies”. I am also a strong supporter of participatory approaches to performance improvement, from involving stakeholders in the identification of needs and their causal factors to determining solution alternatives, selecting the solution, planning and managing the change, and monitoring and evaluating the change. This active stakeholder participation is critical to the sustainable success of any Diversity & Inclusion (D&I) intervention, not only because we gain real buy-in from stakeholders, but also because part of what we do as rigorous Practitioners ultimately, is to change the way people think about and approach D&I performance solutions in organizations.

 

Diversity Intervention Consulting is primarily focused on a specific transaction, the provision of an intervention (e.g., Cultural Competency Skills for Leaders training), whether it is a specific process or product. In this case, the performance consultant, as “expert,” carries the bulk of the responsibility for delivering the intervention, but does not typically stick around for the consequences of such interventions. Partially rooted in the sociological tradition in new systems theory which views organizations as self-organizing social systems, Performance/Process Consulting provides a different approach. With a Performance/Process Consulting approach, however, the Diversity Performance Consultant/Technologisttm and the client are equal partners who share the responsibility for the desired change. There is a reduced chance of falling into fads or trendy solutions that may be insufficient or not fully applicable to the organizational realities, because both the Diversity Performance Consultant/Technologisttm and the client are partners in the change and its consequences. Both have a stake in the success of the intervention, and both learn lessons along the way. Moreover, they involve others in the organization, so that these lessons learned benefit more than just a few.

 

I am convinced that the real value of our work is much more than a roster of interventions (no matter how evidenced-based); rather, it is the paradigm shift that we contribute to in the course of our involvement with our stakeholders. Our ultimate value is in the sustainable and positive change of the organization’s performance system that is now able to operate at its goal or outcome level. While neither resource was utilized exclusively, it is certainly worthwhile for us to reflect on our own approach and determine whether we consciously or subconsciously assessed the situation to determine what balance or blend would be of most value for the given situation.

 

It is always helpful to review our Performance Consulting approach because of the wide range of relevant topics and ROI-based metrics that fit under the performance improvement umbrella. I am fond of saying that “focusing on tactics without a strategic framework is like learning to run faster in the wrong direction”. You cannot make a strategic contribution without a tight alignment and linkage to the business objectives and success metrics of the organization. If you want to have your interventions resonate with the C-suite and line managers of the organization, they must be based in the real bottom-line needs that drive organizational performance. Whether the organizational initiative is diversity training to teach cultural competency skills, selling products to emerging market clientele, innovating new products and services for a global market, delivering healthcare services, serving governmental constituents, meeting a wide range of student needs, improving the customer service experience, etc., “strategically aligned” diversity performance strategies have the best chance at success and sustainability.

Let’s take a look at an example that helps to clarify this relationship. First, among the organization’s strategic objectives, you find a series of crucial performance areas. One of these areas focuses on an objective of improved customer service. Based upon the importance of this area to the business, the diversity organization has created a corresponding strategic objective to analyze and improve service across all demographic market segments. In the second step, you determine that for service to be improved in these targeted markets, the critical success factor areas must include “improved communication”, “culturally appropriate interactions”, quick access, increased satisfaction, and accurate information. Finally, these critical success factor areas lead you to select diversity performance measures and indicators that support each critical success factor area such as the “percentage of multilingual service transactions delivered”, “number of rings to answer” when a customer calls the organization, “percentage of favorable response on your diverse customer satisfaction survey”, etc. This type of alignment drives improved performance and gains top management support.

Both Diversity Process Consulting and Diversity Intervention Consulting can offer strategic value to the organization. The key is how well each Performance Consulting method meets critical needs of the business to drive its goals, outcomes and success. At what value level would stakeholders rate your internal Performance Consulting methods today? What do you need to do differently to enhance your role as a value-added business partner?

Dr. Hubbard is an expert in Organizational Behavior, Organizational Analysis, Applied Performance Improvement and Measurement Strategies, Strategic Planning, Diversity Measurement, and Organizational Change Methodologies. He holds a Practitioner Certification and Master Practitioner Certification in Neurolinguistic Programming (NLP), a Neuro-science discipline. Dr. Hubbard earned Bachelors and Masters Degrees from The Ohio State University and earned a Ph.D. with Honors in Business Administration. Dr. Hubbard is available for Keynote Presentations, Executive Briefings, Workshops, etc. He can be reached at http://www.hubbardnhubbardinc.com/contact-us.html

Three Critical Dimensions and Seven Levels that Turn Diversity & Inclusion Evaluation into Results

“Three Critical Dimensions and Seven Levels that Turn Diversity & Inclusion Evaluation into Results”

 

Evaluation is a task that every Diversity Practitioner will face at one time or another. No matter what your role such as Trainer, Consultant, Chief Diversity Officer (CDO), Council Member, ERG/BRG Leader, etc., conducting an evaluation to assess key aspects of your Diversity and Inclusion initiatives is inevitable.

Two Definitions of Evaluation

 

People do not always agree on one definition of evaluation. Following are statements that reflect two different definitions:

 

  • “Evaluation is the systematic process of collecting and analyzing data in order to determine whether and to what degree objectives have been or are being achieved.”
  • “Evaluation is the systematic process of collecting and analyzing data in order to make a decision.”

 

Notice that the first ten words in each of the definitions are the same. However, the reasons-the “Why!”-for collecting and analyzing the data reflect a notable difference in the philosophies behind each definition. The first reflects a philosophy that as an evaluator, you are interested in knowing only if something worked, if it was effective in doing what it was supposed to do. The second statement reflects the philosophy that evaluation makes claims on the value of something in relation to the overall operation of a Diversity program, project, or event. Many experts agree that an evaluation should not only assess program results but also identify ways to improve the program being evaluated. A Diversity program or initiative may be effective but of limited value to the client or sponsor. You can imagine, however, using an evaluation to make a decision (the second definition) even if a program has reached its objectives (the first definition). For example, for Non-Profits, Federal grants are based on the first statement, that is, whether the program has achieved its objectives, but the harder decision to downsize or change may be a consequence of the second definition of evaluation.

 

For some, endorsing Diversity Evaluation is a lot like endorsing regular visits to the dentist. People are quick to endorse both activities, but when it comes to doing either one, many Diversity Practitioners are very uncomfortable. In this blog, I want to reduce your discomfort by demystifying some important aspects of designing and conducting a Diversity ROI evaluation by helping you get to know a few Diversity metrics processes that matter in evaluation design.

In both for-profit and nonprofit organizations, organizations possess data (and information) that could help to evaluate a Diversity program or project. These data are the one thing that all evaluations have in common regardless of the particular definition of evaluation you embrace: “evaluation is the systematic process of collecting data that help identify the strengths and weaknesses of a program or project. The data may be as simple as records of attendance at training sessions” or, as complex as “showing test scores showing the impact of a new educational program on increasing students’ knowledge across an entire school system”.

 

Evaluating Efficiency, Effectiveness, and Impact

 

We can define Diversity evaluation even more closely as a process. The process is guided by the reason for doing the evaluation in the first place. An evaluation might be a process of examining a Diversity training program, in light of values or standards, for the purpose of making certain decisions about the efficiency, effectiveness, or impact of the program. To carry out this task, you need to understand the concepts of efficiency, effectiveness, and impact. Think of these three terms as the levels of a program evaluation.

 

“Efficiency” relates to an analysis of the costs (dollars, people, time, facilities, materials, and so forth) that are expended as part of a program in comparison to either their benefits or effectiveness. How is efficiency, or the competence with which a program is carried out, measured in a program? The term itself gives clues to what this is about. Diversity Practitioners would look at the efficiency with which details are carried out in a program. Diversity programs and initiatives often begin with recruiting, gathering materials, providing for space, setting up fiscal procedures, and so forth. In other words, the relationship between the costs and end products becomes the focus of an efficiency evaluation. Although very important, these aspects of efficiency have no bearing on the program’s effectiveness. If the investment in the program or project exceeds the returns, there may be little or no efficiency.

 

For example, let’s consider an assembly line facility that houses a rather substantial training and staff development department. As part of this department, ten instructors are responsible for ensuring that five hundred employees are cycled through some type of Diversity training every six months, for a minimum of twenty hours of training each cycle. The training revisits the employees’ basic knowledge of their job and introduces new concepts of Diversity that build additional competencies since the last training. The staff development department might work very efficiently by making sure that all employees cycle through in a timely fashion, in small enough groups to utilize the best of what we know about how adults learn. The students’ time on task is often not enough, however, and many of them do not retain much of what was covered in the training. Thus the program is not effective.

 

The department may be efficient in that it fully utilized the time of each of the available trainers, it stayed within the parameters of the staff development budget, it kept employee “down time” to a minimum, it used materials and equipment that were available, and it completed the Diversity and Inclusion training agenda for the company. Yet there may be an increase in cultural miscommunication incidents and generational conflict across levels because employees make simple, basic mistakes and assumptions about others who are different than themselves. The department’s training was efficient but not necessarily effective.

 

When you examine the “effectiveness” of your Diversity and Inclusion initiatives, you are asking this question: “Did the activities do what they were supposed to do?” Simply put, an initiative’s effectiveness is measured in terms of substantive changes in knowledge, attitudes, or skills on the part of a program’s or initiative’s participants. Although the right number of participants may have been recruited and the best possible site may have been secured, the effectiveness test is this: Did the activities provide the skills to effectively handle Diversity and Inclusion-related situations! Did the participants gain the knowledge they need to work across generational differences? In another example, the same Diversity and Inclusion department staff may conduct a training session on a new approach to deescalate cultural conflict situations. The trainer may pretest all the employees as they begin their training session. Upon completion, the employees are post-tested and the results compared to determine whether their knowledge increased, decreased, or stayed the same. An increase in their knowledge would be an indication that the training was effective-it did what it was supposed to do. Yet two weeks after the training, when one of the employees was back at her job location, a situation arose in which she engaged in a serious altercation with another employee and failed to use the skills taught. She used her older, more comfortable procedure for addressing communication differences across cultures and caused a problem that put her and her coworkers at the risk of suspension. Here is an example of training that was effective-the worker passed all the posttests-but had little impact on changing the behavior of the employee.

 

Thus the impact that the program has had on the people or organization for which it was planned becomes an important evaluation consideration. “Impact” evaluation examines whether and to what extent there are long-term and sustained changes in a target population. Has the program or initiative brought about the desired changes: Are employees using the new procedures? Do your employees have more job satisfaction?

 

Evaluators frequently pay too little attention to assessing impact. One reason is that “impacts” often manifest themselves over time, and Diversity Practitioners have already turned their attention elsewhere before computing this aspect of the evaluation. The actual impact that training in new procedures might have in people’s everyday life often needs time to percolate and evolve. An attempt to collect impact data after allowing for this delay may run into a number of roadblocks such as learner turnover (you cannot find them), job or circumstance change (they no longer are in situations that demand heavy use of the skill taught), or lack of time or resources for the evaluator to conduct these follow-up activities.

 

Still, program and project sponsors are most interested in impacts. Whether a learner feels satisfied with the training or the training results in knowledge gain means little to a sponsor or employer if the learning doesn’t help the organization.

 

Evaluating Alternatives

 

The second philosophical statement that defines evaluation presents it as the process of delineating, obtaining, and providing useful information for the purpose of selecting among alternatives. Thus, it may not matter whether the program was efficiently conducted, effective, or had an impact on behavior or functions, Instead, the value of the evaluation is in its being able to compare one activity to another, one initiative or program to another, or one employee to another so that decisions can be made in the presence of empirically collected data. Diversity Search Committees perform this kind of evaluation. In the course of their work, they describe job candidates’ strengths, outline previous experiences, and acquire other useful information that makes it possible to choose among a number of candidates. A company planning to adopt and purchase a computer system will perform this kind of evaluation on all the systems it is considering. It will select the one that performs the best given the needs and resources of the company.

 

Identifying Areas to Improve

 

Finally, there is a third way of defining evaluation: Evaluation is the identification of discrepancies between where a program or initiative is currently and where it would like to be. For example, an organization’s multicultural marketing department may have as one of its goals at least one face-to-face focus group with emerging market customers per year. Currently, its Sales force sees fewer than half of the multicultural customers in a year. Records of face-to-face calls indicate the discrepancy between where XYZ Corporation is currently as opposed to where the organization wants to be.

 

Personnel evaluations often take on this definition as well. A new employee’s first evaluation may be an example of the first definition, that is, an evaluation against some minimal standard of performance. After this initial evaluation, certain performance goals are set for the employee (either mutually or by the supervisor or team. The next and all subsequent evaluations of the employee are compared with those performance goals or standards. The discrepancies are identified and remediation strategies are developed.

 

The Critical 7 Levels — Don’t Perform Your Diversity Initiative or Diversity Program Evaluation without Them!

 

Other levels of evaluation as defined by the Hubbard Diversity ROI Methodology refer to the eventual us of the evaluation data and who might make use of the results

Diversity Return on Expectations (DROEx®), for example, must be based on evidence and impact results. I have found it useful to first to distinguish the “evidence-based, outcome-focused” measures from other types of “activity only” measures. Anyone responsible for implementing Diversity initiatives is also responsible for evaluation. Whether you calculate the impact or not, from management’s and/or the stakeholder’s point of view, “you will always own the ROI of the initiatives you implement”. So, the amount of evaluation that you provide to meet expectations depends on the types of decisions that your organization must make and the information needed to make those decisions. There are 7 levels you can use in the Hubbard Diversity Return-on-Investment DROI® evaluation methodology to effectively demonstrate your ROI impact and show a “chain of impact” to meet customer and stakeholder expectations that is evidence-based and credible:

  • Level 0: Business and Performer Needs Analysis
  • Level 1: Reaction, Satisfaction, and Planned Actions
  • Level 2: Learning
  • Level 3: Application and Behavioral Transfer
  • Level 4: Business Impact
  • Level 5: Diversity Return-on-Investment (DROI®), Benefit-to-Cost Ratio (BCR)
  • Level 6: Intangibles

For example, if your only requirement is to ensure that participants have positive attitudes toward the initiative, then a Level 1 evaluation is sufficient. But, if your goal is to determine whether your diversity initiative is having a positive effect on job performance, then you will have to perform a Level 3 evaluation. This means you will also have to conduct Level 1 and 2 evaluations in order to assess the learning performance applications and Job impact at Level 3 (an example of the “DROI® Chain of Impact”). They provide the basis for determining whether participants demonstrated that they learned by putting these skills and attitudes to use (verified by a Level 3 evaluation).

 

There’s no doubt that we must communicate effectively and demonstrate our value to the bottom-line. Diversity ROI metrics and performance improvement processes help us focus first on tangible outcomes, then on interventions to meet expectations. When Diversity Practitioners focus primarily on the intervention, such as the Diversity content, the method, or the technology, it’s easy to be led astray by current fads, thus wasting valuable time and money. Instead, focus first on the desired outcomes and DROI® analytics to determine what kind of measurable diversity intervention, if any, is necessary to meet customer and key stakeholder expectations.

Conducting glitzy Diversity training or other Diversity activities and implementing fad-based interventions can distract decision makers from what truly counts. The glitz may make things fun, louder and interactive, not necessarily better. Without a clear, data-based front-end analysis of organizational performance gaps, any intervention, including Diversity training and the like, is a guess. Add in sophisticated Diversity intervention technologies without an adequate front-end analysis, including metrics, and it becomes an expensive and often complex guess. Systematic Diversity training design procedures, for example, must include DROI® analytics and metrics, needs assessments, objectives, targeted competency-based design, and multi-level evaluation processes. That framework provides a method to get the coveted seat at the C-Suite table. Why? Because when used properly, that knowledge base can help companies increase revenue and decrease costs using Diversity and Inclusion practices that impact organizational performance outcomes. In other words, you can earn your seat at the executive table by applying what you already know as a Diversity ROI-focused professional. It’s successful because the DROI® metrics and processes you use are solidly based on the behavioral science research results which provide strategies detailing how diverse people interact and what drives their behavior to produce successful organizational outcomes.

 

If we examine any other professional discipline or field of study, like Medicine, Engineering, Accountancy, Science, etc., we expect that they are able to prove the efficiency, effectiveness, and impact of the solutions, programs and initiatives they what us to support. Why should Diversity and Inclusion be any different if we want our processes to have credibility and support?

 

Conducting a comprehensive Diversity Evaluation is the only true way to know if your Diversity and inclusion programs or initiatives are delivering the outcome results expected by key stakeholders to meet the needs of the organization. It is essential that Diversity Practitioners master critical Diversity and Inclusion evaluation methods using technologies that are rooted in Diversity ROI science. Why? Because the perceived value and credibility of what we do to be seen as a true Business Partner and Professional depends on it! Are you evaluating your Diversity and Inclusion initiatives and programs at this level?? What’s your department’s Brand and Credibility Image in your organization??

Resolve to Transform Yourself into an Evidence-based Diversity ROI Professional for 2015

Resolve to Transform Yourself into an Evidence-based Diversity ROI Professional for 2015

When it comes to setting goals for 2015 to improve your Diversity ROI and measurement methods, what are your resolutions for the New Year? What is your plan to improve your “Diversity Measurement Brand” as an effective Strategic Business Partner with critical expertise and capability? Are you familiar with the skills and capabilities needed to position yourself and your department as an effective, competent, evidence-based ROI resource the organization can call on this year?

Wikipedia defines a “New Year’s Resolution” as a tradition, most common in the Western Hemisphere but also found in the Eastern Hemisphere, in which a person makes a promise to do an act of self-improvement or something slightly nice, such as opening doors for people beginning from New Year’s Day.

Some additional examples include resolutions to donate to the poor more often, to become more assertive, or to become more environmentally responsible.

Popular goals include resolutions to:

  • Improve physical well-being: eat healthy food, lose weight, exercise more, eat better, drink less alcohol, quit smoking, stop biting nails, get rid of old bad habits
  • Improve mental well-being: think positive, laugh more often, enjoy life
  • Improve finances: get out of debt, save money, make small investments
  • Improve career: perform better at current job, get a better job, establish own business
  • Improve education: improve grades, get a better education, learn something new (such as a foreign language or music), study often, read more books, improve talents
  • Improve self: become more organized, reduce stress, be less grumpy, manage time, be more independent, perhaps watch less television, play fewer sitting-down video games
  • Take a trip

Often, it is quite a list. Some people are successful at achieving the goals they set while others sputter and can’t quite get off the blocks to run their race.

Success Rate

A 2014 comprehensive study commissioned by Australian comparison website finder.com found that of the more than 2,000 people surveyed, 42% of the participants set a New Years’ Resolution however, most failed at their goals. In fact, the study showed that almost two in three people (62%) didn’t succeed with their resolutions. Interestingly, out of those who did achieve their resolutions, three in four participants (76%) believed that sharing their goals, for example on a social networking service, helped them reach their target.

The most common reason for participants failing to complete their New Years’ Resolutions was setting unrealistic goals (35%), while 33% didn’t keep track of their progress and 23% of the group forgot about them. About one in 10 respondents claimed they made too many resolutions. Lessons learned from the Australian website finder.com.au offers sage advice about what to do and what not to do when planning your 2015 strategy.

In a Blog earlier this year, I mentioned that demonstrating effective, evidence-based D&I acumen is both an art and science: it results from using solid, proven, tested techniques (the science) of diversity ROI analytics and measurement strategies in an inspiring and engaging way (the art of diversity ROI analytics and measurement strategies). Rather than advocating one specific diversity intervention product or service, a strategy I have found worth considering is thinking about the active science-based ingredients that constitute an effective diversity intervention or solution — then you can match and locate the effective features in the measurement and analysis approach you are reviewing to ensure it meets your needs.

There are a huge number of diversity, inclusion, and training approaches available in the marketplace. They usually try to lure you in by highlighting their ability to address a particular problem or issue the organization is facing and promise to provide you with the things you need to achieve your organizational goals. As a diversity professional, the real trick is finding the interventions or solutions that work and work consistently to drive sustainability. If you want to implement a solution or intervention that delivers a measurable ROI or a measurable non-financial impact, you must be able to access a decision framework that is effective and drives results. The proposed solution or intervention must be able to connect to the roots of your organization’s DNA. This should be a critical area of focus for 2015.

Building a Recipe for Accountability and Success

To do this successfully, it is important to have as much detail as possible when specifying the requirements of a diversity intervention. Many projects run into difficulty, misunderstandings and differences in expected outcomes because the requirements are not planned and well-documented. These issues are often outlined in a diversity project proposal or detailed in the project’s scope documentation. Regardless of the way it is developed, the following items should be included to achieve the best chance for success for your 2015 initiatives. More importantly, the evidence-based diversity professional and the evaluation project’s sponsor need to reach an agreement about these key issues to create a sound strategic partnership and build accountability for the end result.

Ingredient 1: Does the Proposed Solution Include a Diagnostic Approach and Analytical Alignment Tools?

I have long advocated that diversity and inclusion should not be seen as a mere theory, but should be used as a performance improvement technology with its own set of ROI-based analytics and process improvement sciences. Driving business performance improvement requires that you have a detailed understanding of the diversity ROI evaluation methodology and how it works. It begins with some initial planning, and continues with the implementation of a comprehensive data collection and evaluation process. The initial planning and analysis step is critical for generating a successful diversity intervention. Many diversity practitioners trying to develop effective business solutions find out after the fact that they should have spent more time planning the strategic linkage and alignment of the diversity initiatives that will drive the business challenges and opportunities they are trying to effect.

Ingredient 2: Does the Proposed Solution Have Objectives That Are Behaviorally Specific?

When it comes to diversity evaluation projects, there are two sets of objectives. First, there are the objectives for the diversity evaluation project itself, indicating specifically what will be accomplished and delivered through the evaluation process. The other set of objectives are called the diversity initiative objectives and focuses on the goals of the actual diversity initiative that will ultimately add value to the organization.

Every diversity evaluation project should have a major project objective, and in most cases, multiple objectives. The objectives should be as specific as possible and focused directly on the diversity evaluation. Sample project objectives may focus on the following outcomes:

  • Determine if the diversity initiative is accomplishing its objectives.
  • Identify the strengths and weaknesses in the diversity initiative.
  • Determine the benefit/cost ratio and ROI of the diversity initiative.
  • Identify who benefited the most and least from the diversity initiative.
  • Gather data to assist in pursuing future initiatives.

As the list illustrates, the objectives are broad in scope, outlining from an overall perspective what is to be accomplished. The details of timing, specifications and specific deliverables come later. The broad diversity evaluation project objectives are critical because they bring focus to the project quickly. They define the basic parameters of the project and are often the beginning points of a discussion with those involved in the project.

Ingredient 3: Does the Proposed Solution Have a Clearly Defined Scope?

The scope of the diversity evaluation project needs to be clearly defined. The scope can pinpoint key parameters addressed by the project. The following list shows typical scope issues that should be defined in the project:

  • Target group for the evaluation.
  • Location of the target group.
  • Time frame for the evaluation.
  • Technology necessary to conduct the evaluation.
  • Access to stakeholders.
  • Product line(s) to cover.
  • Type of diversity process/activity/competencies being evaluated or improved.
  • Constraints on data collection.

Perhaps the project is limited to certain employee or demographic groups, a functional area of the business, a specific location, a unique type of strategy or a precise time frame. Sometimes there is a constraint on the type of data collected or access to certain individuals, such as particular customers in a targeted market segment. Whatever the scope involves, it needs to be clearly defined in this section.

Ingredient 4: Is the Timing Clearly Defined?

Timing is critical in showing specifically when the diversity intervention activities will occur. This means not only the timing of the delivery of the final diversity ROI study report but also the timing of particular steps and events — including when data are needed, analyzed and reported and when presentations are made. The following list shows typical scheduled activities:

  • Diversity initiatives or solutions developed.
  • Diversity initiatives implementation started.
  • Diversity initiatives implementation completed.
  • Start of the diversity ROI evaluation project.
  • Data collection design completed.
  • Evaluation design completed.
  • Data collection begins.
  • Data collection completed.
  • Specific data collection issues (for example, pilot testing, executive interviews).
  • Data analysis completed.
  • Preliminary results available.
  • Report developed.
  • Presentation to management.

Ingredient 5: Does the Proposed Solution Spell Out the Specific Diversity Intervention Deliverables?

This section describes exactly what the project sponsor or client will receive when the diversity intervention is completed in terms of improved competencies, reports, documents, systems and processes. Whatever the specific deliverables, they are clearly defined in this section. Most projects will have a final report, but they often go much further, delivering new skill sets, processes and suggested methodologies for improving the diversity process and business issues being addressed.

Ingredient 6: Does the Proposed Solution Clearly Utilize a Proven Science-based Methodology and Approach?

If a specific methodology is to be used for the diversity ROI intervention, it should be defined and state the scientific basis for its ability to obtain measurable results. A reference should be made to the appropriateness of the methodology, and how the methodology will accomplish what is needed for the diversity initiative to be successful. This helps prevent initiatives that are merely “fads” that do not and cannot generate the desired outcome. Just because participants enjoy the intervention doesn’t mean that you will have improved performance. It must be constructed with key ingredients to achieve its behaviorally stated objectives and measurable, evidence-based outcomes. A well-designed diversity intervention can produce both: an enjoyable process and measurable results.

Ingredient 7: Does the Proposed Solution Have Clearly Defined Steps?

The specific steps that will occur should be defined showing key milestones. This provides a step-by-step understanding and tracking of the diversity evaluation project such that at any given time the project sponsor or client can see not only where progress is made but also where the evaluation project is going next.

Ingredient 8: Does the Proposed Solution Spell Out the Resources Required for Success?

This section should define specific resources required to implement the intervention. This could include access to individuals, vendors, technology, equipment, facilities, competitors or customers. All resources that may be needed should be listed along with details regarding the timing and circumstances under which the resources will be needed.

Ingredient 9: Does the Proposed Solution Highlight Fully Loaded Costs and Benefits?

The cost section details the specific costs tied to different steps of the intervention process. There is often reluctance to detail costs; however, it is important to understand the different steps of the process and their relative costs. This cost outline should also be linked to driving the organization’s strategic objectives and mission. When calculating the diversity return on investment for a diversity initiative, all costs are considered. This includes not only development and implementation costs but also the costs of evaluating the program.

Ingredient 10: Does the Diversity Intervention Provide a Causal Chain of Impact to Demonstrate and Isolate Diversity’s Contribution to the Results Versus Other Contributors?

Eventually a diversity initiative or intervention should lead to some level of impact on the organization’s business. In some situations, the diversity initiative is aimed at softer issues, such as improving the diverse workforce climate, employee satisfaction, diverse customer group satisfaction and reducing diverse workgroup conflict reduction. In other situations, diversity initiatives are aimed at more tangible issues such as cost reductions, market share, revenue improvements, productivity and number of voluntary turnovers, all sorted by demographic group. Whatever the case, diversity initiatives and interventions should have multiple levels of objectives and must be able to demonstrate how the specific diversity intervention drove the improvement differences and results that were achieved. These levels of objectives, ranging from qualitative to quantitative, define precisely what will occur as a particular diversity initiative is implemented in the organization. These objectives are so critical that they need special attention in their development and use. The Hubbard Diversity ROI Model and seven-level chain of impact can assist you in generating diversity interventions with these characteristics.

Ingredient 11: Does the Diversity Intervention Have a Comprehensive Data Collection Process?

Data collection is the most crucial step of the evaluation process because without data, there is no evidence of the diversity initiative’s impact. During the data collection process, it is necessary to determine the participants’ reactions to and satisfaction with the diversity initiative (Level 1), their level of learning from the intervention (Level 2), the amount of application and implementation that happened as a consequence of the diversity initiative (Level 3), the resulting business impact (Level 4), and whether the initiative generated benefits and a return on investment (Levels 5 and 6). It is necessary to collect data from at least levels 1-4 because of the chain of impact that must exist for a diversity initiative to be successfully applied into the organizational system and provide value. To reap the benefits of the chain of impact, a key business problem that can be addressed by diversity must be identified during the Needs Analysis Phase (Level 0). It also requires that participants in the diversity initiative experience a positive reaction to the initiative and its potential applications. They must acquire new knowledge or skills to perform at an improved level that is a direct result of the diversity intervention. As application or implementation opportunities arise, there should be changes in their “on-the-job” behavior that result in a measurable, positive impact on the organization. The only way to know if the chain of impact has occurred up to this point is to collect data at all four levels. The diversity initiative will also generate benefits that are either quantitative or qualitative in the forms of benefit-to-cost, dollar return on investment and anecdotal impacts.

An effective evidence-based diversity ROI initiative must be built on a comprehensive, evidence-based planning and data collection model that incorporates appropriate scientific process and critical factual information. By utilizing these science-based techniques to plan and collect data, your diversity interventions and evaluation studies in 2015 will begin on a solid foundation that positions the initiatives for improved performance and organizational success.

Sample Resolutions for your 2015 Transformation Strategy could include any and all of the following:

  1. I will align my Diversity and Inclusion initiatives with my organization’s overall business strategies to drive its goals, objectives and outcomes.

      2. I will design and deliver better, more effective Diversity and Inclusion (D&I) initiatives using Diversity ROI approaches such as the Hubbard Diversity ROI Methodology and its 7-Level Evaluation framework. This Framework will consist of evaluating my initiatives at the appropriate level depending on the specific initiative’s and stakeholder’s requirements:

  • Level 0: Business and performer needs analysis.
  • Level 1: Reaction, satisfaction and planned actions.
  • Level 2: Learning.
  • Level 3: Application and behavioral transfer.
  • Level 4: Business impact.
  • Level 5: Diversity return-on-investment, benefit-to-cost ratio.
  • Level 6: Intangibles.

 

  1. I will support my organization’s greatest asset—it’s people—by providing clear pathways for development using Diversity ROI-based tools such as the Hubbard 7-Level Evaluation framework to generate a measurement “Chain of Impact” to gauge the strength of the linkage between my Diversity and Inclusion (D&I) initiatives and their impact on the organization’s bottom-line. I will use this feedback to determine whether the development objectives have been achieved.

 

  1. I will use technology to build innovative processes and improve performance using team-based measurement and evaluation processes as well as automated online calculators, Dashboards and Scorecards to generate consistency and a clear baseline to judge progress over time.

 

  1. I will use research-based ROI practices to improve the effectiveness of my Diversity training programs. This will include conducting Diversity ROI studies I can use as communication tools to demonstrate the effectiveness of our initiatives as well as build an enhanced “Brand image”.

 

  1. I will use Diversity measurement, Diversity analytics (predictive, etc.), and other data to measure and improve organizational and individual performance.

 

  1. I will be a better leader in 2015 by increasing my personal competency and skills in the area of Diversity ROI measurement and evaluation (through Diversity ROI training and Certification).

 

  1. I will apply a worldview to problem solving by learning “how to” implement Diversity ROI-based analytical case study initiatives across cultures globally.

 

  1. I will help others reach their full potential through specific development initiatives by monitoring measuring and evaluating individual performance and the degree to which targeted level improvement milestones have been reached.

 

  1. I will use creative tactics and measurement strategies to involve the learner and improve the retention impact of our organizational talent base.

 

Adopting the Diversity ROI Evaluation and Measurement Resolutions, mentioned above, for 2015 can be an excellent way to kick off the New Year! Wishing you all the best and much success in your transformation!

JOIN the ASSOCIATION Today and receive your Members Only Diversity ROI Resource Site Username and Password!

Want more Diversity ROI tools, worksheets, case studies, online Diversity ROI calculators, over 300 Diversity ROI measures and formulas, a Members Only Diversity ROI Resource Site accessed using your Membership Username and Password, and much. much more?? Join the Association by paying your Annual Membership Dues (only $25 per month…paid annually). Click or insert the link below to start receiving your Member Benefits: http://www.diversitysuperstore.com/mm5/merchant.mvc?Store_Code=DS&Screen=CTGY&Category_Code=OSL

 

 

Using a Diversity ROI Analytics Business Case to Show Diversity & Inclusion’s Payoff in Big $$$

Organizations depend on their diverse employees to grow their bottom line and achieve the aggressive goals needed to win in today’s global, fast-paced economy. They know the marketplace is full of a diverse group of customers, yet they do not always effectively utilize their diverse workforce members to create innovative, paradigm-shifting solutions.

This guide is designed to help you build your Diversity ROI Business Case to demonstrate value-added by aligning with key business goals and objectives:

  1. Market Share Improvement
  2. Improving Global Leadership and Management Capability
  3. Lowering Costs and Increasing Productivity
  4. Developing New Revenue Sources

Why should you concern yourself with effective Diversity ROI Measurement and Management? In the past, many managers answered this question out of a sense of the “right thing to do” or because they were seeing more and more people who didn’t look like them in the workforce, or merely felt they had to meet the organization’s requirement for working with diverse groups. However, today’s managers know that without effective diversity management capability, organizational effectiveness is in jeopardy. Being effective at managing a diverse workforce for example, helps to lift morale, improve processes, bring access to new segments of the marketplace and enhance productivity of the organization. In essence, it is good for business.

In profit-making organizations, maximizing the difference between revenues and costs optimizes performance. This same goal exists in many non-profit organizations, except that the result is called surplus instead of profits. The question therefore is: “How are workforce Diversity and its management related to revenues, costs, or both?” To answer this question we can explore several concepts and strategies that illustrate the impact of diversity on business performance. These concepts and strategies include items such as marketing strategies, problem-solving strategies, creativity and innovation that can be viewed as important factors in revenue generation.

Marketing Strategies and Market Share Improvement

We live in an increasing global world that is diverse. Whether your business includes marketing financial services, computers, telecommunications products, social services, health care equipment, manufacturing processes, engineering expertise, and the like, expertise in addressing a diverse customer market (Business-Consumer Archetype) will be essential to your success. For example, an automobile manufacturer in Japan cannot afford to ignore the fact that nearly half of all new car buyers in the United States are women. This is true regardless of the gender make up of car buyers in Japan. Likewise, no reasonable person in the consumer-goods industry can afford to ignore the fact that roughly a quarter of the world’s population is Chinese and immigration to the United States from mostly Asian and Latin American countries is occurring at a rate of more than a million people per year.

We know that in the United States, Asians, African-Americans, and Hispanics combined now collectively represent over a $Trillion dollars annually in consumer spending. The Selig Center for Economic Growth (from the University of Georgia Terry School of Management) estimates and projections of buying power for minorities—African Americans, Asians, Native Americans, and Hispanics—definitely share in driving business success, and together wield formidable economic clout. As these groups increase in number and purchasing power, their growing shares of the U.S. consumer market draw avid attention from producers, retailers, and service providers alike.

The buying power data presented here and differences in spending by race and/or ethnicity suggest that one general advertisement, product, or service geared for all consumers increasingly miss many potentially profitable market opportunities. As the U.S. consumer market becomes more diverse, advertising, products, and media must be tailored to each market segment. With this in mind, new entrepreneurs, established businesses, marketing specialists, economic development organizations, and chambers of commerce now seek estimates of the buying power of the nation’s major racial and ethnic minority groups.

In a Business-Consumer Archetype (B to C), your diversity measurement strategies and analytics must be “Relationship/Brand Focused”. They must measure your organization’s ability to build customer intimacy knowledge and “use it” in measurable ways to generate outcome-based results that add revenue and other value to the bottom-line. Sample Diversity measurement strategies must focus on areas such as: Cultural Competence, Market Share, Brand, Relationship/Service-based outcomes, etc.

Sample metrics may include:

  • % Market Share
  • $ Share of Wallet by Demographic Group
  • #/% Diversity Competent Leaders/Managers by Demographic Group
  • #/% New Products generated by Demographic Group and for Demographic Groups
  • Improvement in Average Speed of Problem Resolution using Diverse Work Team Suggestions
  • % Favorable Response on Diverse Customer Satisfaction Surveys

In a Business-Business Archetype (B to B) on the other hand, your Diversity Measurement strategies and Diversity Analytics must be “Relationship/Product/Process Focused”. Sample Diversity measurement strategies must focus on areas such as: Innovation, Creativity, Process Improvement, Relationship/Service-based outcomes, etc.

Sample metrics may include:

  • Consultative Selling-Culture/Style Match
  • Customer Relations Effectiveness using Diverse Workforce Suggestions
  • Creativity (Competitive Edge Generation) – # Patents Generated by Demographic Group
  • Innovation (Diverse Work Team)
  • Cycle-time Reduction – Process speed to market
  • Solution Set Match-to-Problem (Improvements generated by diverse team)
  • Cost Reduction (strategic Diversity)

Research to prove the value of Diversity and Inclusion must clearly demonstrate a “causal chain of impact” working through seven levels of analysis as well as isolate Diversity and Inclusion’s contribution from other possible contributors. These processes and sciences are embedded in in the Hubbard Diversity ROI Methodology and the Diversity High Impact Mapping process.

Improving Global Leadership and Management Capability

If an organization plans to sell or deliver goods and services in a diverse marketplace, it must be fully capable of effectively utilizing its diverse workforce in key strategic ways. For instance, it is important from a public relations point of view to be viewed as a company that is known for managing and utilizing its diverse workforce assets well. There are a number of well-publicized ratings for “The Best Company for Working Women and Working Mothers”, “The Most Admired Company” and the “The Top 50 Companies for Women and Minorities”. This fuels a public relations climate where workforce talent and consumers make choices about the organizations they would work for and buy from. This line of thinking is also supported by a study of stock price responses to publicity that changed either positively or negatively on an organization’s ability to manage diversity. Many studies have found that announcements of awards for exemplary efforts resulted in significant positive changes in stock prices while announcements of discrimination suits resulted in significant negative changes in stock prices.

In addition, organizations can gain a lot from the insights of its diverse workforce to understand the cultural effects of buying decisions and mapping strategies to respond to them. Depending on the product or service delivered by the organization, many employees may also represent part of the firm’s customer base! A good reputation inside the organization can help product and service sales outside the organization. Another key marketing strategy includes tapping employee network or resource groups. They can be an excellent resource for focus groups, feedback and ideas for honing the organization’s reach into diverse marketplace opportunities.

Lowering Costs and Increasing Productivity

Revenue increases can also show up due to improvements in diverse work team problem solving and decision-making. Diverse work teams have a broader and richer base of experience to draw on in solving organizations problems and issues. The presence of minority views creates higher levels of critical analysis of assumptions and implications of decisions. In addition, it also generates an increase in the number of alternatives from which the group chooses. Problem solving benefits from diverse work groups do not happen by simply mixing people together who are culturally different. The improved outcomes heavily depend on a diversity-competent manager “utilizing” key diverse insights and experiences of the total group.

In one study, researchers found that properly managed and trained diverse work teams produced scores that were six times higher than homogeneous teams. Researchers also found that it is important how a diverse team uses its diversity. For example, those diverse teams that recognized and utilized their diversity had higher productivity. Even when the team was diverse, if that diversity is not used effectively, it can cause process problems that result in lower team productivity. The essential variable is a Leader’s or Manager’s ability to “effectively manage and utilize the team’s diversity”.

Developing New Revenue Sources

Creativity and innovation can be vital to an organization’s ability to perform. New product introductions, advertising, process re-engineering, quality improvements and the like are examples where these skills are required. Diverse work teams have also been found to promote improved creativity and innovation that generates revenue. In her book “The Change Masters”, Rosabeth Moss Kanter notes that highly innovative companies have done a better job of eradicating racism, sexism, and classism; tend to have workforces that are more race and gender diverse, and take deliberate steps to create heterogeneous work teams with the objective of bringing that diversity to bear on organizational problems and issues. Many organizations such as Pepsico for example, with the introduction of Guacamole Chips, and other innovations, created a plethora of new product SKUs generated by utilizing their diverse Employee Resource and Business Resource Groups.

As the buying power of diverse consumer segments including women, Hispanics, African Americans, and the lesbian, gay, bisexual and transgender community continues to grow, these segments represent a marketplace opportunity too big for retailers and consumer product manufacturers to ignore, according to “The Changing Consumer and the Workforce Imperative” Report. “This report focuses on how the retail and consumer products industry can unleash our multicultural workforces to achieve results that benefit our employees, our communities and our companies,” said Network Chair Michelle Gloeckler, senior vice president for merchandising execution at Walmart Stores. “Research for this project began at last year’s NEW Multicultural Workforce Conference and the results were previewed at this year’s conference in March. The Network believes that diversity and inclusion is critical to the future of our business.”

The report, based in part on one-on-one interviews with more than two-dozen leading U.S. consumer goods and retail executives, explores the correlation between workforce diversity and the ability of the consumer goods and retail industries to engage the changing U.S. consumer.

“Cultural connections are critical to understanding what drives purchasing decisions and brand loyalty across different market segments,” said Alison Paul, immediate past president of the Network of Executive Women, and vice chairman and U.S. retail sector leader, Deloitte LLP. “Making these connections rely on retailers’ and manufacturers’ ability to not only become more culturally aware-which are increasingly table stakes–but harness and value diverse perspectives as a source of innovation.”

Consumer insights most often come from those who share a consumer’s cultural experience, the report concludes. As such, recruiting, retaining and advancing a diverse workforce are integral to creating a brand/consumer connection, as consumers feel most comfortable doing business with companies whose employees mirror their communities.

According to the report, consumer product manufacturers and retailers may be able to achieve an inclusive culture by first understanding the bottom-line business opportunity, then making a commitment to diversity that touches all company departments. Top management should view workforce diversity not as a stand-alone program, but as an essential element for business survival. Achieving cultural competency involves leadership commitment and communication, employee accountability, strong talent recruiting and retention programs, progressive succession planning, diverse supplier relationships, and effective ROI measurement and analysis processes that capture impacts and results.

Appealing to a carefully segmented, diverse market is no longer only a niche opportunity for adventurous store managers and edgy entrepreneurs: Multiculturalism is fast becoming a retail and consumer goods industry opportunity too big to ignore. The same is true for “B to B” organizations as well. A diverse workforce serving a broadened customer base is a critical success factor because, as market research further demonstrates, a diverse workforce improves service outcomes and enhances financial performance regardless of the specific archetype.

Embracing Diversity as a way of thinking is the most effective response for business leaders and an important driver of an organization’s innovative engine. This means Diversity and Inclusion, and the archetypes that drive its constant performance, need to be brought to the forefront of your value proposition and ingrained in the organization’s cultural DNA. It must become a branded component of how you do business. When an authentic, inclusive culture is at work, a diverse workforce becomes capable of producing a broad range of original and engaging ideas that is simply not possible among homogenous employee populations. At the top of the organization, this can translate into more apt and financially rewarding decision-making.

The Diversity ROI Business Case highlighting the link between “Diversity and Inclusion Utilization” and Business Performance, not merely acquiring “Representation” alone, can be made by utilizing Diversity ROI processes and practices. From a Diversity ROI standpoint, Diversity measures and analytics must capture the outcomes and impact of these Diversity and business strategies in a way that demonstrates compelling evidence of Diversity’s contribution to the organization’s business objectives and results. By using tools such as the Diversity ROI 7-Level Chain-of-Impact, the Hubbard Diversity ROI Methodology, the Diversity High Impact Map, a ROI-based Diversity Scorecard, etc., a strong business Diversity ROI Business Case can be made in dollars and “sense” that clearly shows Diversity and Inclusion as “great for business”!

Dr. Hubbard is an expert in Organizational Behavior, Organizational Analysis, Applied Performance Improvement and Measurement Strategies, Strategic Planning, Diversity Measurement, and Organizational Change Methodologies. He holds a Practitioner Certification and Master Practitioner Certification in Neurolinguistic Programming (NLP), a Neuro-science discipline. Dr. Hubbard earned Bachelors and Masters Degrees from Ohio State University and earned a Ph.D. with Honors in Business Administration. Dr. Hubbard is available for Keynote Presentations, Executive Briefings, Workshops, etc. He can be reached at http://www.hubbardnhubbardinc.com/contact-us.html