• Data, AI, & Machine Learning
  • Managing Technology
  • Social Responsibility
  • Workplace, Teams, & Culture
  • AI & Machine Learning
  • Diversity & Inclusion
  • Big ideas Research Projects
  • Artificial Intelligence and Business Strategy
  • Responsible AI
  • Future of the Workforce
  • Future of Leadership
  • All Research Projects
  • AI in Action
  • Most Popular
  • The Truth Behind the Nursing Crisis
  • Work/23: The Big Shift
  • Coaching for the Future-Forward Leader
  • Measuring Culture

Spring 2024 Issue

The spring 2024 issue’s special report looks at how to take advantage of market opportunities in the digital space, and provides advice on building culture and friendships at work; maximizing the benefits of LLMs, corporate venture capital initiatives, and innovation contests; and scaling automation and digital health platform.

  • Past Issues
  • Upcoming Events
  • Video Archive
  • Me, Myself, and AI
  • Three Big Points

MIT Sloan Management Review Logo

Rethinking Performance Management for Post-Pandemic Success

Organizations serious about high performance must rethink performance metrics.

  • Data, AI, & Machine Learning
  • Leadership Skills
  • Talent Management
  • Analytics & Business Intelligence

Performance Management

research articles on performance management

Will dispersed, distributed, and remote workforces become the post-pandemic new normal? It may be too soon to say. Much clearer is how misleading and unhelpful legacy metrics are for assessing work-from-home performance. Pre-COVID-19 workplace analytics are no longer fit for purpose. They don’t capture the disjointed realities of digital workflows. Stressed, separated, and challenged to do better with less, people need greater insight into how they’re doing. Productivity now demands more aggressive and actionable measures.

Recalibrating key performance indicators (KPIs) is essential to ensuring that remote work actually works. Enterprises that want the best from their workers — and for their customers — innovatively invest in digital accountability, but these efforts must acknowledge and respect newly blurred distinctions between work and home life. Digitally colonizing people’s homes is not an option; workforce mood and morale matter. Thoughtful leaders grasp the need for a healthy coexistence.

Email Updates on the Future of Work

Monthly research-based updates on what the future of work means for your workplace, teams, and culture.

Please enter a valid email address

Thank you for signing up

Privacy Policy

Without trust and transparency, remote workforce monitoring appears intrusive and exploitative. With transparency and trust, tracking can authentically be branded and experienced as data-driven workforce support . Increasingly, monitoring and measuring morale — qualitatively, as well as quantitatively — matters. But soft skills deserve hard numbers, too. Emergent post-pandemic dashboards embrace affective metrics as firmly and fairly as effective ones.

That means that leading companies must renovate their data-driven dashboards to better inspire people and project teams and promote positive outcomes. They must automatically capture and analyze, and explicitly communicate, their high-performance criteria. The most important takeaway: High-performance management depends on high-performance measurement. The digital future of one depends on the digital future of the other.

Redefining and remeasuring high performance may prove to be the true disruptive opportunity for post-COVID-19 growth.

At one global professional services company, for example, top management dramatically accelerated project delivery schedules for its newly remote teams. This forcing mechanism deliberately inspired greater communication, coordination, and collaboration expectations for team members. At the same time, however, the company created a complementary buddy system to help ensure that more isolated and/or introverted employees felt connected. Tech support migrated from a back-office help-desk function to a digital project facilitator and enabler for global teams with demanding deadlines. The number of pulse surveys monitoring employee engagement and morale increased from fortnightly to every few days. Top management is tracking what‚ and who — delivers value well.

A senior global research project manager at Adobe programmed his laptop to display a personalized end-of-day dashboard visually summarizing — with pie charts and graphs — how he spent his time, whom he contacted, messages sent and received, documents exchanged, appointments scheduled, commitments made, and to-do list items accomplished, along with the top three items for the following day. He started sharing this dashboard with his team and is now wondering whether he should nudge — or require — colleagues to create comparable dashboards. “Should we be visible to each other in this way?” he asks. He says that such “dashboard transparency” has sparked cross-functional exchanges he’d never had before.

At least two global banks seek to capture remote-working lessons and best practices for internal discussion and sharing. Looking ahead, they’re rethinking whether they really need all the commercial office space they currently possess. They’re now reviewing with IT how significantly having a dispersed workforce alters their process automation road maps. Consequently, IT and its business process owner counterparts now track and map dispersed workforce workflows with a new remote automation strategy in mind.

Using Data to Better (See and Communicate) Performance

Mandatory remoteness quickly obsolesced executive truisms like “management by walking around,” and “under management’s watchful eye,” along with the concept of an “open-door policy.” Disrupted organizations soon learn just how little they know about how well — and how poorly — their people and teams work together. Virtually every serious organization now grasps that some meaningfully measurable form of real-time monitoring is essential to value orchestration and oversight.

For some, this quest for transparency translates to “Trust but verify”; for others, the mantra is “Verify but trust.” Either way, trust is core. “Do I trust my people? Yes,” says one investment banking lead. “Do I now need to be able to see how they spend their time? Yes. They need to trust me, too.”

Proactive enterprise communication is central to this cultural shift. When a Fortune /Adobe survey asked CIOs what has proved to be the biggest challenge in facilitating their companies’ remote work, only 20% said hardware, and 21% tech tools. Over half — 53% — said the hardest issue was getting employees to effectively communicate with one another. Why is that so seemingly hard? There’s certainly no shortage of smart messaging tools. As the COVID-19 crisis reveals, companies overwhelmingly depend on them.

Yet, most companies lack real-time metrics or measures assessing team and/or process communication effectiveness. Typically, those indicators are bundled into performance management reviews. That helps explain an accelerating managerial trend: greater reliance on performance management systems to better orchestrate and upgrade team performance. This emergent application of performance management systems ensures more communication and conversations about performance.

Unsurprisingly, next-generation performance management depends on digital monitoring and tracking platforms to generate real-time analytic insights. Those workflow and process insights can be prescriptive and predictive, as well as descriptive. High-performing leaders embrace this practice. Dispersed, technologically enabled enterprises seamlessly converge people, process, and technology into performance management systems.

With improved dashboards, leaders can see which teams best add value to what processes. They can observe which workflows invite consolidation, automation, and/or professional development . Leadership now has the data and analytics necessary to refine what high performance should mean for people and what it could mean for machines. These insights are indispensable. The more repeatable, replicable, and scalable the high-performance workflow, the better its candidacy for automation and/or machine learning. Correlating and connecting instrumented workflows with KPIs lets organizations turn the “remoteness from COVID-19”-imposed bug into a high-performance-enabling feature.

We see this in law firms, logistics providers, customer contact centers, and even health care providers. From telemedicine to texts about a customer’s arrival for curbside pickup, organizations are repurposing and instrumenting their performance management platforms in ways that measurably redefine high performance.

For example, colocated contact centers have been forced to geographically disperse. This has brutally disrupted legacy work patterns and forced a performance management reevaluation. Chatbots prioritize and route inquiries; support workers more easily message or transfer callers to colleagues; automated follow-ups with relevant links attached are readily sent. Response time, Net Promoter Score, and customer satisfaction KPIs retain pride of metrics place. But better analytics orchestration lets management track the digital blends of process and performance ingredients best correlated to desired outcomes. The resultant data highlights touch points best suited for automation and those where human contact best improves outcomes. The new constraints and opportunities imposed by remoteness and automation have transformed how the contact centers have chosen to align performance assessment, efficiency, and customer response.

Similarly, a “remote-ified” Silicon Valley law firm quickly and effectively deployed transcription-as-a-service to convert every Zoom-based client and partner meeting into editable documents. Instant transcripts dramatically changed how legal teams collaborated with each other and with clients. Measuring value-added revisions to those documents — and how those revisions were included in filings and client communications — immediately emerged as an essential workflow monitoring challenge. Version management governance became a new driver for decision-making. Partners now track their time-and-version ratios between simultaneous and asynchronous review. For some partners and associates, ROI effectively means return on iteration — in other words, which lawyers and legal teams have the biggest productive impact editing, annotating, and converting transcripts into desired client deliverables.

These examples show that successful leaders can use performance management analytics as portal and platform to convert new capabilities and constraints into new value. Data-informed performance management invites and inspires more productive workforce exchanges.

These interim COVID-19 findings represent genuine business applications of conclusions reached by our 2019 research report “ Performance Management’s Digital Shift .” That report anticipated the disruptive dominance data-driven workforce communication would enjoy. “The biggest cultural and organizational impact of next-generation performance management systems,” we observed, “will be feedback time, tempo, and impact. Instead of annual, quarterly, or impromptu reviews, talent- and accountability-oriented enterprises will encourage and enable near-constant feedback.”

Feedback — actionable, constructive, trackable, and influential — is the informational and motivational coin of the digital realm in the post-pandemic distributed workforce. Feedback — data-enriched, KPI-aligned — simultaneously promotes situational awareness and self-awareness. Feedback is how people get better at getting better. High-performance systems require high-performance feedback. Better-quality feedback means better-quality outcomes. This simple management — and leadership — truth is being rediscovered and reconfigured in light of COVID-19.

To cultivate healthy returns from a healthy — if remote and distributed — workforce requires leaders to treat data and analytics as nutrients for people, not just fuel for economic growth. That means leaders need to do the following:

Commit to a continuous feedback culture. Much as individuals use Google Maps or Waze to manage expectations around travel, employees and associates need dynamic visualizations to manage their expectations around work. Performance management platforms must facilitate ongoing feedback on professional progress, growth, and development opportunities. Executives must define the feedback experience for their people. Doing so forces leaders to define and develop a shared perspective about what high performance means.

Commit to clarity between assessment and development. Managers should make clear when feedback targets performance assessment versus cultivating new capabilities and skills. Development matters. Especially for remote workers and distributed teams, human resource policies must balance assessment and the safe cultivation of new skills and capabilities.

Commit to transparency. Post-pandemic performance management credibility and trustworthiness depend on transparency. People must be able to see that their contributions to meetings are recognized and/or that their blown deadlines cost the company a big client. This requires significant shifts in data governance: Connecting and aligning feedback transparency to data collection must become a core cultural value and practice. In short, transparency is the foundation for a performance culture that can also literally be seen as a fair and equitable culture.

Related Articles

Commit to performance management and KPI alignment. Aspiration and expectation require quantification. There is no meaningful performance management without measurable KPIs. High-performance accountability requires clear and concise KPIs or key results. Linking performance management to KPIs or objectives and key results is the strategic duty and obligation of serious leadership. Managers, not HR, ensure that performance management activities support measurable, valuable business outcomes.

There will always be tensions — and opportunities — between managing high-performance people, high-performance machines, and high-performance systems. Innovatively confronting those challenges will be the most important leadership challenge this global pandemic creates.

About the Author

Michael Schrage is a research fellow at the MIT Sloan School of Management’s Initiative on the Digital Economy, where he does research and advisory work on how digital media transforms agency, human capital, and innovation.

More Like This

Add a comment cancel reply.

You must sign in to post a comment. First time here? Sign up for a free account : Comment on articles and get access to many more articles.

Cart

  • SUGGESTED TOPICS
  • The Magazine
  • Newsletters
  • Managing Yourself
  • Managing Teams
  • Work-life Balance
  • The Big Idea
  • Data & Visuals
  • Reading Lists
  • Case Selections
  • HBR Learning
  • Topic Feeds
  • Account Settings
  • Email Preferences

Employee performance management

  • Leadership and managing people
  • Managing people

research articles on performance management

Research: Why Gender Bias Persists, Even When Organizations Try to Curb It

  • Alison Wynn
  • Emily K. Carian
  • Sofia Kennedy
  • JoAnne Wehner
  • December 20, 2023

research articles on performance management

How to Decide Whether to Fire Someone

  • Rebecca Knight
  • January 28, 2019

research articles on performance management

Whether You’re Qualified Depends on How You’re Quantified

  • Michael Schrage
  • October 12, 2015

research articles on performance management

What Makes a 360-Degree Review Successful?

  • Jack Zenger
  • Joseph Folkman
  • December 23, 2020

Will You Help or Heave Your Underperformers?

  • Harvard Management Update
  • February 28, 2008

research articles on performance management

Good Leadership Is Contagious

  • February 17, 2016

research articles on performance management

The Key to Inclusive Leadership

  • Juliet Bourke
  • Andrea Titus
  • Andrea Espedido
  • March 06, 2020

research articles on performance management

Find the Coaching in Criticism

  • Sheila Heen
  • From the January–February 2014 Issue

research articles on performance management

Coaching for Change

  • Richard Boyatzis
  • Melvin L. Smith Jr.
  • Ellen Van Oosten
  • From the September–October 2019 Issue

Job Sculpting: The Art of Retaining Your Best People

  • Timothy Butler
  • James Waldroop
  • From the September–October 1999 Issue

research articles on performance management

Research: Career Hot Streaks Can Happen at Any Age

  • Dashun Wang
  • October 05, 2018

When Do You Show Underperformers the Door?

  • Paul Michelman
  • June 18, 2007

research articles on performance management

Conduct an Informal 360

  • Scott K. Edinger
  • April 03, 2012

research articles on performance management

Making Performance Reviews Fairer in a Hybrid Workplace

  • Scott Behson
  • February 03, 2023

Taking Time Seriously in Evaluating Jobs

  • Elliott Jaques
  • From the September 1979 Issue

Control in an Age of Empowerment

  • Robert Simons
  • From the March–April 1995 Issue

research articles on performance management

Reimagining the Urban Office

  • Peter Bacevice
  • Pantea Tehrani
  • Mat Triebner
  • August 14, 2020

research articles on performance management

Talent Management and the Dual-Career Couple

  • Jennifer Petriglieri
  • From the May–June 2018 Issue

Inside Microsoft: Balancing Creativity and Discipline

  • Robert J. Herbold
  • From the January 2002 Issue

research articles on performance management

Why COOs Should Think Like Behavioral Economists

  • Geoff Donaker
  • Michael Luca
  • October 31, 2017

research articles on performance management

Hubtown (B): Implementing a Bottom-Up Approach to Performance Management

  • Kajari Mukherjee
  • Meenakshi Aggarwal-Gupta
  • December 21, 2016

Incentive Systems

  • Brian J. Hall
  • December 21, 2015

Shinsei Bank: Developing an Integrated Firm

  • Thomas J. DeLong
  • September 05, 2006

research articles on performance management

The Emotionally Intelligent Team: Building Collaborative Groups That Outperform the Rest

  • Vanessa Urch Druskat
  • August 12, 2025

A Day in the Life of Alex Sander: Driving in the Fast Lane at Landon Care Products

  • Elizabeth Collins
  • Larry E. Greiner
  • April 11, 2008

Playgrounds and Performance: Results Management at KaBOOM! (A)

  • Herman B. Leonard
  • Marc J. Epstein
  • Laura Winig
  • November 03, 2005

Stress in the Workplace: Mental Health Conversations-The Employee

  • Gabrielle Adams
  • Jazmin Brown-Iannuzzi
  • Jaclyn Lisnek
  • Melanie Prengler
  • Gerry Yemen
  • August 06, 2023

Stress in the Workplace: Mental Health Conversations-The Boss

Man jit singh at sony entertainment television (a).

  • Linda A. Hill
  • Dana M. Teppert
  • Allison J. Wigen
  • November 18, 2013

Business at the Base of the Pyramid: Understanding Impact and Impact Evaluations

  • V. Kasturi Rangan
  • Tricia Gregg
  • January 16, 2018

Road to Hell (A)

  • Gareth Evans
  • May 01, 1980

Note on Analyzing and Choosing a Job Offer

  • Monica Higgins
  • October 13, 2004

Shelley Metzenbaum and Improving Federal Government Performance

  • Thomas Glynn
  • February 06, 2012

research articles on performance management

People, Performance, and Succeeding as a Manager (HBR Work Smart Series)

  • Harvard Business Review
  • November 12, 2024

research articles on performance management

HBR's 10 Must Reads for HR Leaders Collection (5 Books)

  • Marcus Buckingham
  • W. Chan Kim
  • Renee A. Mauborgne
  • John P. Kotter
  • December 10, 2019

Michelle Rhee's IMPACT on the Washington D.C. Public Schools

  • Patricia Garcia-Rios
  • August 23, 2012

Transition at DataCo?

  • Frank V. Cespedes
  • Carin-Isabel Knoop
  • March 09, 2016

Orientation to the Influence Style Questionnaire, Winter 2000

  • Herminia Ibarra
  • Katherine Lawrence
  • January 14, 1998

The Sophomore Jinx

  • Phillip E. Pfeifer
  • April 08, 1991

Career Strategies and Tactics in Professional Service Firms

  • Ashish Nanda
  • Scot Landry
  • April 24, 2000

research articles on performance management

Mabel's Labels: Leading in a Results-Only Work Environment - Teaching Note

  • Alison Konrad
  • Lindsay Birbrager
  • October 14, 2015

New Insights into Enron

  • Malcolm S. Salter
  • August 17, 2006

Popular Topics

Partner center.

In the spotlight: Performance management that puts people first

In volatile times, companies are under outsize pressure to respond to economic, technological, and social changes. Effective performance management systems can be a powerful part of this response. They’re designed to help people get better in their work, and they offer clarity in career development and professional performance. And then there’s the big picture: companies that focus on their people’s performance are 4.2 times more likely to outperform their peers, realizing an average 30 percent higher revenue growth and experiencing attrition five percentage points lower (see sidebar, “About the research”). Companies that focus on their people and organizational health also reap dividends in culture, collaboration, and innovation—as well as sustained competitive performance. 1 Alex Camp, Arne Gast, Drew Goldstein, and Brooke Weddle, “ Organizational health is (still) the key to long-term performance ,” McKinsey, February 12, 2024.

Today, company leaders lack full confidence in most performance management systems—despite these systems’ importance and value—citing fragmentation, the existence of informal or “shadow” systems, misalignment, and inconsistency as common challenges. What sort of systems fit the company’s needs? Should rewards focus on individual or team goals? Where are limited resources best spent?

About the research

The insights in this article draw from a comprehensive review of industry best practices, including the experiences of more than 30 global companies across sectors, as well as research by the McKinsey Global Institute (MGI) into how companies gain a competitive edge and deliver top-tier financial results. Specifically, MGI studied more than 1,800 companies with revenues of greater than $100 million. 1 Performance through people: Transforming human capital into competitive advantage ; MGI, February 2, 2023. The article’s author team also completed a study of more than 50 companies’ performance management practices, aiming to provide a nuanced understanding of how organizations approach and execute performance management.

An understanding of the four basic elements of performance management—goal setting, performance reviews, ongoing development, and rewards—provides a foundation for answering these questions and more. Of course, the right performance management system will vary by organization. Leaders who embrace a fit-for-purpose design built on a proven set of core innovations can build motivational and meritocratic companies that attract and retain outstanding employees.

How leading companies approach performance management

Our research across a set of global companies found that despite widespread agreement about certain performance management best practices—such as offering regular feedback outside of an annual review—many companies remain stuck in old ways of working. There are many design choices that can determine the characteristics of a performance management system, but some are more critical than others (Exhibit 1). These decisions—and how they interact with each other—will help determine how the performance management system maps onto the company’s overarching strategy.

Goal setting

Two critical design decisions relate to goal setting: the number of performance management systems used and whether to prioritize individual or team performance goals.

Degree of differentiation. The simplest and best option for many organizations is a single performance management system to address the needs of all employees. However, in more-complex companies with several employee groups, more than one system might be necessary. Manufacturing companies, for instance, may employ three performance management systems with few commonalities: one for sales, in which sales agents are provided direct incentives for the number of goods sold; one for production, with a monthly rhythm focusing on improving core production KPIs; and one for executives, in which the focus might be related more to annual objectives and leadership behavior.

Considerations for these choices often revolve around the nature of the work and the ease of quantifying outputs. For roles in which performance can be easily measured through tangible metrics, such as sales and production, a system emphasizing quantifiable outcomes may be more suitable. On the other hand, for roles involving tasks that are less easily measured, such as those in R&D, a performance management system should be designed to accommodate the nuanced and less tangible aspects of their contributions.

The nucleus of performance. Many organizations have traditionally placed a strong emphasis on individual performance, rooted in the belief that individual accountability drives results. In recent years, there has been a noticeable shift toward recognizing the importance of the team in achieving overall organizational success.

At a large European online retailer, for instance, the focus of performance management has been put on the team rather than the individual. Goals are set for the team, feedback is given to the team, and the performance appraisal is conducted for the team. Example performance metrics for teams can include project completion timelines, cross-functional collaboration success, and the achievement of collective milestones. On an individual level, the company assesses performance using a sophisticated model that prescribes skills and behaviors for 14 job families, each with up to four hierarchies.

Another prominent company in the automotive industry underscores the team as the cornerstone of performance. The teams could be defined along both functional and organizational lines—such as the division or the business line—and the company linked the organizational lines’ performance to the individuals’ compensation.

Performance reviews

Performance reviews raise the question of how to balance the individual objectives and their appraisal with respect to the “what” and the “how,” as well as whether review responsibility should lie primarily with managers, committees, or a combination of both.

Performance formula: What versus how. The balance between setting objectives and assessing what employees accomplish and how they go about their work is the central focus here. To measure the “what,” reviews have traditionally used KPIs, concentrating on quantifiable metrics and specific targets and emphasizing measurable outcomes and achievements. 2 For more on metrics best practices and how they can help leaders avoid pitfalls in their performance management systems, see Raffaele Carpi, John Douglas, and Frédéric Gascon, “ Performance management: Why keeping score is so important, and so hard ,” McKinsey, October 4, 2017.

However, for many roles and in many segments of the company, the work is complex, multifaceted, and fast-paced and can be difficult to capture with rather static KPIs. Consequently, many companies have reverted to using objective key results (OKRs) to link results to defined objectives. The objectives represent the qualitative, aspirational goals an individual or team aims to achieve, while the key results are the quantifiable metrics used to measure progress toward those objectives. The objectives provide context and direction, capturing the broader strategic intent behind the measurable key results.

Companies that explicitly focus a portion of performance reviews on the “how” consider qualities such as collaboration, communication, adaptability, and ethical decision making. Considering behavior and conduct, in particular, can help assess leaders whose teams’ outcomes are hard to measure—such as long-term projects, complex initiatives, or qualitative improvements that may not have easily quantifiable metrics. About three in five companies in our sample look at a mix of both what and how, which can equip managers with a more comprehensive understanding of not only tangible results but also the underlying approach and mindset that contributed to those outcomes.

Review responsibility. In structuring accountability for conducting performance reviews, companies tend to lean on managers, committees, or a combination of both.

Managers should play a central role, and their discretion should be a significant factor in performance assessments because they can judge the context in which an employee has been working. For example, when evaluating performance, it’s crucial to consider the headwinds and tailwinds that the business, team, or employee faced during the evaluation period. External factors, market conditions, and organizational dynamics can significantly affect an employee’s ability to achieve their goals, and considering them helps provide a fair and contextual assessment.

In this context, another design question emerges: whether to appraise employees against OKR fulfilment or the effort they put into achieving the desired outcome. Particularly in many large digital players, OKRs are set as “moonshot” goals—objectives so ambitious they are difficult to achieve. Managers can help ensure that, at the end of the performance cycle, an employee is assessed against not only OKR fulfillment but also—and to an even greater degree—how hard they tried given the resources available to them.

Managers’ points of view, formed with knowledge of the circumstances that produced employees’ performance, produce richer assessments that are sensitive to context—given that managers work closely with their team members and have firsthand knowledge of the challenges, workloads, and specific situations that each employee encounters.

Committees, meanwhile, bring diverse perspectives and can mitigate biases that might arise from individual managers’ subjectivity. Committees can provide a checks-and-balances system, promoting consistency and standardization in the evaluation process.

A combination of these two approaches can be an effective solution. Senior managers and high performers across hierarchies could be discussed in committees, while the rest of the workforce could be evaluated by their direct managers. This integrated approach leverages the contextual insights of managers while also incorporating the diverse viewpoints and standardization that committees offer, particularly for more-senior or high-impact roles.

Regardless of the review responsibility structure, it’s worth noting that more and more managers, committees, and employees are using generative AI (gen AI) to aggregate and extract information to inform performance reviews. For example, some employees may toil to define clear, specific, and measurable goals that align with their career aspirations; gen AI can help create a first draft and iterate based on their role, helping the employee focus on their specific growth areas as well as gauge improvement on an ongoing basis. Managers and committees, meanwhile, used to spend a lot of time gathering performance metrics from different sources and systems for employee evaluation. Gen AI can aggregate input from various sources into a consolidated format to provide managers with a more comprehensive starting point for reviews.

Beyond employees’ formal professional-development opportunities, their managers’ capability to set goals, appraise performance fairly and motivationally, and provide feedback is one of the most critical success factors for an effective performance management system. As a result, many companies have pivoted to invest in focused capability building.

Ongoing development

Another key aspect to consider when designing a performance management system is the focus of the assessment: will it evaluate past performances, or will the emphasis be placed on creating an understanding and foundation for further growth?

A backward-looking assessment will focus on fulfillment of the what and how objectives to create a fair basis for ranking and related consequences. However, many companies are pivoting to complement this assessment or are even focusing entirely on a developmental appraisal. In this approach, the focus is on truly understanding the strengths and weaknesses of the individual as a basis for further development, capability building, and personal growth.

Against that backdrop, rather than concentrating solely on top performers, an inclusive developmental system should cater to the growth needs of employees across all levels and backgrounds. McKinsey research emphasizes the importance of ongoing development for all employees, including—crucially—efforts tailored specifically for women 3 Women in the Workplace 2023 , McKinsey, October 5, 2023. and other underrepresented groups. 4 Diversity matters even more: The case for holistic impact , McKinsey, December 5, 2023. Such development programs not only foster a more equitable culture but also help unlock the full potential of the entire workforce.

Traditionally, many companies have used relative ratings to compare and rank employees against one another, often resulting in a forced distribution or curve. Employees are placed into categories or tiers based on their relative performance, with a predetermined percentage falling into each category (for example, top 10 percent, middle 70 percent, and bottom 20 percent).

Many companies today are simplifying their ratings systems so employees understand where they stand while shifting toward development approaches tailored to individuals’ strengths and weaknesses. The goal is to identify areas for growth and provide targeted support to help employees enhance their capabilities and skills.

While assessing performance remains important, the emphasis should be on using those assessments as a starting point for identifying developmental opportunities, with an understanding of both strengths and weaknesses and the specific development needs to improve performance. The focus shifts from mere evaluation to understanding the underlying factors that contribute to an individual’s performance, be it skills gaps, mindsets, or environmental factors.

Four reward categories—compensation, career progression, development opportunities, and recognition—remain the core pillars of an effective performance management system. Most leading companies provide individual rewards (as opposed to team- or corporate-driven ones), with equal relevance given to short- and long-term incentives, looking at impact holistically and balancing investment in all four reward categories.

Under certain circumstances, it may make sense to emphasize financial rewards, particularly in sales functions or other roles where monetary incentives are highly valued. Indeed, some organizations may double down on monetary compensation, offering significantly higher pay packages to their top performers, because money is seen as a key motivator in these roles.

In other cases, it may be more effective to take money off the table and emphasize nonfinancial rewards, such as recognition, flexibility, and career development opportunities. While base pay may remain the same across the firm, high performers can be rewarded with faster career progression, more recognition, and better development opportunities. A 2009 McKinsey survey found that “three noncash motivators—praise from immediate managers, leadership attention (for example, one-on-one conversations), and a chance to lead projects or task forces” were “no less or even more effective motivators than the three highest-rated financial incentives: cash bonuses, increased base pay, and stock or stock options.” Furthermore, “The survey’s top three nonfinancial motivators play critical roles in making employees feel that their companies value them, take their well-being seriously, and strive to create opportunities for career growth.” 5 “ Motivating people: Getting beyond money ,” McKinsey Quarterly , November 1, 2009. More than a decade later, McKinsey research found that managers and employees remain misaligned: specifically, employers overlook the relational elements—such as feeling valued by a manager and the organization and feeling a sense of belonging—relative to how important these factors are to employee retention (Exhibit 2). 6 “ ‘ Great Attrition’ or ‘Great Attraction’? The choice is yours ,” McKinsey Quarterly , September 8, 2021. Indeed, the importance of nonmonetary incentives represents a consistent theme in performance management research and inquiry.

Given the time and effort required to effectively implement nonfinancial rewards, it’s crucial for organizations to carefully consider how to deploy these rewards strategically with employee groups. The decision of where to place emphasis should align with the organization’s culture, values, and the specific workforce’s motivations.

It’s worth noting that companies focusing on team achievement over individual performance also tend to value praise of the team. Public recognition and praise for effective teamwork and joint accomplishments can foster a sense of unity, camaraderie, and motivation.

Things to get right

Of the global companies we observed, there was a shared set of enabling factors across those with effective performance management systems. These things are fairly intuitive, but they are hard to practice well. Done consistently, they can produce powerful results.

  • Ensure that performance management systems are agile. Systems should allow for goals to be easily updated so the workforce—and therefore the organization—can respond to quickly changing conditions. The processes themselves should also be agile. For instance, relationships and interactions between managers and employees should allow for coaching that is close to real time so employees are consistently being pushed in the right direction—and learning to create that momentum themselves.
  • Provide regular feedback. Annual reviews can create a bottleneck on managers and the C-suite. More regular performance conversations can be successful in a variety of formats; quarterly, weekly, and casual check-ins should supplement formal reviews. Conversations can be about both the what and the how of the work and be a source of ongoing coaching.

If reviews remain once a year rather than more frequent, top management may consider prioritizing their direct involvement in the evaluation process to keep a pulse on employee sentiment and progress. A leading financial institution in Europe chose this route and found it was able to build a strong capability-building program around a feedback culture that is unafraid of difficult conversations.

  • Establish an effective fact base. According to our research, only two in five companies use both upward and downward evaluation in individual performance reviews. To establish a more comprehensive fact base, organizations can implement robust 360° review processes that solicit feedback from an employee’s manager, peers, direct reports, and even customers or stakeholders outside the company. Many leaders have found that 360° reviews offer a comprehensive understanding of an individual’s performance because such reviews consider perspectives from both those who are led and those who are in leadership roles.
  • Maintain rating and differentiation. Many companies have reassessed their approach to employee ratings and the subsequent differentiation of consequences. While some companies have eliminated ratings altogether, most companies have been evolving their systems to drive motivation, recognize and incentivize performance, and create a “talent currency.” This means a high performer from one division is considered by the organization to be of the same caliber as one from another division. Overall, leaders are pushing for simplification, such as moving from a seven-tier approach to a four-tier or even three-tier system. There is also a stronger link between ratings and outcomes, as well as a shift from forced distribution to distribution guidance.
  • Employ gen AI. Gen AI—the latest technology to change the business landscape—can be a tool to support select elements of performance management, such as setting goals and drafting performance reviews. A manager could use the technology to aggregate and synthesize input from different sources to draft communications to and about employees more efficiently, freeing them to focus on the core value driving parts of performance management and giving more time for personal interactions with their employees, such as coaching and feedback. 7 For more, see People and Organization Blog , “ Four ways to start using generative AI in HR ,” blog post by Julian Kirchherr, Dana Maor, Kira Rupietta, and Kirsten Weerda, McKinsey, March 4, 2024.

Getting started

Companies can get started by understanding where they are now. Specifically, they should assess their organizations’ current performance culture, including the level of adoption of the existing performance management system and its quality. Decision makers should then use the following three questions to check the health of their performance management efforts and outline their ambitions for performance management:

  • Are we getting the expected returns from the time invested in the performance management process, and does it drive higher performance and capabilities?
  • Does the current performance management system reflect the needs and context of this particular business or workforce segment?
  • Do we have a performance culture? (Hint: How frequent are employees’ coaching interactions? How clear and differentiated is feedback?)

Many traditional approaches to people management are unlikely to suffice in today’s top-performing organizations. The research-backed benefits of prioritizing people’s performance, from enhanced revenue growth to lower attrition rates, underscore the strategic importance of these systems. By embracing a fit-for-purpose design anchored in the key elements of performance management, organizations can position themselves as dynamic and adaptive employers.

Simon Gallot Lavallée is an associate partner in McKinsey’s Milan office, where Andrea Pedroni  is a partner; Asmus Komm is a partner in the Hamburg office; and Amaia Noguera Lasa is a partner in the Madrid office.

The authors wish to thank Katharina Wagner, Brooke Weddle, and the many industry professionals who contributed to the development of this article.

Explore a career with us

Related articles.

Image of people celebrating in an office with a woman smiling and being hugged by her coworker.

Gen AI talent: Your next flight risk

Vector illustration of a tree with blossoms and roots going into the ground.

Increasing your return on talent: The moves and metrics that matter

Glass ball abstract background. 3d

CEO excellence: How do leaders assess their own performance?

  • Browse All Articles
  • Newsletter Sign-Up

Performance →

research articles on performance management

  • 02 Apr 2024
  • Research & Ideas

Employees Out Sick? Inside One Company's Creative Approach to Staying Productive

Regular absenteeism can hobble output and even bring down a business. But fostering a collaborative culture that brings managers together can help companies weather surges of sick days and no-shows. Research by Jorge Tamayo shows how.

research articles on performance management

  • 02 Jan 2024
  • What Do You Think?

Do Boomerang CEOs Get a Bad Rap?

Several companies have brought back formerly successful CEOs in hopes of breathing new life into their organizations—with mixed results. But are we even measuring the boomerang CEOs' performance properly? asks James Heskett. Open for comment; 0 Comments.

research articles on performance management

  • 22 Nov 2023

Humans vs. Machines: Untangling the Tasks AI Can (and Can't) Handle

Are you a centaur or a cyborg? A study of 750 consultants sheds new light on the strengths and limits of ChatGPT, and what it takes to operationalize generative AI. Research by Edward McFowland III, Karim Lakhani, Fabrizio Dell'Acqua, and colleagues.

research articles on performance management

  • 06 Oct 2023

Yes, You Can Radically Change Your Organization in One Week

Skip the committees and the multi-year roadmap. With the right conditions, leaders can confront even complex organizational problems in one week. Frances Frei and Anne Morriss explain how in their book Move Fast and Fix Things.

research articles on performance management

  • 28 Aug 2023

The Clock Is Ticking: 3 Ways to Manage Your Time Better

Life is short. Are you using your time wisely? Leslie Perlow, Arthur Brooks, and DJ DiDonna offer time management advice to help you work smarter and live happier.

research articles on performance management

  • 08 Aug 2023

The Rise of Employee Analytics: Productivity Dream or Micromanagement Nightmare?

"People analytics"—using employee data to make management decisions—could soon transform the workplace and hiring, but implementation will be critical, says Jeffrey Polzer. After all, do managers really need to know about employees' every keystroke?

research articles on performance management

  • 01 Aug 2023

As Leaders, Why Do We Continue to Reward A, While Hoping for B?

Companies often encourage the bad behavior that executives publicly rebuke—usually in pursuit of short-term performance. What keeps leaders from truly aligning incentives and goals? asks James Heskett. Open for comment; 0 Comments.

research articles on performance management

  • 14 Jun 2023

Four Steps to Building the Psychological Safety That High-Performing Teams Need

Struggling to spark strategic risk-taking and creative thinking? In the post-pandemic workplace, teams need psychological safety more than ever, and a new analysis by Amy Edmondson highlights the best ways to nurture it.

research articles on performance management

  • 05 Jun 2023

Is the Anxious Achiever a Post-Pandemic Relic?

Achievement has been a salve for self-doubt for many generations. But many of the oldest members of Gen Z, who came of age amid COVID-19, think differently about the value of work. Will they forge a new leadership style? wonders James Heskett. Open for comment; 0 Comments.

research articles on performance management

  • 27 Feb 2023

How One Late Employee Can Hurt Your Business: Data from 25 Million Timecards

Employees who clock in a few minutes late—or not at all—often dampen sales and productivity, says a study of 100,000 workers by Ananth Raman and Caleb Kwon. What can managers do to address chronic tardiness and absenteeism?

research articles on performance management

  • 01 Feb 2023

Will Hybrid Work Strategies Pull Down Long-Term Performance?

Many academics consider remote and hybrid work the future, but some business leaders are pushing back. Can colleagues working from anywhere still create the special glue that bonds teams together? asks James Heskett. Open for comment; 0 Comments.

research articles on performance management

  • 23 Aug 2022
  • Cold Call Podcast

Management Lessons from the Sinking of the SS El Faro

Captain Michael Davidson of the container ship SS El Faro was determined to make his planned shipping trip on time—but a hurricane was approaching his intended path. To succeed, Davidson and his fellow officers had to plot a course to avoid the storm in the face of conflicting weather reports from multiple sources and differing opinions among the officers about what to do. Over the 36-hour voyage, tensions rose as the ship got closer and closer to the storm. And there were other factors compounding the challenge. The El Faro was an old ship, about to be scrapped. Its owner, TOTE Maritime, was in the process of selecting officers to crew its new ships. Davidson and some of his officers knew the company measured a ship’s on-time arrival and factored that into performance reviews and hiring decisions. When the ship ultimately sunk on October 1, 2015, it was the deadliest American shipping disaster in decades. But who was to blame for the tragedy and what can we learn from it? Professor Joe Fuller discusses the culpability of the captain, as well as his subordinates, and what it reveals about how leaders and their teams communicate under pressure in his case, "Into the Raging Sea: Final Voyage of the SS El Faro."

research articles on performance management

  • 01 Aug 2022

Does Religious Belief Affect Organizational Performance?

Chinese firms exposed to Confucianism outperformed peers and contributed more to their communities, says a recent study. James Heskett considers whether the role of religion in management merits further research. Open for comment; 0 Comments.

research articles on performance management

  • 22 Mar 2022

How Etsy Found Its Purpose and Crafted a Turnaround

Etsy, the online seller of handmade goods, was founded in 2005 as an alternative to companies that sold mass-manufactured products. The company grew substantially, but remained unprofitable under the leadership of two early CEOs. Ten years later, Etsy went public and was forced into a new arena, where it was beholden to stakeholders who demanded financial success and accountability. Unable to contain costs, the company was almost bought out by private equity firms in 2017—until CEO Josh Silverman arrived with a mission to save the company financially and, in the process, save its soul. Harvard Business School professor Ranjay Gulati discusses the purpose-driven turnaround Silverman and his team led at Etsy—to make the company profitable and improve its social and environmental impact—in the case, “Etsy: Crafting a Turnaround to Save the Business and Its Soul.” Open for comment; 0 Comments.

research articles on performance management

  • 09 Nov 2021

The Simple Secret of Effective Mentoring Programs

The employees who need guidance most rarely seek it out. New research by Christopher Stanton sheds light on what companies stand to gain from mentorship programs that include everyone. Open for comment; 0 Comments.

research articles on performance management

  • 22 Oct 2021

Want Hybrid Work to Succeed? Trust, Don’t Track, Employees

Many companies want employees back at desks, but workers want more flexibility than ever. Tsedal Neeley offers three rules for senior managers trying to forge a new hybrid path. Open for comment; 0 Comments.

research articles on performance management

  • 13 Jul 2021

Strategies for Underdogs: How Alibaba’s Taobao Beat eBay in China

In 2007, Alibaba’s Taobao became China’s leading consumer e-commerce marketplace, displacing the once dominant eBay. How did underdog Taobao do it? And will it be able to find a way to monetize its marketplace and ensure future success? Professor Felix Oberholzer-Gee discusses his case, “Alibaba’s Taobao,” and related strategy lessons from his new book, Better, Simpler Strategy: A Value-Based Guide to Exceptional Performance. Open for comment; 0 Comments.

research articles on performance management

  • 20 Oct 2020
  • Sharpening Your Skills

Steps to Help You Get Out of Your Own Way

These research-based tips will help you slow down, fight the fog, and improve both your home life and work life. Open for comment; 0 Comments.

research articles on performance management

  • 08 Oct 2020

Keep Your Weary Workers Engaged and Motivated

Humans are motivated by four drives: acquire, bond, comprehend, and defend. Boris Groysberg and Robin Abrahams discuss how managers can use all four to keep employees engaged. Open for comment; 0 Comments.

research articles on performance management

  • 29 Sep 2020

Employee Performance vs. Company Values: A Manager’s Dilemma

The Cold Call podcast celebrate its five-year anniversary with a classic case study. Harvard Business School Dean Nitin Nohria discusses the dilemma of how to treat a brilliant individual performer who can't work with colleagues. Open for comment; 0 Comments.

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • Perspect Behav Sci
  • v.42(4); 2019 Dec

Evidence-Based Performance Management: Applying Behavioral Science to Support Practitioners

Matthew d. novak.

4001 Dole Human Development Center, Department of Applied Behavioral Science, University of Kansas, 1000 Sunnyside Avenue, Lawrence, KS 66045 USA

Florence D. DiGennaro Reed

Tyler g. erath, abigail l. blackman, sandra a. ruby, azure j. pellegrino.

The science of behavior has effectively addressed many areas of social importance, including the performance management of staff working in human-service settings. Evidence-based performance management entails initial preservice training and ongoing staff support. Initial training reflects a critical first training component and is necessary for staff to work independently within an organization. However, investment in staff must not end once preservice training is complete. Ongoing staff support should follow preservice training and involves continued coaching and feedback. The purpose of this article is to bridge the research-to-practice gap by outlining research-supported initial training and ongoing staff support procedures within human-serving settings, presenting practice guidelines, and sharing information about easy-to-implement ways practitioners may stay abreast of current research.

Train people well enough so they can leave, treat them well enough so they don’t want to. —Richard Branson

The science of behavior has effectively addressed many areas of social importance including education (e.g., Sulzer-Azaroff & Gillat, 1990 ), traffic safety (e.g., van Houten, Nau, & Marini, 1980 ; Yeaton & Bailey, 1978 ), substance use (e.g., Higgins, Silverman, & Heil, 2007 ), parent training (e.g., Lindgren et al., 2016 ; Phaneuf & McIntyre, 2007 ), behavioral medicine (e.g., Piazza, Milnes, & Shalev, 2015 ), and others. Perhaps the most widely known application is the behavioral treatment of autism (Freedman, 2016 ). Due to the research supporting its effectiveness (e.g., National Autism Center, 2009 , 2015 ), autism treatment based on the principles of behavior analysis is endorsed by the U.S. Surgeon General (U.S. Department of Health & Human Services, 1999 ), National Institutes of Health (Strock, 2007 ), and the National Research Council (Lord & McGee, 2001 ). The model that has evolved for the provision of services to individuals with autism and other disabilities presents a challenge that is unique to those in health and human services. Whereas psychological therapy is delivered by licensed psychologists and medical procedures are performed by doctors, behavior analysts with the most amount of training and education (i.e., Board Certified Behavior Analysts®) often do not deliver services directly. Rather, they typically oversee the provision of services delivered by others. Thus, the challenge for those providing behavioral services to vulnerable populations is ensuring that individuals with relatively less training and education (i.e., Registered Behavior Technicians® or Board Certified Assistant Behavior Analysts®) provide direct services in an effective and responsible manner.

To be successful, this unique service model necessitates effective performance management—the careful training and supervision of staff who implement behavioral treatment. Unfortunately, recent research suggests the field could benefit from improvements in this area. DiGennaro Reed and Henley ( 2015 ) administered a survey to certified and aspiring behavior analysts to determine the extent to which evidence-based staff training practices were implemented by their employers. The results were worrisome and launched efforts by the authors to disseminate recommended practices to practitioners and organizational leaders (e.g., DiGennaro Reed, 2016 , 2017 , 2018 , 2019 ; Henley, 2018 , 2019 ). Only 55% of respondents indicated they received initial training after being hired; when training was provided, organizations relied on tactics with little empirical support, such as instruction alone. Fortunately, 71% of respondents reported they received ongoing training and support, but primarily in the forms of a lecture or monthly feedback, which are typically less effective than other forms of performance management. Respondents who worked as supervisors were also queried about the training they received to prepare them for the important responsibility of leading and managing staff. Only 33% indicated they received any formal training on how to effectively implement research-supported supervision practices. These results suggest training and performance management in settings that employ behavior analysts are not consistent with recommended practices. Many respondents began working without any formal training, received less-than-ideal ongoing support, and were expected to supervise staff without any guidance regarding best practices.

Many practicing behavior analysts lack sufficient training and ongoing support, which is worrisome because the lack of evidence-based staff training and performance management may lead to negative outcomes, including staff turnover, poor service quality, and charges of unethical conduct. Kazemi, Shapiro, and Kavner ( 2015 ) surveyed 100 behavior technicians from several companies and found that satisfaction with initial training, ongoing staff support, and supervisor behavior were key factors influencing respondents’ intent to quit their jobs. These results suggest that providing evidence-based staff training may help to mitigate staff turnover, which is reported to be as high as 75% within human-service organizations (Kazemi et al., 2015 ). Moreover, staff turnover places substantial financial strain on an organization, with average costs ranging from $5,000 for a single behavior technician to $10,000 for a certified behavior analyst (Sundberg, 2016 ).

In addition to affecting workforce stability, insufficient training and performance management may further disrupt the quality of behavioral services by influencing treatment integrity—the extent to which prescribed treatment procedures are implemented correctly (Peterson, Homer, & Wonderlich, 1982 ). In a review of 19 parametric analyses of treatment integrity, Brand, Henley, DiGennaro Reed, Gray, and Crabbs ( 2019 ) reported that treatment integrity errors produce unpredictable client outcomes. Although, in some instances, errors in behavioral treatment did not negatively influence client skill acquisition or problem behavior (e.g., Leon, Wilder, Majdalany, Myers, & Saini, 2014 ), in general researchers showed that integrity errors resulted in slower learner progress and less effective treatment. These findings underscore the importance of ensuring that staff implement treatment protocols as designed, which is fostered by the quality of training and performance management staff experience.

Insufficient performance management practices may have consequences that extend beyond affecting direct services; they may carry severe consequences for behavior analysts individually as well as for the profession more broadly. To ensure quality provision of services, the Behavior Analyst Certification Board® (BACB®) Professional and Ethical Compliance Code for Behavior Analysts (BACB, 2014 ) outlines a set of guidelines that all behavior analysts must follow. For example, section 5.03 of the Code states, “If the supervisee does not have the skills necessary to perform competently, ethically, and safely, behavior analysts provide conditions for the acquisition of those skills” (p. 14). Thus, supervisors are obligated to provide staff with effective training. On the topic of ongoing staff support, section 5.06 states, “Behavior analysts design feedback and reinforcement systems in a way that improves supervisee performance. Behavior analysts provide documented, timely feedback regarding the performance of a supervisee on an ongoing basis” (p. 14). Together these statements indicate that behavior analysts must rely on evidence-based staff training and performance management procedures to ensure compliance with this code. Failure to do so may result in ethical charges against the credentialed behavior analyst, which could lead to loss of certification or state licensure.

Evidence-based performance management involves a program that includes initial preservice training and ongoing staff support. Initial training, often referred to as orientation or onboarding , reflects a critical first training component and is necessary for staff to work independently within an organization. However, investment in staff must not end once preservice training is complete. Ongoing staff support should follow preservice training and it involves supervisors providing continued coaching and feedback regarding the staff’s performance in one or more areas. The purpose of this article is to bridge the research-to-practice gap by outlining research-supported initial training and ongoing staff support procedures within human-service settings, presenting practice guidelines based on our experience and current research, and sharing information about ways to stay up to date with research.

Preservice Training

The natural first step to ensuring high-quality staff training is the delivery of preservice training, which allows new employees to learn relevant job skills in a controlled, distraction-free environment. Although orientation and onboarding procedures are ubiquitous across all forms of employment, the presence of training alone does not guarantee proficiency with job skills. To be most effective, preservice training should use empirically supported training techniques. One empirically supported technique is behavioral skills training (BST), which is a procedure used to train new skills through a package including instruction, modeling, rehearsal, and feedback (Parsons, Rollyson, & Reid, 2012 ). Behavioral skills training can be implemented individually or in groups and has been used to train several tasks in the human service industry, including discrete trial instruction (Sarokoff & Sturmey, 2004 ) and mand training (Nigro-Bruzzi & Sturmey, 2010 ) among others. Each component of BST is outlined below.

Instruction

The first component of BST is instruction, which involves describing a target skill or behavior one expects the trainee to perform (Miltenberger, 2016 ). Trainers can deliver instruction by describing procedures vocally (e.g., lecture, discussion) or textually (e.g., written protocols). Written protocols can include text alone or text with supplemental components, such as diagrams and images (i.e., enhanced written instructions; Berkman, Roscoe, & Bourret, 2019 ; Graff & Karsten, 2012 ). All too often, preservice training ends after instruction alone (DiGennaro Reed & Henley, 2015 ). It is critical to know that instruction alone is insufficient in training new skills (Ducharme & Feldman, 1992 ). Instead, training should begin with instruction followed by the other components that comprise BST.

This is not to say that instruction does not influence performance. Indeed, there are several ways in which instruction can be delivered to influence trainees’ performance. For example, Henley, Hirst, DiGennaro Reed, Becirevic, and Reed ( 2017 ) compared the use of directive instructions (e.g., “you must”) to nondirective instructions (e.g., “you might consider”) on trainees’ responding under changing reinforcement schedules in a laboratory task. When presented with directive instructions, participants responded in accordance with the instructions, even when the instructions were inaccurate (i.e., instructions did not match the reinforcement schedules). Participants in the nondirective condition, however, responded in accordance with the reinforcement schedules, independent of the instructions. Studies on this topic suggest that, when creating instructions for staff, it is important to consider how instructions are delivered, as minor variations may affect performance.

There are isolated instances in the literature of participants correctly performing skills after detailed instruction alone. For example, Graff and Karsten ( 2012 ) taught staff to effectively conduct preference assessments using enhanced written instructions, which included a detailed data sheet, diagrams, and step-by-step instructions written without technical jargon. However, Shapiro, Kazemi, Pogosjana, Rios, and Mendoza ( 2016 ) only partially replicated Graff and Karsten’s findings and had to include additional training procedures to reach criterion performance. Instances of performing to criterion after instruction alone are rare and may depend on various factors, such as the skill being trained, the instruction format, and the trainee’s history. Because these several factors must align for instruction alone to be effective, it is prudent to implement all components of BST when conducting preservice training.

Practice Guidelines

We recommend that trainers present clear and succinct instructions about procedures, as Jarmolowicz et al. ( 2008 ) demonstrated that treatment adherence is better when instructions are written in a conversational form than in technical language. Moreover, it may be helpful to provide jargon-free, written protocols with diagrams (Graff & Karsten, 2012 ) that staff can use during training and refer to later, if needed. In our consultation experience, we have observed that trainees often appreciate the rationale for certain procedures, and providing that information may help guard against performance drift, though research is still needed in this area. Finally, we recommend trainers and supervisors be transparent about specific behaviors that will be observed and measured. It is presumed that the behaviors that will be observed and measured are of the utmost importance and, thus, should not be kept a secret from trainees. Also, new staff members generally want to perform well and may become nervous about their responsibilities and being observed. In our experience, transparency about what is expected and how performance will be measured generally reduces trainees’ nervousness.

The second component of BST is modeling, which involves an experienced staff person demonstrating perfect performance of a target skill or behavior one expects the trainee to imitate (Miltenberger, 2016 ). Modeling can take place in person or shown via video. Video modeling includes the advantages of conserving resources if used over time and being transportable, allowing trainees the opportunity to view the video model outside of the training session. Further, a live model may contain slight errors or inconsistencies across trainings that affect training outcomes; video modeling provides the added benefit of standardizing training procedures and ensuring that only desired models are shown 1 (DiGennaro Reed, Blackman, Erath, Brand, & Novak, 2018 ; Shapiro & Kazemi, 2017 ).

Recent research has shown video modeling, in particular video modeling with voiceover instruction, to be more effective than written instructions alone—though feedback was required for some participants—when training new staff to implement discrete trial instruction and behavior reduction interventions (e.g., DiGennaro Reed, Codding, Catania, & Maguire, 2010 ; Giannakakos, Vladescu, Kisamore, & Reeve, 2016 ). Furthermore, staff effectively learned how to conduct preference assessments after receiving training comprised of video modeling with voiceover instruction (e.g., Delli Bovi, Vladescu, DeBar, Carroll, & Sarokoff, 2017 ).

When incorporating modeling in training, it is important to model the entire procedure for the trainee. In addition, we recommend standardizing the models across training episodes to ensure the relevant skills are being modeled consistently. The latter recommendation may be accomplished by relying on video models or ensuring live models receive written protocols to follow during training. Finally, to aid in generalization, modeling should entail multiple exemplars of the target skill (Moore & Fisher, 2007 ). DiGennaro Reed, Erath, Brand, and Novak ( 2019 ) provide resources for creating video models, which readers may find beneficial.

The third component of BST, rehearsal—also referred to as practice or role play—involves having trainees practice a target skill (Miltenberger, 2016 ). Rehearsal can be arranged in multiple ways, such as using a trained researcher or confederate (e.g., Iwata et al., 2000 ; McGimsey, Greene, & Lutzker, 1995 ; Phillips & Mudford, 2008 ), another trainee who is acquiring the skill being rehearsed (e.g., Palmen, Didden, & Korzilius, 2010 ; Wallace, Doney, Mintz-Resudek, & Tarbox, 2004 ), a service recipient (e.g., Erbas, Tekin-Iftar, & Yucesoy, 2006 ), or by varying the number of rehearsal opportunities (e.g., Jenkins & DiGennaro Reed, 2016 ). An important distinction is that rehearsal alone does not guarantee high levels of performance; in fact, it may allow trainees to practice errors, which may impede acquisition (Ward-Horner & Sturmey, 2012 ). Thus, rehearsal is typically accompanied by performance feedback and continues until trainees achieve mastery (Reid, Parsons, & Green, 2011 ).

In suggesting guidelines for trainers, we offer that practice does not make perfect; rather, practice with feedback makes perfect. That is, feedback should be delivered immediately following each rehearsal opportunity; thus, rehearsal and feedback should occur in tandem. Feedback is described in more detail in the next section. To help trainees acquire all relevant skills, the trainer must engineer opportunities for the trainee to practice the entire procedure, respond to a range of client responses, receive feedback, and meet a mastery criterion. These opportunities include using confederates in-vivo or in an analog setting, and having the confederate behave in scripted or predetermined ways to ensure the trainee practices all the components of a procedure and responds to a range of behaviors. Allowing trainees to respond to many situations is important, especially when dealing with vulnerable populations and procedures that need to be implemented with high integrity.

The fourth component of BST is feedback, which refers to information about past performance that specifies how the trainee can improve performance in the future (Miltenberger, 2016 ). At this stage of training, feedback should be delivered immediately after each rehearsal opportunity and specify steps performed correctly and steps requiring correction (DiGennaro Reed et al., 2018 ). Several reviews of the literature reveal there are various dimensions of feedback, such as its source (supervisor, peer), medium or mode (written, verbal), frequency (daily, weekly), recipients (individuals, groups), privacy (private, public), and content (type of information provided; Alvero, Bucklin, & Austin, 2001 ; Balcazar, Hopkins, & Suarez, 1985 ; Prue & Fairbank, 1981 ). In addition, the way in which corrective and positive feedback are sequenced can influence its efficacy (Henley & DiGennaro Reed, 2015 ; Slowiak & Lakowske, 2017 ). Although supervisors and trainers have flexibility regarding how to implement the various dimensions of feedback, it is likely most efficient and effective to deliver both corrective and positive verbal feedback immediately upon completion of rehearsal.

The numerous variations and dimensions of feedback present a challenge to researchers seeking to examine the most effective combinations. Thus, no practice recommendations with an exact combination of methods can be made, which may be impractical as most supervisors are subject to various organizational and logistical constraints that limit their control over certain factors. However, research on the dimensions of feedback and its delivery has produced results with enough consistency to support general practice guidelines.

We recommend trainers base their feedback on direct observations rather than verbal reports or indirect measures. The use of observational data provides important information for the trainer and may also be used as a data source for delivering feedback. Next, trainee performance may improve faster if corrective feedback is presented before positive feedback (Henley & DiGennaro Reed, 2015 ); however, we often ask trainees to specify their preference for the order in which feedback is delivered. Third, supervisors should deliver feedback immediately after performance, as research suggests immediate feedback is more effective than delayed feedback (Goodman, Brady, Duffy, Scott, & Pollard, 2008 ) and staff prefer immediate feedback compared to delayed feedback (Reid & Parsons, 1996 ). We also recommend that feedback is used in conjunction with the components of BST described previously. Finally, it is important that feedback is delivered in a respectful and professional manner to maintain a positive working relationship, in particular when corrective feedback must be shared.

Ongoing Staff Support

It would be a mistake to assume that, once preservice training is complete, staff will perform all skills with high integrity while on the job and in a complex real-world environment. Thus, high-quality preservice training should be viewed as the initial investment in the professional development of staff. Based on decades of research, it is reasonable to assume that staff may not generalize skills learned in a contrived training environment to the actual work setting or maintain high levels of performance over extended periods of time. To address these challenges and support the maintenance and growth of staff skills, ongoing coaching is necessary. In the following sections, we outline how supervisors can provide ongoing support to staff following preservice training.

Observations and Feedback

The next step in the training process is the provision of ongoing supervision and support. This usually involves supervisory observations of the staff implementing varied procedures. The purpose of direct observations is twofold: to provide the supervisor with opportunities to monitor treatment integrity in the natural environment and to use data to provide performance feedback to staff. Depending on contextual variables operating in the organization (e.g., staff schedules, supervisor schedules, the setting), these observations can vary widely in when, how, and how often they are employed. For example, observations can be scheduled in advance or unscheduled drop-ins ( when ); viewed live (i.e., in-vivo) or via video recordings ( how ); and conducted as often or as little as needed, depending on staff performance, feasibility, and other related variables ( how often ).

Although variability exists regarding how supervisory observations are implemented, one commonality across all variations is to ensure recommended practices are being used. Table ​ Table1 1 depicts an on-the-job training protocol (adapted from Ricciardi, 2005 ) for using recommended practices to conduct ongoing observations. This protocol uses a competency-based approach to training (e.g., Reid & Parsons, 2002 ), and shares many of the same components used in initial training procedures (e.g., instruction, rehearsal, performance feedback). Thus, divergence from initial training procedures is more in relation to the training process , not training content , wherein the goal of ongoing supervision observations is to provide practice opportunities for staff to demonstrate high levels of treatment integrity in their actual workplace setting. The provision of supervision and support in this capacity also affords other benefits, such as the opportunity for supervisors and staff to troubleshoot issues regarding implementation in practice—an issue which may not have been present in the controlled training settings where initial training typically occurs. Related to this, supervisors can also embed coaching procedures (e.g., prompting, prompt fading, reinforcement) into their observations to facilitate staff implementation at mastery levels.

On-the-job training protocol (adapted from Ricciardi, 2005 )

Pay for Performance

An important consideration for maintaining desirable performance is the method by which staff are compensated for their work. Most compensation systems in the United States involve pay-for-time systems, in which compensation is primarily based on the amount of time spent at work, not performance of job duties. The prevalence of pay-for-time systems presents an interesting challenge for behavior-analyst supervisors, as the primary contingency (i.e., pay) is delivered largely independent of performance of job duties. Although pay-for-performance systems likely maintain higher quality and quantity work than pay-for-time, several factors impede implementation of the pay-for-performance systems.

The first barrier to performance-contingent pay is that many supervisors may not be in a position in their organization where they are able to dramatically change existing pay structures. Those supervisors who have control over organizational pay structures would also be likely to experience resistance from staff due to the ubiquity of traditional pay structures. A second barrier to pay-for-performance systems is a concern that these systems may place undue stress on employees—because their income is tied directly to their performance (Ganster, Kiersch, Marsh, & Bowen, 2011 ). This issue is made worse when incentive systems are dependent on factors beyond staff control.

Notwithstanding these barriers, supervisors must identify methods for reinforcing desirable performance within a traditional pay-for-performance system. A large body of research on the use of incentives in organizational settings suggests that desirable staff performance can be maintained by monetary incentives that account for a relatively small proportion of total compensation for staff (e.g., Dickinson & Gillette, 1994 ). That is, desired performance is maintained by the presence of an incentive contingency, not the percentage of incentive pay (Poling, Dickinson, Austin, & Normand, 2000 ). Thus, one solution may be for supervisors to use monetary incentives in conjunction with traditional pay systems—readers in organizations capable of and interested in providing performance-based pay are directed to Abernathy ( 1996 , 2014 ) for additional resources. Note that this type of system is not without limitations. First, monetary incentives must be arranged so they are sustainable over an extended duration, and many human-service settings simply do not have the funds to maintain these efforts. Second, monetary incentives may be subject to certain federal and state labor regulations (e.g., Fair Labor Standards Act of 1938 ), which may create unwanted logistical difficulties for an organization. Thus, despite the advantages of using a generalized conditioned reinforcer in the form of monetary incentives, supervisors may seek alternative forms of incentive delivery to maintain desirable staff performance.

Identifying Potential Incentives

Although supervisors may feel confident in their ability to select effective nonmonetary incentives for their staff, we urge caution in doing so. Wilder, Rost, and McMahon ( 2007 ) asked supervisors to rank-order potential incentives based on how effective they thought the incentive would be for each of their employees. When comparing supervisor predictions with employee rankings, Wilder et al. observed high agreement between supervisors’ indication of their employees’ most preferred items or activities; however, few supervisors accurately predicted moderate- and lower-preferred items or activities. These findings were replicated by Wilder, Harris, Casella, Wine, and Postma ( 2011 ) and suggest that supervisors generally do a poor job at predicting effective incentives.

Daniels and Bailey ( 2014 ) offer a systematic procedure to assist with selecting incentives. First, supervisors should consider what types of incentives they can reasonably provide. At this stage it is important to consider that incentives may be a mix of items, activities, or privileges. Whereas monetary and most tangible incentives have an inherent cost to an organization, many activities or privileges may come at little or no cost. For example, Iwata, Bailey, Brown, Foshee, and Alpern ( 1976 ) maintained high levels of daily care and training activities from staff working in a residential facility using an incentive where staff could rearrange their days off for the following week. Another important consideration at this stage is that supervisors should select items or activities that are sustainable for use for the indefinite future. Although reinforcement schedules may be thinned over time, the incentive program is only effective for as long as it is being implemented. Supervisors may need to have conversations with their organization’s management to identify incentives that the organization allows and can support—so the supervisor does not have to pay for it out-of-pocket.

Second, supervisors may wish to discuss these options for potential incentives with staff to identify a small number of items, activities, or privileges. This step should be conducted after first identifying potential items and activities because, otherwise, employees do not know what is available or may ask for things that cannot be delivered (see Daniels & Bailey, 2014 ).

Finally, after potential incentives have been identified, supervisors should conduct a systematic preference assessment with staff. Although there is a rich literature evaluating methods for assessing preference in clinical populations with limited verbal repertoires (e.g., Fisher et al., 1992 ), these methods are likely not appropriate for staff with strong verbal repertoires (see Waldvogel & Dixon, 2008 ). Two commonly used methods for assessing employee preference for incentives are a reinforcer survey (Daniels & Bailey, 2014 ) and a ranking procedure (Waldvogel & Dixon, 2008 ; Wine, Reis, & Hantula, 2014 ). The reinforcer survey asks employees to rate how much work they would be willing to do for each item or activity on a Likert-type scale from 0 ( none at all ) to 4 ( very much ). The ranking procedure is similar but provides a relative value for each potential incentive by asking employees to rank the items or activities from least to most preferred. Both the survey and ranking procedure provide relatively accurate indications of effective incentives—although the survey method may be better at identifying a greater range of effective incentives (see Wine et al., 2014 for a comparison).

Incentive Delivery

A final consideration for ensuring effective use of incentives is the way they are delivered. Some variables that warrant additional consideration for use with staff include incentive quality, probability of delivery, and delay to delivery. Incentive quality is largely determined by preference, although incentive magnitude and schedule also affect quality. Incentives may be delivered on a dense schedule initially and thinned once the employee has consistently demonstrated desired performance. Two considerations with respect to quality are that staff preferences may shift over time (Wine, Gilroy, & Hantula, 2012 ) and the use of incentives of varied preference may maintain high levels of performance (Wine & Wilder, 2009 ). Thus, supervisors should consider assessing preference on a regular basis and using a variety of moderate- to high-preferred incentives.

Although rules can help bridge the gap of delays to reinforcement, supervisors should seek to minimize delays as much as possible. In addition, with respect to the probability of incentive delivery, reinforcers may not need to be delivered each time. Though there is little research assessing probability of incentive delivery in OBM settings, several studies have demonstrated the effectiveness of lottery systems at maintaining performance (e.g., Cook & Dixon, 2006 ; Iwata et al., 1976 ). Taken together, there has been little OBM research assessing the relative impact of reinforcer dimensions. However, recent research incorporating the area of behavioral economics has provided a promising methodology through which a thorough understanding may be developed (e.g., Henley, DiGennaro Reed, Reed, & Kaplan, 2016 ; Wine et al., 2012 ).

Assessing Performance Problems

Despite best efforts to train and provide follow-up support to staff, supervisors will likely encounter instances of less-than-desirable performance. As is true with service delivery in clinical populations, performance management interventions typically provide benefit when they are informed by preintervention functional assessment. Though several informant assessments exist and have been implemented with success (e.g., Daniels & Lattal, 2017 ; Mager & Pipe, 1984 ), the Performance Diagnostic Checklist–Human Services (PDC–HS; Carr, Wilder, Majdalany, Mathisen, & Strain, 2013 ) has emerging support for use in human-service settings. The PDC–HS may be especially advantageous for BCBAs in supervisory positions who may have limited OBM experience as it is less time consuming and does not require the same level of expertise as behavioral systems analysis (for more information about behavioral systems analysis, see Johnson, Casella, McGee, & Lee, 2014 ; McGee & Diener, 2010 ; Sigurdsson & McGee, 2015 ). The PDC–HS is an informant assessment that may be used to identify variables causing or maintaining substandard performance. The assessment consists of 20 questions across four domains: (a) training; (b) task clarification and prompting; (c) resources, materials, and processes; and (d) performance consequences, effort, and competition. As its name suggests, the PDC–HS was developed specifically for use in human service settings, and the questions and domains were developed to target environmental variables that commonly affect performance in this particular setting.

The first section, training , contains questions about the type of training received and whether the employee has demonstrated desired levels of performance in the past. The second section, task clarification and prompting , includes questions about the employee’s knowledge of job requirements and the environment where the behavior is expected to occur. Third, the resources, materials, and processes section contains questions about the organization’s systems and resources that may be beyond the employee’s control. Finally, the performance consequences, effort, and competition section includes questions about overall supervisor support and supervision, feedback, and potential competing activities.

Carr et al. ( 2013 ) indicated that seven of the items on the PDC–HS can be answered through direct observation and recommended administering the remaining 13 items through discussion with the employee’s supervisor. Practitioners administering the PDC–HS might consider also administering it with multiple supervisors or across different levels of the organization (e.g., management, supervisors, employees) as there may not be 100% agreement across all relevant parties (e.g., Merritt, DiGennaro Reed, & Martinez, 2019 ).

When complete, results of the PDC–HS are scored by counting the number of items for which an area of concern was flagged in each domain (see Carr & Wilder, 2016 ; Carr et al., 2013 ); the domain with the most flagged items typically indicates the “function” of the performance problem, or the area to be targeted for intervention. Where the PDC–HS may be particularly useful is the accompanying intervention planning guide, which provides a list of recommended interventions (with supporting literature) for each domain. For example, Bowe and Sellers ( 2018 ) conducted a PDC–HS to assess inaccurate implementation of error correction procedures during teaching sessions, and results indicated that insufficient training was likely the greatest contributing factor for performance problems. The experimenters then compared an indicated intervention of BST with an intervention recommended in the task clarification and prompting domain (posting reminders; i.e., a nonindicated intervention) and found that performance improved only following the indicated intervention. In sum, the PDC–HS is particularly beneficial for supervisors in human service settings as it provides a systematic assessment of performance problems, is tailored specifically for use in human service settings, and helps supervisors select a function-indicated intervention.

Continuing Education for Staff

As employees continue their professional growth at an organization, their interests may begin to extend beyond the scope of what a supervisor is able to provide. These interests may be viewed as an opportunity to develop skills by facilitating additional learning opportunities. Many of the approaches described in the section below on staying up to date with research can also be adapted for staff development. For example, a supervisor may encourage staff to attend regional conferences or workshops by providing time off work or assisting with registration costs. Those who oversee a large number of staff may consider inviting speakers to deliver workshops on topics related to the services the organization provides. By facilitating continuing education opportunities, supervisors create varied learning opportunities for staff while also creating natural rewards for staff who stay with an organization.

Staying Up to Date in Performance Management Research

Staying current with the research literature is an important skill for practitioners as it may foster the provision of high-quality supervision, training, and services across all levels of the organization. Section 1.01 of the Professional and Ethical Compliance Code includes a provision that states “behavior analysts rely on professionally derived knowledge based on science and behavior analysis when making scientific or professional judgements in human service provision, or when engaging in scholarly or professional endeavors” (BACB, 2014 , p. 4). To meet this standard, credentialed behavior analysts must remain abreast of current scientific findings. At the broadest level, this often involves various classes of behavior that can be categorized into two areas: (a) attending professional development opportunities and (b) reading peer-reviewed publications in staff training and performance management.

Attending professional development opportunities often means attending local, regional, and/or international behavior-analytic conferences and workshops to learn about recent developments in a given area. With current technology, webinars, online-based trainings, and podcasts may be options. For example, the OBM Network ( http://obmnetwork.com ) provides numerous webinars from excellent researchers in the field of OBM on topics such as feedback, remote supervision, pay-for performance, leadership, and staff turnover, among others.

Carr and Briggs ( 2010 ) offer helpful recommendations for overcoming barriers to staying abreast of the scholarly literature. In addition, a means of remaining up to date on latest publications is to use software- and internet-based tools for alerts on recently published literature in a journal or content area. For example, many journal providers offer table-of-content alerts, which present the user with a brief snapshot of the articles published in the newest issue of a journal. Pubcrawler ( http://pubcrawler.gen.tcd.ie/ ) is an internet-based alert service that allows users to create personal queries for recently published articles, which are then compiled into a list and sent via email. A notable feature is that users can set their search criteria for the query using an extensive list of settings, including but not limited to commonly used components such as keywords and articles from particular journals. For example, if a user were interested in receiving updates for recent publications on staff training, the user could set up a search query by setting the search criteria for “staff training” as the keyword and a list of behavior-analytic journals as the places in which the query should search.

Given the expansive and ever-growing body of literature, it can be difficult to discern which literature is most relevant, in particular when many articles are accessible only through fees or university subscriptions. However, there are numerous methods to find articles that contain staff training or performance management content. One simple and straightforward way is to purchase access to behavior-analytic journals through the Association for Behavior Analysis International©, which can often be done at a discounted rate for members. Credentialed behavior analysts also have access to select journals through the online portal of the BACB. Another method is to use Google Scholar ( https://scholar.google.com ), where articles may be freely available. An additional benefit to using Google Scholar is that searches expand beyond the scope of just peer-reviewed articles, as their database also indexes books, conferences, and other nonpeer-reviewed materials. ResearchGate© ( https://www.researchgate.net ) is another tool for individuals to use to either download an article or reach out to the researcher directly. Finally, although many articles can be accessed using the methods described above, authors will typically be happy to send articles to those who reach out to them directly via email (often found on their university web page) or ResearchGate.

Recent research suggests that recommended staff training and performance management practices are not being regularly implemented in organizations that hire behavior analysts, which could affect the quality of services being provided. This article attempted to bridge the research-to-practice gap by outlining research-supported initial training and ongoing staff support procedures within human service settings, presenting practice guidelines, and sharing information about easy-to-implement ways practitioners may stay abreast of current research. Assessment and intervention procedures based on the science of behavior analysis have empirical support, but we must ensure they are being implemented with high integrity by a well-trained and supported workforce.

1 To our knowledge, the extant research has focused on effects of models of exemplar performance only; more research is needed on the effects of including models of nonexemplar performance on training outcomes.

Portions of this manuscript were presented as an invited talk by Florence D. DiGennaro Reed at the OBM in Health and Human Services Conference, Denver, CO.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

  • Abernathy WB. The sin of wages . Atlanta, GA: Performance Management; 1996. [ Google Scholar ]
  • Abernathy WB. Beyond the Skinner box: The design and management of organization-wide performance systems. Journal of Organizational Behavior Management. 2014; 34 :235–254. doi: 10.1080/01608061.2014.973631. [ CrossRef ] [ Google Scholar ]
  • Alvero AM, Bucklin BR, Austin J. An objective review of the effectiveness and essential characteristics of performance feedback in organizational settings. Journal of Organizational Behavior Management. 2001; 21 (1):3–29. doi: 10.1300/J075v21n01_02. [ CrossRef ] [ Google Scholar ]
  • Balcazar FE, Hopkins BL, Suarez Y. A critical, objective review of performance feedback. Journal of Organizational Behavior Management. 1985; 7 (3–4):65–89. doi: 10.1300/J075v07n03_05. [ CrossRef ] [ Google Scholar ]
  • Behavior Analyst Certification Board. (2014). Professional and ethical compliance code for behavior analysts . Littleton, CO: Author. Retrieved from https://www.bacb.com/ethics/ethics-code/ . Accessed 19 Aug 2016
  • Berkman SJ, Roscoe EM, Bourret JC. Comparing self-directed methods for training staff to create graphs using GraphPad Prism. Journal of Applied Behavior Analysis. 2019; 52 :188–204. doi: 10.1002/jaba.522. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Bowe M, Sellers TP. Evaluating the Performance Diagnostic Checklist–Human Services to assess incorrect error-correction procedures by preschool paraprofessionals. Journal of Applied Behavior Analysis. 2018; 51 :166–176. doi: 10.1002/jaba.428. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Brand D, Henley AJ, DiGennaro Reed FD, Gray E, Crabbs B. A review of published studies involving parametric manipulations of treatment integrity. Journal of Behavioral Education. 2019; 28 :1–26. doi: 10.1007/s10864-018-09311-8. [ CrossRef ] [ Google Scholar ]
  • Carr JE, Briggs AM. Strategies for making regular contact with the scholarly literature. Behavior Analysis in Practice. 2010; 3 :13–18. doi: 10.1007/BF03391760. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Carr JE, Wilder DA. The Performance Diagnostic Checklist–Human Services: A correction. Behavior Analysis in Practice. 2016; 9 :63–63. doi: 10.1007/s40617-015-0099-3. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Carr JE, Wilder DA, Majdalany L, Mathisen D, Strain LA. An assessment-based solution to a human-service employee performance problem. Behavior Analysis in Practice. 2013; 6 :16–32. doi: 10.1007/BF03391789. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Cook T, Dixon MR. Performance feedback and probabilistic bonus contingencies among employees in a human service organization. Journal of Organizational Behavior Management. 2006; 25 (3):45–63. doi: 10.1300/J075v25n03_04. [ CrossRef ] [ Google Scholar ]
  • Daniels AC, Bailey JS. Performance management: Changing behavior that drives organizational performance . 5. Atlanta, GA: Performance Management Publications; 2014. [ Google Scholar ]
  • Daniels AC, Lattal AD. Life’s a PIC/NIC . . . when you understand behavior . Cornwall on Hudson, NY: Sloan Publishing; 2017. [ Google Scholar ]
  • Delli Bovi GM, Vladescu JC, DeBar RM, Carroll RA, Sarokoff RA. Using video modeling with voice-over instruction to train public school staff to implement a preference assessment. Behavior Analysis in Practice. 2017; 10 :72–76. doi: 10.1007/s40617-016-0135-y. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Dickinson AM, Gillette KL. A comparison of the effects of two individual monetary incentive systems on productivity: Piece rate pay versus base pay plus incentives. Journal of Organizational Behavior Management. 1994; 14 (1):3–82. doi: 10.1300/J075v14n01_02. [ CrossRef ] [ Google Scholar ]
  • DiGennaro Reed, F. D. (2016, November). ABCs of staff support: Evidence-based performance management . Presentation for the Iowa Association for Behavior Analysis Annual Conference, Des Moines, IA.
  • DiGennaro Reed, F. D. (2017, May). Evidence-based performance management: Applying behavioral science to support practitioners . Presentation for the OBM in Health and Human Services Conference, Denver, CO. [ PMC free article ] [ PubMed ]
  • DiGennaro Reed, F. D. (2018, May). Using behavioral science to support educators during consultation . Presentation for the annual meeting of the Association for Behavior Analysis International, San Diego, CA.
  • DiGennaro Reed, F. D. (2019, April). Performance management in ABA service settings. Presentation for the annual meeting of the Association for Professional Behavior Analysts, Atlanta, GA.
  • DiGennaro Reed FD, Blackman AL, Erath TG, Brand D, Novak MD. Guidelines for using behavioral skills training to provide teacher support. Teaching Exceptional Children. 2018; 50 :373–380. doi: 10.1177/0040059918777241. [ CrossRef ] [ Google Scholar ]
  • DiGennaro Reed FD, Codding R, Catania CN, Maguire H. Effects of video modeling on treatment integrity of behavioral interventions. Journal of Applied Behavior Analysis. 2010; 43 :291–295. doi: 10.1901/jaba.2010.43-291. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • DiGennaro Reed FD, Erath TG, Brand D, Novak MD. Video modeling during coaching and performance feedback. In: Fischer A, Dart E, Collins T, Radley K, editors. Technology applications in school consultation, supervision, and school psychology training . New York, NY: Routledge; 2019. [ Google Scholar ]
  • DiGennaro Reed FD, Henley AJ. A survey of staff training and performance management practices: The good, the bad, and the ugly. Behavior Analysis in Practice. 2015; 8 :16–26. doi: 10.1007/s40617-015-0044-5. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Ducharme JM, Feldman MA. Comparison of staff training strategies to promote generalized teaching skills. Journal of Applied Behavior Analysis. 1992; 25 :165–179. doi: 10.1901/jaba.1992.25-165. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Erbas D, Tekin-Iftar E, Yucesoy S. Teaching special education teachers how to conduct functional analysis in natural settings. Education and Training in Developmental Disabilities. 2006; 41 :28–36. [ Google Scholar ]
  • Fair Labor Standards Act of 1938. (n.d.). 29 U.S.C. §201 et seq.
  • Fisher W, Piazza CC, Bowman LG, Hagopian LP, Owens JC, Slevin I. A comparison of two approaches for identifying reinforcers for persons with severe and profound disabilities. Journal of Applied Behavior Analysis. 1992; 25 :491–498. doi: 10.1901/jaba.1992.25-491. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Freedman DH. Improving public perception of behavior analysis. The Behavior Analyst. 2016; 39 :89–95. doi: 10.1007/s40614-015-0045-2. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Ganster DC, Kiersch CE, Marsh RE, Bowen A. Performance-based rewards and work stress. Journal of Organizational Behavior Management. 2011; 31 :221–235. doi: 10.1080/01608061.2011.619388. [ CrossRef ] [ Google Scholar ]
  • Giannakakos AR, Vladescu JC, Kisamore AN, Reeve SA. Using video modeling with voiceover instruction plus feedback to train staff to implement direct teaching procedures. Behavior Analysis in Practice. 2016; 9 :126–134. doi: 10.1007/s40617-015-0097-5. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Goodman JI, Brady MP, Duffy ML, Scott J, Pollard NE. The effects of “bug-in-ear” supervision on special education teachers’ delivery of learn units. Focus on Autism and Other Developmental Disabilities. 2008; 23 :207–216. doi: 10.1177/1088357608324713. [ CrossRef ] [ Google Scholar ]
  • Graff RB, Karsten AM. Evaluation of a self-instruction package for conducting stimulus preference assessments. Journal of Applied Behavior Analysis. 2012; 45 :69–82. doi: 10.1901/jaba.2012.45-69. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Henley, A. J. (2018). Empirical foundations and practical applications of behavioral skills training . Invited presentation and workshop for Behavior Services of Western Massachusetts, Springfield, MA.
  • Henley, A. J. (2019). Supervising like a boss: Healthy behavioral practices for promoting effective supervision . Invited presentation for the Massachusetts Association of 766 Approved Private Schools, Marlborough, MA.
  • Henley AJ, DiGennaro Reed FD. Should you order the feedback sandwich? Efficacy of feedback sequence and timing. Journal of Organizational Behavior Management. 2015; 35 :321–335. doi: 10.1080/01608061.2015.1093057. [ CrossRef ] [ Google Scholar ]
  • Henley AJ, DiGennaro Reed FD, Reed DD, Kaplan BA. A crowdsourced nickel-and-dime approach to analog OBM research: A behavioral economic framework for understanding workforce attrition. Journal of the Experimental Analysis of Behavior. 2016; 106 :134–144. doi: 10.1002/jeab.220. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Henley AJ, Hirst JM, DiGennaro Reed FD, Becirevic A, Reed DD. Function-altering effects of rule phrasing in the modulation of instructional control. The Analysis of Verbal Behavior. 2017; 33 :24–40. doi: 10.1007/s40616-016-0063-5. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Higgins ST, Silverman K, Heil SH, editors. Contingency management in substance abuse treatment . New York, NY: Guilford Press; 2007. [ Google Scholar ]
  • Iwata BA, Bailey JS, Brown KM, Foshee TJ, Alpern M. A performance-based lottery to improve residential care and training by institutional staff. Journal of Applied Behavior Analysis. 1976; 9 :417–431. doi: 10.1901/jaba.1976.9-417. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Iwata BA, Wallace MD, Kahng S, Lindberg JS, Roscoe EM, Conners J, et al. Skill acquisition in the implementation of functional analysis methodology. Journal of Applied Behavior Analysis. 2000; 33 :181–194. doi: 10.1901/jaba.2000.33-181. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jarmolowicz DP, Kahng S, Ingvarsson ET, Goysovich R, Heggemeyer R, Gregory MK. Effects of conversational versus technical language on treatment preference and integrity. Intellectual & Developmental Disabilities. 2008; 46 :190–199. doi: 10.1352/2008.46:190-199. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Jenkins SR, DiGennaro Reed FD. A parametric analysis of rehearsal opportunities on procedural integrity. Journal of Organizational Behavior Management. 2016; 36 :255–281. doi: 10.1080/01608061.2016.1236057. [ CrossRef ] [ Google Scholar ]
  • Johnson DA, Casella SE, McGee H, Lee SC. The use and validation of pre-intervention diagnostic tools in Organizational Behavior Management. Journal of Organizational Behavior Management. 2014; 34 :104–121. doi: 10.1080/01608061.2014.914009. [ CrossRef ] [ Google Scholar ]
  • Kazemi E, Shapiro M, Kavner A. Predictors of intention to turnover in behavior technicians working with individuals with autism spectrum disorder. Research in Autism Spectrum Disorders. 2015; 17 :106–115. doi: 10.1016/j.rasd.2015.06.012. [ CrossRef ] [ Google Scholar ]
  • Leon Y, Wilder DA, Majdalany L, Myers K, Saini V. Errors of omission and commission during alternative reinforcement of compliance: The effects of varying levels of treatment integrity. Journal of Behavioral Education. 2014; 23 :19–33. doi: 10.1007/s10864-013-9181-5. [ CrossRef ] [ Google Scholar ]
  • Lindgren S, Wacker D, Suess A, Schieltz K, Pelzel K, Kopelman T, et al. Telehealth and autism: Treating challenging behavior at lower cost. Pediatrics. 2016; 137 :S167–S175. doi: 10.1542/peds.2015-2851O. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Lord C, McGee JP, editors. Educating children with autism . Washington, DC: National Academy Press, Committee on Educational Interventions for Children with Autism, Division of Behavioral and Social Sciences and Education, National Research Council; 2001. [ Google Scholar ]
  • Mager R, Pipe P. Analyzing performance problems . 2. Belmont, CA: Lake; 1984. [ Google Scholar ]
  • McGee HM, Diener LH. Behavioral systems analysis in health and human services. Behavior Modification. 2010; 34 :415–442. doi: 10.1177/0145445510383527. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • McGimsey JF, Greene BF, Lutzker JR. Competence in aspects of behavioral treatment and consultation: Implications for service delivery and graduate training. Journal of Applied Behavior Analysis. 1995; 28 :301–315. doi: 10.1901/jaba.1995.28-301. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Merritt, T. A., DiGennaro Reed, F. D., & Martinez, C. E. (in press). Using the Performance Diagnostic Checklist–Human Services to identify an indicated intervention to decrease employee tardiness. Journal of Applied Behavior Analysis, 52 , 1034–1048. 10.1002/jaba.643. [ PubMed ]
  • Miltenberger RG. Behavior modification: Principles and procedures . 6. Boston, MA: Cengage Learning; 2016. [ Google Scholar ]
  • Moore JW, Fisher WW. The effects of videotape modeling on staff acquisition of functional analysis methodology. Journal of Applied Behavior Analysis. 2007; 40 :197–202. doi: 10.1901/jaba.2007.24-06. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • National Autism Center . National Standards Project: Findings and conclusions . Randolph, MA: Author; 2009. [ Google Scholar ]
  • National Autism Center . National Standards Project, Phase 2: Findings and conclusions. Addressing the need for evidence-based practice guidelines for autism spectrum disorder . Randolph, MA: Author; 2015. [ Google Scholar ]
  • Nigro-Bruzzi D, Sturmey P. The effects of behavioral skills training on mand training by staff and unprompted vocal mands by children. Journal of Applied Behavior Analysis. 2010; 43 :757–761. doi: 10.1901/jaba.2010.43-757. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Palmen A, Didden R, Korzilius H. Effectiveness of behavioral skills training on staff performance in a job training setting for high-functioning adolescence with autism spectrum disorder. Research in Autism Spectrum Disorders. 2010; 4 :731–740. doi: 10.1016/j.rasd.2010.01.012. [ CrossRef ] [ Google Scholar ]
  • Parsons MB, Rollyson JH, Reid DH. Evidence-based staff training: A guide for practitioners. Behavior Analysis in Practice. 2012; 5 :2–11. doi: 10.1007/BF03391819. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Peterson L, Homer AL, Wonderlich SA. The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis. 1982; 15 :477–492. doi: 10.1901/jaba.1982.15-477. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Phaneuf L, McIntyre LL. Effects of individualized video feedback combined with group parent training on inappropriate maternal behavior. Journal of Applied Behavior Analysis. 2007; 40 :737–741. doi: 10.1901/jaba.2007.737-741. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Phillips KJ, Mudford OC. Functional analysis training for residential caregivers. Behavioral Interventions. 2008; 23 :1–12. doi: 10.1002/bin.252. [ CrossRef ] [ Google Scholar ]
  • Piazza CC, Milnes SM, Shalev RA. A behavior-analytic approach to the assessment and treatment of pediatric feeding disorders. In: Roane HS, Ringdahl JE, Falcomata TS, editors. Clinical and organizational applications of applied behavior analysis . Cambridge, MA: Academic Press; 2015. pp. 69–94. [ Google Scholar ]
  • Poling A, Dickinson AM, Austin J, Normand MP. Basic behavioral research and organizational behavior management. In: Austin J, Carr JE, editors. Handbook of applied behavior analysis . Reno, CA: Context Press; 2000. pp. 295–320. [ Google Scholar ]
  • Prue DM, Fairbank JA. Performance feedback in organizational behavior management: A review. Journal of Organizational Behavior Management. 1981; 3 (1):1–16. doi: 10.1300/J075v03n01_01. [ CrossRef ] [ Google Scholar ]
  • Reid DH, Parsons MB. A comparison of staff acceptability of immediate versus delayed verbal feedback in staff training. Journal of Organizational Behavior Management. 1996; 16 (2):35–47. doi: 10.1300/J075v16n02_03. [ CrossRef ] [ Google Scholar ]
  • Reid DH, Parsons MB. Working with staff to overcome challenging behavior among people who have severe disabilities: A guide for getting support plans carried out . Morganton, NC: Habilitative Management Consultants; 2002. [ Google Scholar ]
  • Reid DH, Parsons MB, Green CW. Evidence-based ways to promote work quality and enjoyment among support staff: Trainee guide . Washington, DC: American Association of on Intellectual and Developmental Disabilities; 2011. [ Google Scholar ]
  • Ricciardi JN. Achieving human service outcomes through competency-based training: A guide for managers. Behavior Modification. 2005; 29 :488–507. doi: 10.1177/0145445504273281. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Sarokoff RA, Sturmey P. The effects of behavioral skills training on staff implementation of discrete-trial teaching. Journal of Applied Behavior Analysis. 2004; 37 :535–538. doi: 10.1901/jaba.2004.37-535. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Shapiro M, Kazemi E. A review of training strategies to teach individuals implementation of behavioral interventions. Journal of Organizational Behavior Management. 2017; 37 :32–62. doi: 10.1080/01608061.2016.1267066. [ CrossRef ] [ Google Scholar ]
  • Shapiro M, Kazemi E, Pogosjana M, Rios D, Mendoza M. Preference assessment training via self-instruction: A replication and extension. Journal of Applied Behavior Analysis. 2016; 49 :794–808. doi: 10.1002/jaba.339. [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Sigurdsson SO, McGee HM. Organizational behavior management: Systems analysis. In: Roane HS, Ringdahl JE, Falcomata TS, editors. Clinical and organizational applications of applied behavior analysis . Cambridge, MA: Academic Press; 2015. pp. 627–647. [ Google Scholar ]
  • Slowiak JM, Lakowske AM. The influence of feedback statement sequence and goals on task performance. Behavior Analysis: Research & Practice. 2017; 17 :357–380. doi: 10.1037/bar0000084. [ CrossRef ] [ Google Scholar ]
  • Strock, M. (2007). Autism spectrum disorders (pervasive developmental disorders) . Bethesda, MD: National Institute of Mental Health. Retrieved from https://eric.ed.gov/?id=ED495219 . Accessed 19 Aug 2019.
  • Sulzer-Azaroff B, Gillat A. Trends in behavior analysis in education. Journal of Applied Behavior Analysis. 1990; 23 :491–495. doi: 10.1901/jaba.1990.23-491. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Sundberg, D. B. (2016) Why people quit your company and how behavior analysis can slow the revolving door at ABA service providers . Retrieved from https://bsci21.org/why-people-quit-your-company-and-how-behavior-analysis-can-slow-the-revolving-door-at-aba-service-providers/ . Accessed 2 Nov 2016.
  • U.S. Department of Health & Human Services . Mental health: A report of the Surgeon General . Rockville, MD: U.S. Department of Health & Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health; 1999. [ Google Scholar ]
  • Van Houten R, Nau P, Marini Z. An analysis of public posting in reducing speeding behavior on an urban highway. Journal of Applied Behavior Analysis. 1980; 13 :383–395. doi: 10.1901/jaba.1980.13-383. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Waldvogel JM, Dixon MR. Exploring the utility of preference assessments in organizational behavior management. Journal of Organizational Behavior Management. 2008; 28 :76–87. doi: 10.1080/01608060802006831. [ CrossRef ] [ Google Scholar ]
  • Wallace MD, Doney JK, Mintz-Resudek CM, Tarbox RS. Training educators to implement functional analyses. Journal of Applied Behavior Analysis. 2004; 37 :89–92. doi: 10.1901/jaba.2004.37-89. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Ward-Horner J, Sturmey P. Component analysis of behavior skills training in functional analysis. Behavioral Interventions. 2012; 27 :75–92. doi: 10.1002/bin.1339. [ CrossRef ] [ Google Scholar ]
  • Wilder DA, Harris C, Casella S, Wine B, Postma N. Further evaluation of the accuracy of managerial prediction of employee preference. Journal of Organizational Behavior Management. 2011; 31 :130–139. doi: 10.1080/01608061.2011.569202. [ CrossRef ] [ Google Scholar ]
  • Wilder DA, Rost K, McMahon M. The accuracy of managerial prediction of employee preference: A brief report. Journal of Organizational Behavior Management. 2007; 27 (2):1–14. doi: 10.1300/J075v27n02_01. [ CrossRef ] [ Google Scholar ]
  • Wine B, Gilroy S, Hantula DA. Temporal (in)stability of employee preferences for rewards. Journal of Organizational Behavior Management. 2012; 32 :58–64. doi: 10.1080/01608061.2012.646854. [ CrossRef ] [ Google Scholar ]
  • Wine B, Reis M, Hantula DA. An evaluation of stimulus preference assessment methodology in organizational behavior management. Journal of Organizational Behavior Management. 2014; 34 :7–15. doi: 10.1080/01608061.2013.873379. [ CrossRef ] [ Google Scholar ]
  • Wine B, Wilder DA. The effects of varied versus constant high-, medium-, and low-preference stimuli on performance. Journal of Applied Behavior Analysis. 2009; 42 :321–326. doi: 10.1901/jaba.2009.42-321. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Yeaton WH, Bailey JS. Teaching pedestrian safety skills to young children: An analysis and one-year follow-up. Journal of Applied Behavior Analysis. 1978; 11 :315–329. doi: 10.1901/jaba.1978.11-315. [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]

Issue Cover

  • Previous Article
  • Next Article

Performance of Medication Tasks: Relationship Among Patient-Reported Outcomes, Performance-Based Assessments, and Objective Assessments

  • Article contents
  • Figures & tables
  • Supplementary Data
  • Peer Review
  • Get Permissions
  • Cite Icon Cite
  • Search Site

Jaclyn K. Schwartz , Katherine Aylmer , Samara Green , Sami Tayeb , Timothy J. Wolf , Elizabeth Unni , Emily Somerville; Performance of Medication Tasks: Relationship Among Patient-Reported Outcomes, Performance-Based Assessments, and Objective Assessments. Am J Occup Ther May/June 2024, Vol. 78(3), 7803205060. doi: https://doi.org/10.5014/ajot.2024.050500

Download citation file:

  • Ris (Zotero)
  • Reference Manager

Importance: Occupational therapy practitioners use standardized assessments to guide their clinical decision-making, but it is unclear how well performance on standardized assessments translates to performance at home.

Objective: To understand the concurrent and predictive validity of patient-reported outcomes and performance-based assessments for monitoring performance at home within the context of medication management and adherence.

Design: Exploratory study.

Setting: Participants completed standardized assessments in a lab or at home, which were followed by home-based electronic monitoring of medication adherence.

Participants: Sixty community-dwelling adults with hypertension or stroke who independently took antihypertensive medications.

Outcomes and Measures: Participants completed the Hill-Bone Medication Adherence Scale, the Hill-Bone Medication Adherence Reasons Scale, the Performance Assessment of Self-Care Skills Medication Management subtask, and the Executive Function Performance Test–Enhanced Medication Management subtest. Then, they used an electronic pill cap to monitor medication adherence at home for 1 month.

Results: Patient-reported outcomes and performance-based assessments in the context of medication management and adherence demonstrated poor concurrent and predictive validity to medication adherence at home.

Conclusions and Relevance: There is a gap between what people think they will do, what they can do on a standardized assessment, and what they actually do at home. Future research is needed to strengthen concurrent and predictive validity to clinically meaningful outcomes.

Plain-Language Summary: Occupational therapy practitioners should use caution when using standardized assessments to try to predict client performance at home. They should also continue to use a battery of assessments, clinical reasoning, and client preferences to guide their decision-making for monitoring performance at home within the context of medication management and adherence.

research articles on performance management

Citing articles via

Email alerts.

research articles on performance management

  • Special Collections
  • Conference Abstracts
  • Browse AOTA Taxonomy
  • AJOT Authors & Issues Series
  • Online ISSN 1943-7676
  • Print ISSN 0272-9490
  • Author Guidelines
  • Permissions
  • Privacy Policy
  • Cookie Policy
  • Accessibility
  • Terms of Use
  • Copyright © American Occupational Therapy Association, Inc.

This Feature Is Available To Subscribers Only

Sign In or Create an Account

Optimization of topology and energy management in fuel cell cruise ship hybrid power systems

  • Research Paper
  • Open access
  • Published: 17 May 2024
  • Volume 2 , article number  12 , ( 2024 )

Cite this article

You have full access to this open access article

research articles on performance management

  • Lei Niu 1 , 2 &
  • Li Xiao 3  

Current research on energy management strategies (EMSs) often neglects the impact of system topology and local control. This study tackles this issue by optimizing the topology of the hybrid power system on the ’FCS Alsterwasser’ cruise ship and enhancing EMS performance using various local controllers. First, the paper outlines the objectives of the research and provides an analysis of the current domestic and international research status. Second, the methods used in this study are introduced, including the topology optimization method and EMS. Subsequently, a model of the hybrid power system is constructed and verified through simulations. Finally, the effectiveness of different strategies is evaluated according to simulation results. Compared with an EMS based solely on a proportional-integral controller, the combination of a state machine and droop controller achieves better results, reducing battery power fluctuations by 86.5% and fuel cell power fluctuations by 16.2%.

Avoid common mistakes on your manuscript.

1 Introduction

1.1 motivation.

In the shipbuilding industry, fuel cells are considered promising clean alternative energy sources (van Biert et al. 2016 ). Proton exchange membrane fuel cells (PEMFCs) are preferred in the maritime industry because of their benefits, such as zero emissions, quick startup, high efficiency, high power density, and low noise (Ma et al. 2013 ). However, ship navigation conditions are complex, and load fluctuations are considerable (de-Troya et al. 2016 ). The application of fuel cells to various types of ships is much more intricate than to land equipment, mainly because fuel cells cannot rapidly suppress power fluctuations in a ship’s microgrid (Wu and Bucknall 2020 ). Therefore, energy storage systems (ESSs) are often used to complement fuel cell systems to address the synergy and complementarity among energy sources, ultimately enhancing the overall energy efficiency of vessels. ESSs can effectively smooth out power fluctuations in a ship’s load (Yang et al. 2020 ). Battery systems are typically used for energy storage in fuel cell power systems to enhance efficiency and power. These storage systems combine the high energy densities of batteries and high power densities of supercapacitors and can thus handle frequent charge-discharge cycles (Banaei et al. 2021 ). This capability enables them to mitigate low- and high-frequency power fluctuations, resulting in peak shaving and valley-filling effects and effectively reducing the impact of load fluctuations on a grid (Xing et al. 2021 ). A hybrid power system composed of fuel cells and ESSs can optimize the operation of fuel cells, improve their efficiency, extend their lifespan, enhance the dynamic response of a power system, and enable multisource complementary power generation (Dall’Armi et al. 2023 ).

Designing an efficient energy management strategy (EMS) that appropriately allocates the required power between a fuel cell system and ESS is challenging. An EMS controls the dynamic behavior of components in a hybrid power system, thereby affecting system efficiency, fuel consumption, and lifespan (Sun et al. 2013 ). Therefore, developing a suitable EMS for hybrid fuel cell power systems has always been an essential research topic (Sulaiman et al. 2018 ). However, existing research on EMSs for hybrid fuel cell power systems has mostly focused on EMS performance, overlooking the impact of local control on energy management performance (Liu et al. 2024 ). Nevertheless, some researchers have achieved favorable research results by using topology optimization or capacity optimization design. Given the shortcomings of existing research, this study aims to explore topology optimization and energy management in the hybrid power system of the ’FCS Alsterwasser’ cruise ship. It will investigate the impact of topology and local control on EMSs and further enhance the performance of EMSs.

1.2 Literature review

Various advanced ship EMSs have been proposed and examined owing to challenges in enhancing hybrid power systems’ performance, including dynamic programming (DP; Zhang 2019 ), Pontryagin’s minimum principle (PMP; Schmid et al. 2021 ), equivalent consumption minimization strategy (ECMS; Ge et al. 2023 ), machine learning algorithms, and model predictive control (Ghorashi Khalil Abadi et al. 2022 ). The DP algorithm, as a classic multistage decision optimization method, optimizes the operation cost of ship power systems. However, this strategy is difficult to apply to practical energy management because of uncertainties about ship navigation conditions. DP requires accurate global operational conditions. PMP is partially applicable to hybrid electric vehicles, but research into hybrid power ships is limited. The principle of this strategy is to find an optimal solution by calculating the Hamiltonian function at each moment. DP and PMP are usually conducted offline and often used as benchmarks. Meanwhile, the ECMS optimizes all energy sources in real time by adjusting factors representing equivalent fuel consumption costs and is widely used for real-time power distribution optimization in hybrid power systems. However, this strategy heavily relies on equivalent factors. Thus, determining optimal values is difficult, and the method has limited performance. Energy management strategies based on machine learning algorithms have potential but are hampered by the ’black box’ issue (Fan et al. 2023 ), which renders their direct application to actual ships difficult. To further enhance the performance of hybrid power systems, innovative and effective approaches that address current strategy dependencies and uncertainties are needed.

A hybrid fuel cell propulsion system, as a typical form of ship hybrid power system, has many potential applications, thus garnering considerable interest from the shipbuilding sector. The system has already been applied and researched, but studies on hybrid fuel cell propulsion systems have mainly focused on the hybrid power system of the ’FCS Alsterwasser’ ship to develop new EMSs for conserving energy and reducing emissions. Han et al. ( 2014 ) proposed a state machine-based energy management system for the hybrid power system of the ’FCS Alsterwasser’ ship; the proposed strategy was designed on the basis of the optimal efficiency of the fuel cell (FC) and batteries to ensure that both energy sources operate in the high-efficiency range. Bassam et al. ( 2016 ) proposed a novel energy management strategy that uses fuel cell efficiency as input to maintain high fuel cell efficiency and reduce pressure and thereby reduce fuel consumption; compared with a state-based ECMS strategy and the original proportional-integral (PI) strategy, the proposed PI strategy achieved daily hydrogen savings of 3.5%, 1.7%, and 1.4% while reducing fuel cell stress. Sun et al. ( 2020 ) considered the aging cost of fuel cells and developed a unified optimization model to minimize the total cost of fuel consumption and power source aging over the entire voyage and to optimize the output power of multiple fuel cells and batteries, as well as propulsion power. Tang and Wang ( 2021 ) proposed an EMS based on wavelet transformation and fuzzy logic for a fuel cell/battery/supercapacitor hybrid power cruiser, considering the dynamic characteristics of each power source; the simulation results showed that the proposed EMS enabled the fuel cell to provide approximately 50% of high-frequency power and reduced peak power from the fuel cell by 80% when the initial charge level of the supercapacitor was low. Rafiei et al. ( 2021 ) presented and analyzed a zero-emission all-electric hybrid energy system based on fuel cells, batteries, and shore power, using an improved sin-cosine algorithm to optimize power scheduling; the proposed hybrid power system and energy management method demonstrated high performance as an applicable approach for ships. Wu et al. ( 2020 ) introduced an EMS based on dual Q reinforcement learning; their results indicated that the strategy achieved nearly optimal cost-effectiveness compared with DP and comparable state space resolution without prior knowledge of future power demand. However, although these studies have conducted advanced research on energy management strategies, they have overlooked the impact of local control on hybrid power systems (Zeng et al. 2023 ). Owing to the multiple aspects of energy management in hybrid power systems, it can include an energy management layer and a local control layer according to the hierarchical control architecture. The energy management layer is primarily responsible for optimizing power distribution and decision-making in hybrid power systems (Haseltalab et al. 2016 ), whereas the local control layer is responsible for executing the structure determined by the energy management layer. The two layers are interdependent and cannot be discussed separately. Therefore, the local control layer should be investigated in order that the impact of different local control layers on hybrid power systems and energy management strategies can be explored.

Existing research primarily utilizes a classic proportional-integral (PI) controller for fuel cells because of the direct parallel connection of a ship’s batteries to a DC bus. The control principle relies on open-loop control based on the reference power of a fuel cell and the state of charge (SOC) of batteries, which provide passive energy. This feature leads to challenges in the optimization of fuel cells and battery power. Some studies have explored strategies for optimizing the architecture and capacity configurations of hybrid power systems. Zhang et al. ( 2020 ) proposed a selection method for the hybrid ESS of a fuel cell hybrid propulsion cruise ferry to extend the lifespan of fuel cells; based on the configuration of the power system, a real-time optimization control strategy that balances efficiency and durability was proposed; the simulation results showed that the strategy outperformed rule-based strategies in terms of fuel economy, system durability, and dynamic performance. Zhu et al. ( 2020 ) proposed a multi-objective dual-layer optimization approach, where component sizing adjustments and energy management were simultaneously conducted in the upper and lower layers, respectively; the results of the proposed dual-layer optimization were compared with the results of two independent single-layer optimization strategies; the optimal solution of the proposed method outperformed single-layer optimization, and the results of single lower-layer optimization were closer to the dual-layer optimization results than single upper-layer optimization results (Zhu et al. 2020 ).

However, not only the selection of energy equipment but also the topology structures of different energy sources affect the selection of energy equipment and the performance of hybrid power systems. Chen et al. ( 2020 ) introduced a multi-objective optimization method for HESS and EMS based on a support vector machine and frequency control; the simulation results indicated that compared with different hybrid power system structures, the optimal HESS can meet power demands and reduce the cost of energy storage devices. Compared with rule-based energy management strategies, the optimal hybrid power system showed a 5.4% decrease in energy consumption, improving the quality of electrical energy and extending equipment lifespan (Chen et al. 2020 ). Ge et al. ( 2023 ) optimized the topology structure of a ship’s hybrid fuel cell power system; in addition, they proposed a hybrid power system combining fuel cells, batteries, and supercapacitors and utilized a fuzzy logic-based EMS to improve the performance of the hybrid power system; they suggested the potential of the capacity and topology structure of the ship’s hybrid power system for further optimization. Overall, these studies have optimized and compared the topology structures of hybrid power systems, studying the performance of hybrid power systems under different topology structures and demonstrating the impact of topology structure optimization on the performance of hybrid power systems. Therefore, studying the influence of topology structure on hybrid power systems is necessary.

The purpose of this research is to enhance the existing topology structure of a fuel cell/battery hybrid power ship, investigate the combined effects of different energy management strategies and local controllers, and improve the performance of the EMS. This study will compare the performance of energy management strategies on the basis of PI-based local controllers and droop controllers. It will compare these strategies with an EMS based on the original PI controller, state machine-based EMS, and fuzzy logic-based EMS according to the energy quality of batteries and fuel cells and SOC of batteries.

1.3 Outline

The remaining sections of this study are organized as follows. Section  2 introduces topology structure optimization, EMS, and local controllers. Section  3 focuses on the information on the hybrid power system of the ’FCS Alsterwasser’ ship, including the modeling, simulation process, setup, and construction of the hybrid power system, EMS, and local controller models. Section  4 presents and discusses the simulation results. Section  5 concludes the paper and provides future research directions.

2 Methodology

2.1 topology optimization.

The ship’s original hybrid power system directly connected the battery to the 560 V DC bus as an ESS (Fig.  1 ). However, owing to frequent fluctuations in the ship’s load, the traditional PI-based EMS ensured stability by only controlling the fuel cell system’s power, and the battery had to bear not only partial low-frequency loads but also the main high-frequency load output. Thus, optimizing the hybrid power system and stabilizing the bus voltage were difficult.

figure 1

Original hybrid power system topology of the ’FCS Alsterwasser’ ship

Given the fluctuations in shipload, the economy and equipment lifespan of the hybrid power system can be enhanced by improving the controllability of the hybrid power system. This paper proposes a scheme for improving topology, local control, and EMS to achieve the efficient operation of the hybrid power system. The modification process primarily involves connecting the battery to the DC bus through bidirectional DC/DC converters to enhance the controllability of the batteries. The improved topology of the hybrid fuel cell power system is illustrated in Fig.  2 .

figure 2

Modified hybrid power system topology of the ’FCS Alsterwasser’ ship

With the aforementioned modifications, the batteries can be controlled through external control signals for voltage or current closed-loop control, which can enhance the controllability of the batteries. Therefore, voltage or current closed-loop controllers can be employed for the batteries and fuel cells, enabling reference power tracking and assisting the EMS in distributing power to the hybrid power system.

2.2 Energy management strategies

2.2.1 classic pi ems.

Early EMS based on classic PI and PID controllers have been proposed, featuring a simple and easy-to-implement control structure. The control principles are illustrated in Fig.  3 . In this study, the P gain was set to 200, and the I gain was set to 1.

figure 3

Control principles of classic PI EMS

The current SOC of the battery and its reference SOC are compared, and a PI controller is employed to derive the battery’s reference power, which is then subtracted from the load power, yielding the computed reference power for the fuel cell. Subsequently, by dividing the reference power of the battery and fuel cell by the bus voltage, the theoretical current output for the fuel cell and battery is determined. This output, in turn, facilitates closed-loop control through current feedback. The primary objective of the PI-based EMS is to maintain the battery’s SOC at its designated level to alleviate stress on the battery and extend its operational lifespan. However, this control methodology has limitations. When the battery’s SOC falls below the reference value, the fuel cell operates according to the required load power or at maximum power. This feature can adversely affect the efficiency, hydrogen consumption rate, and longevity of the fuel cell.

2.2.2 State machine-based strategy

The state machine-based EMS is based on deterministic rules and adjusts the operation of the hybrid power system under varying loads through predefined control rules. The principles of the state machine-based energy management control strategy can be found in Fig.  4 , and the configuration of its principles is shown in Table  1 .

figure 4

Principles of state machine-based EMS control

For hybrid fuel cell power systems, a state machine-based control strategy is typically devised on the basis of the desired power and battery SOC, and the operational constraints of the hybrid power system are considered. In this study, the maximum value for battery SOC (SOC max ) is set at 85%, while the minimum value (SOC min ) is 10%. Refining control rules is an effective approach for enhancing the performance of a state machine-based control strategy. However, an excessive number of rules can lead to frequent control changes, resulting in the unstable operation of the hybrid power system and increasing susceptibility to the influence of sudden load variations.

2.2.3 Fuzzy logic control strategy

In this study, the fuzzy logic controller has two input variables, namely, the battery’s SOC bat and power demand P demand , and one output variable, which is the required power for the fuel cell ( P FC ). The fuzzy controller employs IF-Then rules to establish a map between inputs and outputs. The control principles are illustrated in Fig.  5 .

figure 5

Principles of fuzzy logic-based EMS control

This study utilized a fuzzy controller with 12 rules (Motapon et al. 2014 ). The details are provided in Table  2 .

The fuzzy controller uses trapezoidal membership functions for input and output selections (Fig.  6 ).

figure 6

Fuzzy logic control membership functions

2.3 Local controller

2.3.1 pi controller.

The classic PI controller as a local controller has been integrated into energy management strategies. However, the classic PI control method is mainly based on obtaining reference current from the ratio of reference power to the bus voltage and achieves power distribution and control through current closed-loop control. The classic PI control method primarily collects current signals for closed-loop control without introducing reference voltage, leading to large bus voltage fluctuations. It is suitable for use in a semiactive topology, where energy storage devices are directly connected in parallel to the bus in a microgrid structure.

The microgrid structure of FCS Alsterwasser adopts a semiactive structure, where the fuel cell needs to be controlled through DC/DC boost and control without the need to control the battery, which is a type of PI controller. The PI controller cannot achieve simultaneous control of the fuel cell and battery.

2.3.2 Droop controller

Droop control mainly consists of two types: voltage-power droop control, which describes the voltage-power relationship, and voltage-current (V-I) droop control, which describes the voltage-current relationship. In this study, the V-I droop control is employed to achieve power control based on droop characteristics among parallel distributed power sources. In DC microgrids, the droop characteristic curve reflects the relationship between the DC voltage and DC current of the power sources. In fuel cells, which can only discharge, the droop curve exists only in the first quadrant. In batteries that can charge and discharge, the droop curve typically exhibits characteristics in two quadrants, as illustrated in Fig.  7 .

figure 7

Droop control principle

However, traditional droop controllers mainly use fixed droop coefficients, which renders tracking nonlinear reference power obtained from the EMS difficult. Therefore, these controllers cannot be directly applied to this study. This study intends to propose a droop controller based on dynamic virtual impedance as a local controller and compare its performance with a local controller based on the classic PI controller. According to the principle of traditional droop control, the power of an energy source is inversely proportional to the droop coefficient; that is, the droop coefficient decreases with increasing rated power. Depending on the operating state of different energy sources, the droop coefficient can be obtained according to the load power and the power of each energy source. The formula for calculating the droop coefficient is summarized in Eq. ( 1 ).

where \(k_{d}\) is the n- th distributed power source, \(p_{n}\) is the expected power of the n- th distributed power source, \(k_{adj}\) is the correction factor, and in the study, and \(k_{adj}\)  = 0.1. On the right-hand side of Eq. ( 1 ), the denominator is the load power, and the numerator is the load power minus the reference power of the energy source. p total refers to the total demand power, p bat represents the battery power.

3 Modeling and simulation implementation

3.1 ’fcs alsterwasser’ overview.

This article focuses on the world’s first fuel-cell cruise ship, the ’FCS Alsterwasser’. Owing to the widespread availability of its key technical parameters and navigation data, it has been widely used as a subject of study in maritime energy management research. Comprehensive information about this ship can be found in previous studies (Zhu et al. 2014 ; Choi et al. 2016 ). The primary parameters of the ship can be found in Table  3 .

The ship’s hybrid power system consists of a PEMFC and a set of lead-acid batteries, primarily relying on the fuel cell during cruising. During high-load operations, it uses a battery to reduce the output power of the fuel cell and extend its lifespan. The battery mainly serves a ’peak shaving’ function to stabilize the bus voltage. The primary parameters of the ’FCS Alsterwasser’ ship’s hybrid power system can be found in Table  4 .

3.2 Hybrid power system model

3.2.1 fuel cell.

The ’FCS Alsterwasser’ employs a PEMFC, which is a type of fuel cell with a well-established model that is widely studied and applied. As shown in Fig.  8 a, this study utilizes the fuel cell module provided by Matlab/Simulink for modeling purposes, configuring it as a detailed fuel cell model and defining the fuel cell parameters to simulate the fuel cell system. This model is then integrated into the hybrid power system. Detailed information about this module is provided in the documentation of Simulink and the associated reference literature.

figure 8

FC model. a FC module; b FC equivalent circuit

The stack consists of several series-connected fuel cells. The equivalent circuit for a single fuel cell used in this module is provided in Fig.  8 b. The primary parameters for this model can be obtained from the fuel cell’s parameter table (Table  4 ). Considering the response time of the fuel cell, this model can represent the steady-state performance and dynamic behavior of the PEMFC. Additionally, the model considers the characteristics of the electrical and chemical aspects of the FC.

3.2.2 Battery

In this study, the primary focus is researching EMS performance, and the intricate characteristics of the battery are not considered. Constructing a battery model with dynamic properties is sufficient. Therefore, the battery model in Matlab/Simulink is utilized (Fig.  9 ). The model is configured according to the battery’s parameter information (Table  4 ).

figure 9

Battery model

The voltage source of this battery model is defined as follows:

where V nom is the rated voltage and beta is a coefficient that can be adjusted to simulate battery characteristics.

3.2.3 DC/DC converter

The voltage of the DC/DC converter component in the hybrid power system varies according to the current requirements of each power source. Therefore, an electronic circuit is needed to stabilize the power supply voltage while providing the required power. Given that this study does examine the dynamic behavior inside the DC/DC converter, an ideal bidirectional DC/DC converter module from Matlab/Simulink is used to regulate the output voltage of the PEMFC or battery, as shown in Fig.  10 .

figure 10

DC/DC converter model

The ideal DC/DC model can simulate the dynamic behavior of the DC/DC converter and can implement current or voltage closed-loop control through external signals. In this study, the focus is on investigating the impact of different local control strategies on the EMS. Therefore, the DC/DC model facilitates the design of local controllers and EMS simulation studies.

3.2.4 Ship load

To simulate the typical ship conditions, this study utilizes the dynamic load module available in Matlab/Simulink (Fig.  11 ).

figure 11

Dynamic load model

In this study, this module is configured as a DC load. The power consumption of this module will be equal to the input demand power signal if the power consumption of the module is greater than the minimum power consumption parameter value and the DC power source voltage exceeds the specified value of the minimum power source voltage parameter.

3.3 Navigational conditions

The data from a single navigational condition of the ’FCS Alsterwasser’ has been established as a typical condition in ship energy management research and has been widely used in testing various types of EMSs (Peng et al. 2023 ). This segment of navigational condition data can be found in Fig.  12 .

figure 12

Navigational condition of the ’FCS Alsterwasser’ ship

The primary characteristics of this navigational condition data are as follows: (a) peak propulsion power is approximately 112 kW; (b) acceleration time is approximately 32 s (163–195 s); (c) cruise power is approximately 40 kW; (d) excluding auxiliary power during the cycle, the average power demand is approximately 41 kW. This power demand includes propulsion and auxiliary power and covers power requirements during various phases of ship operation, including sailing, docking, stopping, and acceleration, serving as a typical navigational condition for ships. The relatively short duration of this data segment hampers the comprehensive evaluation of the strategy’s performance. Thus, this study plans to test and evaluate the proposed method by continuously cycling this condition 10 times.

3.4 Simulation implementation

Based on the modeling described above, the hybrid power system model for the ’FCS Alsterwasser’ ship and the EMS model are obtained, as shown in Fig.  13 . The voltage, current, and power data for the battery, fuel cell, and load can be obtained through the sensor module. Through their interaction, the performance of the EMS can be evaluated.

figure 13

Hybrid power system and EMS model

4 Results and discussion

4.1 simulation result.

This study has validated the proposed topological optimization and the effectiveness of the EMS through software simulations. Figures  14 and 15 , respectively, depict the current profiles of the battery and fuel cell, while Fig.  16 shows the SOC of the battery. The simulation results in the figures for the PI controller are based on the original topology, whereas the results for the droop controller are based on the improved topology.

figure 14

Battery power

figure 15

SOC of the battery

Based on Figs. 14 , 15 and 16 , the following observations can be analyzed:

Under the same EMS, different results are obtained when the PI controller or droop controller as the local controller is used. For example, when the PI controller is used, the direct control of the FC’s output power causes large fluctuations in the FC power because of repeated changes in the reference power output based on the fuzzy-based EMS. By contrast, the droop controller simultaneously controls the battery and the fuel cell, resulting in the suppression of fuel cell power fluctuations.

According to Fig.  14 , in the PI-based EMS, the battery is in a state of discharging before the 2000 s, during which the battery bears the entire load, and the fuel cell does not work. After the 2000 s, the battery SOC is maintained at approximately 60%, at which the fuel cell bears most of the power, and the battery frequently switches between charging and discharging as the load changes. The strategy based on the PI-based EMS evidently does not rationally allocate power between the battery and fuel cell, leading to large fluctuations in the battery and affecting its lifespan.

The principle of the state machine-based EMS is to determine the reference power for the battery and the fuel cell according to the magnitude of power. The designed scenarios include a relatively stable 41 kW load, repeated pulse loads, FC bearing all the power under steady loads, and batteries only serving as supplements under pulse loads. The reason is that the state machine-based EMS outputs reference power on the basis of predetermined rules, and the wide range of designed scenarios in this study makes balancing the output of the battery and fuel cell with this strategy difficult. Thus, the battery is not working during the steady demand phase.

4.2 Power quality analysis

Based on simulation data, the analysis of the power results for the battery and fuel cell under different strategies, including their mean and standard deviation, is presented in Tables 5 and 6 .

According to Tables 5 and 6 , the following results can be analyzed:

Topological optimization improves the controllability of the battery and enhances the stability of the hybrid power system. When relying solely on the PI controller, the battery power experiences large fluctuations because the battery is directly connected to the bus. This connection results in passive energy supply and large power fluctuations. Nevertheless, adding a DC/DC converter considerably reduces these power fluctuations. In particular, the EMS based on the state machine and PI reduces battery power fluctuations by 94.6%.

As observed in Fig.  16 , the traditional PI controller stabilizes the SOC once it reaches the desired SOC value, at which the battery output power remains nearly zero, and the battery handles most of the load power. The state machine-based EMS primarily maintains the SOC at approximately 65%, while the fuzzy logic control allows the battery to fully discharge.

Performance varies when different local control strategies are integrated into the EMS. Energy management based on the state machine and PI effectively suppresses battery power fluctuations but is limited by the technical challenge posed by the fuel cell that handles most high-frequency fluctuations. This limitation is detrimental to the fuel cell’s lifespan and efficiency.

The results indicate that the EMS based on the combination of the state machine and droop control achieves balanced outcomes. This strategy maintains a high average output power for the fuel cell and minimizes power fluctuations, allowing the battery to handle the majority of high-frequency loads. This aligns with the predefined optimization goals. Notably, the battery power fluctuations decrease by 86.5%, and the fuel cell power fluctuations decrease by 16.2%.

The combination of fuzzy logic control and PI represents a relatively balanced control strategy. Compared with the combination of fuzzy logic control and droop control, the power fluctuations of the battery and fuel cell are enhanced because the fuzzy logic control continuously adjusts the reference power output, leading to frequent adjustments in the droop coefficients in the droop controller and intensifying the fluctuations.

5 Conclusions

Topological optimization improves the stability of the hybrid power system and enhances the controllability of the battery. When the PI controller alone is used, large power fluctuations occur because of the direct connection to the bus, leading to passive energy supply. However, integrating a DC/DC converter into the battery can greatly reduce power fluctuations, and the combination of the state machine-based EMS and PI reduces battery power fluctuations by 94.6%. Different local control strategies coupled with EMS lead to varying performance, and the combination of the state machine and droop control achieves balanced outcomes by minimizing power fluctuations in the battery and fuel cell. The combination of fuzzy logic control and PI represents a relatively balanced control strategy, while the combination of fuzzy logic control and droop control intensifies power fluctuations because of frequent adjustments.

This study primarily focuses on optimizing the topology and EMS of a fuel cell hybrid power system. By improving the topology and devising suitable energy management and local control strategies, the EMS based on the state machine and droop control achieves the most balanced results, demonstrating its suitability for hybrid fuel cell power systems. However, this research has some limitations.

The DC/DC converter used in this study employs an average value model, which cannot capture the current or voltage closed-loop control implemented based on PI or droop controllers. Thus, results are directly based on reference current or voltage, and the dynamic characteristics of the DC/DC converter are not considered.

This study solely focuses on the modification of the DC/DC converter while neglecting the optimization and modification of the capacities of the battery and fuel cell. It overlooks additional economic costs associated with these modifications, and thus, the simulation results are limited. A comprehensive evaluation of strategies should consider various factors to provide a holistic perspective.

This study conducts testing and analysis solely through software simulations without incorporating real-world testing and validation. Hardware-in-the-loop simulations are needed to validate the proposed topological optimization strategy and EMS in a real-world context.

Availability of data and materials

All data, models, and code generated or used during the study appear in the submitted article.

Banaei M, Boudjadar J, Khooban MH (2021) Stochastic model predictive energy management in hybrid emission-free modern maritime vessels. IEEE Trans Ind Inf 17(8):5430–5440. https://doi.org/10.1109/TII.2020.3027808

Article   Google Scholar  

Bassam AM, Phillips AB, Turnock SR, Wilson PA (2016) An improved energy management strategy for a hybrid fuel cell/battery passenger vessel. Int J Hydrog Energy 41(47):22453–22464. https://doi.org/10.1016/j.ijhydene.2016.08.049

Article   CAS   Google Scholar  

Chen H, Zhang ZH, Guan C, Gao HB (2020) Optimization of sizing and frequency control in battery/supercapacitor hybrid energy storage system for fuel cell ship. Energy 197:117285. https://doi.org/10.1016/j.energy.2020.117285

Choi CH, Yu SJ, Han IS, Kho BK, Kang DG, Lee HY et al (2016) Development and demonstration of PEM fuel-cell-battery hybrid system for propulsion of tourist boat. Int J Hydrog Energy 41(5):3591–3599. https://doi.org/10.1016/j.ijhydene.2015.12.186

Dall’Armi C, Pivetta D, Taccani R (2023) Hybrid PEM fuel cell power plants fuelled by hydrogen for improving sustainability in shipping: state of the art and review on active projects. Energies 16(4):2022. https://doi.org/10.3390/en16042022

de-Troya JJ, Álvarez C, Fernández-Garrido C, Carral L (2016) Analysing the possibilities of using fuel cells in ships. Int J Hydrog Energy 41(4):2853–2866. https://doi.org/10.1016/j.ijhydene.2015.11.145

Fan A, Li YP, Fang SD, Li YR, Qiu H (2023) Energy management strategies and comprehensive evaluation of parallel hybrid ship based on improved fuzzy logic control. IEEE Trans Transp Electrif. https://doi.org/10.1109/TTE.2023.3332772

Ge YQ, Zhang JD, Zhou KX, Zhu JT, Wang YK (2023) Research on energy management for ship hybrid power system based on adaptive equivalent consumption minimization strategy. J Mar Sci Eng 11(7):1271. https://doi.org/10.3390/jmse11071271

Ghorashi Khalil Abadi SA, Habibi SI, Khalili T, Bidram A (2022) A model predictive control strategy for performance improvement of hybrid energy storage systems in DC microgrids. IEEE Access 10:25400–25421. https://doi.org/10.1109/ACCESS.2022.3155668

Han JG, Charpentier JF, Tang TH (2014) An energy management system of a fuel cell/battery hybrid boat. Energies 7(5):2799–2820. https://doi.org/10.3390/en7052799

Haseltalab A, Negenborn RR, Lodewijks G (2016) Multi-level predictive control for energy management of hybrid ships in the presence of uncertainty and environmental disturbances. IFAC-PapersOnLine 49(3):90–95. https://doi.org/10.1016/j.ifacol.2016.07.016

Liu HY, Fan AL, Li YP, Bucknall R, Chen L (2024) Hierarchical distributed MPC method for hybrid energy management: a case study of ship with variable operating conditions. Renew Sust Energy Rev 189:113894. https://doi.org/10.1016/j.rser.2023.113894

Ma DZ, Zhao JB, Xu XJ, Zhang T, Zhang X (2013) On the connected ships for fleet technical management system. In: Yan XP et al (eds) ICTIS 2013: improving multimodal transportation systems-information, safety, and integration. ASCE, Reston, pp 2314–2320. https://doi.org/10.1061/9780784413036.312

Chapter   Google Scholar  

Motapon S, Dessaint LA, Al-Haddad K (2014) A comparative study of energy management schemes for a fuel-cell hybrid emergency power system of more-electric aircraft. IEEE Trans Ind Electron 61(3):1320–1334. https://doi.org/10.1109/TIE.2013.2257152

Peng X, Chen H, Guan C (2023) Energy management optimization of fuel cell hybrid ship based on particle swarm optimization algorithm. Energies 16(3):1373. https://doi.org/10.3390/en16031373

Rafiei M, Boudjadar J, Khooban MH (2021) Energy management of a zero-emission ferry boat with a fuel-cell-based hybrid energy system: feasibility assessment. IEEE Trans Ind Electron 68(2):1739–1748. https://doi.org/10.1109/TIE.2020.2992005

Schmid R, Buerger J, Bajcinca N (2021) Energy management strategy for plug-in-hybrid electric vehicles based on predictive PMP. IEEE Trans Control Syst Technol 29(6):2548–2560. https://doi.org/10.1109/TCST.2020.3048129

Sulaiman N, Hannan MA, Mohamed A, Ker PJ, Majlan EH, Wan Daud RW (2018) Optimization of energy management system for fuel-cell hybrid electric vehicles: issues and recommendations. Appl Energy 228:2061–2079. https://doi.org/10.1016/j.apenergy.2018.07.087

Sun X, Yan XP, Wu B (2013) Research on the energy efficiency improvement for existing ships. In: Yan XP et al (eds) ICTIS 2013: improving multimodal transportation systems-information, safety, and integration. ASCE, Reston, pp 2301–2306. https://doi.org/10.1061/9780784413036.310

Sun YL, Xu QM, Yuan YZ, Yang B (2020) Optimal energy management of fuel cell hybrid electric ships considering fuel cell aging cost. In: 2020 IEEE/IAS Industrial and Commercial Power System Asia (I&CPS Asia), Weihai, pp 240–245. https://doi.org/10.1109/ICPSAsia48933.2020.9208534

Tang DG, Wang HL (2021) Energy management strategies for hybrid power systems considering dynamic characteristics of power sources. IEEE Access 9:158796–158807. https://doi.org/10.1109/ACCESS.2021.3131168

van Biert L, Godjevac M, Visser K, Aravind PV (2016) A review of fuel cell systems for maritime applications. J Power Sources 327:345–364. https://doi.org/10.1016/j.jpowsour.2016.07.007

Wu P, Bucknall R (2020) Hybrid fuel cell and battery propulsion system modelling and multi-objective optimisation for a coastal ferry. Int J Hydrog Energy 45(4):3193–3208. https://doi.org/10.1016/j.ijhydene.2019.11.152

Wu P, Partridge J, Bucknall R (2020) Cost-effective reinforcement learning energy management for plug-in hybrid fuel cell and battery ships. Appl Energy 275:115258. https://doi.org/10.1016/j.apenergy.2020.115258

Xing H, Stuart C, Spence S, Chen H (2021) Fuel cell power systems for maritime applications: progress and perspectives. Sustainability 13(3):1213. https://doi.org/10.3390/su13031213

Yang R, Yuan YP, Ying RS, Shen BY, Long T (2020) A novel energy management strategy for a ship’s hybrid solar energy generation system using a particle swarm optimization algorithm. Energies 13(6):1380. https://doi.org/10.3390/en13061380

Zeng YJ, Zhang QJ, Liu YC, Guo HH, Zhang FK, You S (2023) Distributed unified controller design for parallel battery storage system in DC shipboard microgrid. IEEE Trans Power Syst 39(1):546–563. https://doi.org/10.1109/TPWRS.2023.3244967

Zhang FQ, Hu XS, Xu KH, Tang XL, Cui YH (2019) Current status and prospects for model predictive energy management in hybrid electric vehicles. J Mech Eng 55(10):86–108 (in Chinese with English abstract)

Zhang ZH, Guan C, Liu ZY (2020) Real-time optimization energy management strategy for fuel cell hybrid ships considering power sources degradation. IEEE Access 8:87046–87059. https://doi.org/10.1109/ACCESS.2020.2991519

Zhu JY, Chen L, Wang XF, Yu L (2020) Bi-level optimal sizing and energy management of hybrid electric propulsion systems. Appl Energy 260:114134. https://doi.org/10.1016/j.apenergy.2019.114134

Zhu L, Han J, Peng D, Wang T, Tang T, Charpentier JF (2014) Fuzzy logic based energy management strategy for a fuel cell/battery/ultra-capacitor hybrid ship. In: 2014 First International Conference on Green Energy ICGE 2014, Sfax, pp 107–112. https://doi.org/10.1109/ICGE.2014.6835406

Download references

Acknowledgements

This paper is supported by the 2020 Hubei Provincial Department of Education Science Research Program Guidance Project (Grant No. B2020252).

Additional information

Edited by: Wenwen Chen.

Author information

Authors and affiliations.

China Merchants Viking Cruises Co., Ltd., Shenzhen, 518068, China

Guanghua School of Management, Peking University, Beijing, 100871, China

Department of Mechanical and Electronic Engineering, Wuchang University of Technology, Wuhan, 430223, China

You can also search for this author in PubMed   Google Scholar

Contributions

Lei Niu: Conceptualization, Manuscript writing, Implementation of the computer code; Li Xiao: Methodology, Writing-Review & Editing, and Language polishing.

Corresponding author

Correspondence to Li Xiao .

Ethics declarations

Ethics approval and consent to participate.

No applicable.

Consent for publication

Informed consent for publication was obtained from all participants.

Competing interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Niu, L., Xiao, L. Optimization of topology and energy management in fuel cell cruise ship hybrid power systems. Intell. Mar. Technol. Syst. 2 , 12 (2024). https://doi.org/10.1007/s44295-024-00026-3

Download citation

Received : 22 January 2024

Revised : 12 March 2024

Accepted : 12 April 2024

Published : 17 May 2024

DOI : https://doi.org/10.1007/s44295-024-00026-3

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Hybrid power system
  • Energy management strategy
  • Topology optimization
  • Local control
  • Find a journal
  • Publish with us
  • Track your research

COMMENTS

  1. Performance Management: A Scoping Review of the Literature and an

    Given the competitive global environment in which organizations operate, the need to develop (and retain) highly skilled employees is paramount for prosperity and survival (Crawshaw, Van Dick, & Brodbeck, 2012).Performance management (PM) is widely advocated as a way to develop employees (Aguinis, 2013; Cascio, 2014).Broadly speaking, PM can be defined as "identifying, measuring, and ...

  2. Performance Management: A Systematic Review of the Literature and an

    Performance appraisal, performance management, and firm- level performance: A review, a proposed model, and new directions for future research. The Academy of Management Annals , 8, 127-179. doi ...

  3. The Performance Management Revolution

    The focus is shifting from accountability to learning. by. Peter Cappelli. and. Anna Tavis. From the Magazine (October 2016) Going Nowhere, Untitled 8; giclée on paper, 2015 Ben Zank. Summary ...

  4. Full article: Performance management systems: reviewing the rise of

    Findings: The findings suggest there is a link between performance measurement systems and dynamics, but the link is weak, and the main research does not incorporate dynamic elements. There is an observable research community interest in managing information for informed decisions through digitalization.

  5. Harnessing the power of performance management

    These days, performance management is a source of dissatisfaction at many organizations. Large shares of respondents to a recent McKinsey Global Survey on the topic say their organizations' current systems and practices have no effect—or even a negative one—on company performance. 1 Moreover, they do not see positive returns on investment ...

  6. Rethinking Performance Management for Post-Pandemic Success

    Data-informed performance management invites and inspires more productive workforce exchanges. These interim COVID-19 findings represent genuine business applications of conclusions reached by our 2019 research report "Performance Management's Digital Shift." That report anticipated the disruptive dominance data-driven workforce ...

  7. Performance Management: A Scoping Review of the Literature and an

    To address these research objectives, we conducted a scoping review covering 111⁄2 of research into PM. The following section explains the methodology employed, followed by a discussion of the key results and subsequent research gaps. We finish by discussing the prevalence of PM and PA in the literature.

  8. PDF Evaluating the Effectiveness of Performance Management

    Keywords: performance management, performance appraisal, evaluation, integrative conceptual review Despite the popularity of performance appraisal (PA) and per-formance management (PM) in both research and practice, there is a great deal yet to know about the effectiveness of these practices. Consider, for example, the following observations.

  9. Performance Management: A Scoping Review of the Literature and an

    Performance appraisal, performance management, and firm- level performance: A review, a proposed model, and new directions for future research. The Academy of Management Annals , 8, 127-179. doi ...

  10. Reinventing Performance Management

    At Deloitte we're redesigning our performance management system. This may not surprise you. Like many other companies, we realize that our current process for evaluating the work of our people ...

  11. Employee performance management

    Managing people Magazine Article. Timothy Butler. James Waldroop. In these days of talent wars, the best way to keep your stars is to know them better than they know themselves—and then use that ...

  12. Performance management that puts people first

    How leading companies approach performance management. Our research across a set of global companies found that despite widespread agreement about certain performance management best practices—such as offering regular feedback outside of an annual review—many companies remain stuck in old ways of working. There are many design choices that ...

  13. Full article: Continuous Performance Feedback: Investigating the

    Performance feedback is one of the most studied practices in the performance management literature, and organizational behavior management (OBM) has significantly contributed to this topic, as performance feedback is among its most researched interventions (Alvero et al., Citation 2001; Balcazar et al., Citation 1985; Sleiman et al., Citation 2020; Tagliabue et al., Citation 2020).

  14. Performance Management Research from Harvard Business School

    Inside One Company's Creative Approach to Staying Productive. by Michael Blanding. Regular absenteeism can hobble output and even bring down a business. But fostering a collaborative culture that brings managers together can help companies weather surges of sick days and no-shows. Research by Jorge Tamayo shows how.

  15. (PDF) A Literature Review and Overview of Performance Management: A

    The research delves into the founding history of performance management and analyzes critical performance management tools. Our findings show that performance management should be seen, managed ...

  16. Performance Management: A Scoping Review of the Literature and an

    Performance management (PM), in all its guises, occurs across all organizations whether formally through an official organizational process or informally through daily dialogue. ... Toward narrowing the research-practice gap in performance appraisal. Personnel Psychology, 38, 335-345. Crossref. ISI. Google Scholar. Biron M., Farndale E., Paauwe ...

  17. Performance management methods and practices among nurses in primary

    Performance management methods and practices among nurses in primary health care settings: a systematic scoping review protocol ... The review of primary research has gained popularity, as evidence-based practices gain recognition as a benchmark for care and primary research sources continue to grow . A scoping review is considered as a ...

  18. The future of feedback: Motivating performance improvement through

    Performance management need not be tied to unearthing the determinants of past performance and holding people to account for past failures. ... peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or ...

  19. Evidence-Based Performance Management: Applying Behavioral Science to

    Abstract. The science of behavior has effectively addressed many areas of social importance, including the performance management of staff working in human-service settings. Evidence-based performance management entails initial preservice training and ongoing staff support. Initial training reflects a critical first training component and is ...

  20. 2% of CHROs Think Their Performance Management System Works

    Two percent of CHROs from Fortune 500 companies Gallup recently surveyed strongly agree that their performance management system inspires their employees to improve. Employees tend to share this ...

  21. Red flags in performance review management

    3 red flags that you're doing performance management wrong. Alexander Puutio maintains that performance management relies on the belief that employee performance can be accurately and ...

  22. (PDF) Performance management

    Performance management seeks to align a. (McKenna and Beech, 2008). Theoretically it involves a shared process between man agers, individuals and teams where goals are agreed and joi ntly reviewed ...

  23. Performance of Medication Tasks: Relationship Among Patient-Reported

    Importance: Occupational therapy practitioners use standardized assessments to guide their clinical decision-making, but it is unclear how well performance on standardized assessments translates to performance at home. Objective: To understand the concurrent and predictive validity of patient-reported outcomes and performance-based assessments for monitoring performance at home within the ...

  24. Academic Performance of Excellence: The Impact of Self-Regulated ...

    This research focuses on the impact of the relationships between self-regulated learning processes and the planning of time management that is dedicated to school activities on student performance, specifically in the subjects of the Mother Tongue and Mathematics.

  25. Optimization of topology and energy management in fuel cell ...

    Current research on energy management strategies (EMSs) often neglects the impact of system topology and local control. This study tackles this issue by optimizing the topology of the hybrid power system on the 'FCS Alsterwasser' cruise ship and enhancing EMS performance using various local controllers. First, the paper outlines the objectives of the research and provides an analysis of ...