As AI continues to reshape the operations of hospitals, health systems, and payers, leaders are increasingly seeking ways to determine the viability and premium returns of AI-driven initiatives. More often than not, these organizations rely on benchmarking methods—comparing performance metrics to industry standards or peer institutions—to assess new technologies, with a focus on elevating performance and achieving operational results.
Executing against traditional operating measures and data-driven benchmarks is fundamentally time-based and is increasingly limiting in this new era of technology. To achieve more sustainable performance and compounding returns, leaders should evaluate AI use cases against the viability and feasibility of the experiences they hope to create.
A majority of healthcare organizations are using some form of AI across their operations in their daily operations, mostly in back-office and administration functional use cases. Seventy-eight percent of organizations have already implemented or are currently implementing AI into workflows, according to a Guidehouse-HIMSS survey. Whether the investment is for automation or augmentation, benchmarking for the purpose of qualifying investment decisions is typically based on quantitative metrics associated with performance controls across cost, efficiency, quality, and safety. While valuable for identifying gaps and setting improvement goals, benchmarking has notable limitations when applied to assessing AI use cases:
Healthcare organizations that shift to an experience-centric approach are establishing the foundation for the long-term, compounding returns of AI investments and defining the optimal future scenarios for all stakeholders involved: patients, clinicians, administrators, and the broader community. For instance, an AI tool that detects lung nodules in radiology images would typically be evaluated on how precisely it identifies abnormalities and how quickly it processes scans. While these metrics validate performance, they fall short of capturing real-world impact.
Tomorrow’s measurement framework must go further, focusing on outcomes that matter: Did earlier detection improve survival rates? Did the tool reduce downstream costs by avoiding late-stage treatments? Was clinician confidence enhanced, and did it alleviate burnout? Did the application advance equity by improving care for diverse populations? By shifting from algorithm-centric KPIs to patient-centric and system-level metrics, healthcare can validate that AI delivers value that is truly fit for purpose. As a forcing function, this will drive the evolution and maturation of the metrics required to effectively capture performance.
This vision-driven approach starts by determining the experience of AI, versus only planning for the quantitative impacts of implementing AI as a performance accelerator, with a focus on:
When determining what AI investments to make, healthcare organizations should start with the target state experience to yield higher returns—both financial and non-financial—compared to standard benchmarking for several reasons:
When compared to AI investment approaches that evaluate AI use cases against benchmarks and either new or existing technology applications, organizations that embrace the value of human and technology intervention are better positioned to be “Market Setters” (see Figure 1).
.png)
Figure 1: AI Investment Identity Spectrum
To adopt a target-state experience approach, healthcare organizations should:
While benchmarking remains a useful tool for continuous improvement, traditional metrics are insufficient for guiding the transformative potential of AI in healthcare. By starting with target-state experiences, healthcare organizations can qualify that their investments in AI are strategic, value-accretive, and truly aligned with the needs of those they serve. This approach not only delivers greater returns but also fosters a culture of innovation and excellence that will define the future of healthcare.
Guidehouse is a global AI-led professional services firm delivering advisory, technology, and managed services to the commercial and government sectors. With an integrated business technology approach, Guidehouse drives efficiency and resilience in the healthcare, financial services, energy, infrastructure, and national security markets.