How Hospital Quality Ratings Are Determined and How to Use Them

Hospital quality ratings translate complex clinical performance data into structured scores that patients, payers, and policymakers can compare across facilities. Multiple federal agencies and independent organizations produce these ratings using distinct methodologies, measurement sets, and weighting schemes — meaning a single hospital may receive different ratings from different sources. Understanding how each rating system is constructed, what it measures, and where its limitations lie is essential for interpreting any score accurately.

Definition and scope

Hospital quality ratings are standardized assessments that rank or score inpatient facilities on dimensions including patient safety, clinical outcomes, process-of-care adherence, patient experience, and operational efficiency. The ratings are produced under several distinct regulatory and research frameworks, each with its own statutory basis and methodology.

The Centers for Medicare & Medicaid Services (CMS) operates the most widely referenced federal rating system through Hospital Compare, now integrated into the Care Compare platform. CMS publishes an Overall Hospital Quality Star Rating — a composite score on a 1-to-5 star scale — derived from measures grouped into 5 domains: Mortality, Safety of Care, Readmission, Patient Experience, and Timely and Effective Care. Each domain is weighted differently; as of the 2021 methodology update documented by CMS, Mortality carries the highest weight at approximately 22%, while Timely and Effective Care carries approximately 4% (CMS Overall Hospital Quality Star Rating Methodology, July 2021).

The Agency for Healthcare Research and Quality (AHRQ) administers the Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey, which supplies patient experience data feeding into CMS star ratings. AHRQ's Patient Safety Indicators (PSIs) — a set of 18 hospital-level metrics — also contribute to safety-of-care domain scores (AHRQ PSI Technical Specifications).

Independent ratings include the Leapfrog Group's Hospital Safety Grade, which assigns A through F letter grades based on 32 performance measures focused on preventable harm. The U.S. News & World Report Best Hospitals rankings use a separate scoring model that weights outcomes data at 37.5% of the total score for most specialties. These independent systems are not governed by federal statute but draw heavily on CMS-reported data.

For patients navigating provider choices, resources such as Healthcare Provider Types and Specialist Referral Process provide context on how facility ratings intersect with provider-level credentialing.

How it works

CMS constructs its Overall Star Rating through a four-phase methodology:

Measure calculation — CMS calculates individual performance measures from Medicare claims data and hospital-reported data submitted via the CMS Quality Reporting programs. Hospitals must meet minimum case-volume thresholds (typically 25 cases per measure) to be scored on any individual metric.
Domain scoring — Individual measures are standardized and averaged within their assigned domain. A hospital must have at least 3 scored measures across at least 3 of the 5 domains to receive an Overall Star Rating.
Peer grouping — Hospitals are clustered into peer groups based on the number of domains for which they have sufficient data (3-domain, 4-domain, or 5-domain groups), then rated within their group rather than against the full national pool.
Star assignment — A latent variable model is applied within each peer group to assign 1-to-5 star ratings, calibrated so that the distribution of stars approximates a roughly normal spread within each cluster.

The Leapfrog Hospital Safety Grade uses a different structure: 32 measures are divided into Process and Structural measures (e.g., ICU physician staffing, bar-code medication administration) and Outcome measures (e.g., infections, falls, injuries). Leapfrog weights outcome measures more heavily in the composite score. Grades are updated twice per year, in spring and fall.

Contrast between CMS stars and Leapfrog grades: CMS stars capture broad performance across 5 clinical domains with heavy emphasis on mortality and readmissions. Leapfrog grades focus narrowly on preventable harm and patient safety infrastructure, making them more sensitive to safety-specific failures that may not move a CMS composite score significantly.

Understanding how quality data connects to coverage decisions is addressed in In-Network vs Out-of-Network Providers and Prior Authorization Process.

Common scenarios

Scheduled elective surgery — For procedures where patients have lead time, CMS star ratings provide a broad quality signal, while Leapfrog grades and AHRQ PSI data offer more granular safety data. A hospital with 4 CMS stars but a Leapfrog C grade signals a divergence worth examining — often reflecting strong outcome scores (which dominate the CMS model) alongside weaker structural safety practices.

Emergency or unplanned admission — Facility choice is constrained by geography and urgency. Rating data remains relevant for post-admission decisions such as transfer requests. The Healthcare Complaint and Grievance Process provides a framework if care quality concerns arise during a stay.

Chronic condition management — For patients with conditions requiring repeated hospitalization, readmission rates (one of the 5 CMS domains) are a particularly relevant sub-measure. Domain-level data is publicly downloadable from the CMS Care Compare platform, allowing comparison at the subdomain level rather than relying solely on the composite star.

Pediatric or specialty care — CMS star ratings cover general acute care hospitals. Specialty hospitals, children's hospitals, and critical access hospitals are excluded from the Overall Star Rating methodology. U.S. News specialty rankings and the Leapfrog Children's Hospital Survey cover some of these gaps.

Decision boundaries

Hospital quality ratings carry structural limitations that define where they apply and where they do not:

Volume thresholds exclude small hospitals. Critical access hospitals (those designated under 42 U.S.C. § 1395i-4) and low-volume facilities frequently lack sufficient case counts to generate star ratings, creating coverage gaps in rural areas. The Rural Health Services Access page addresses facility availability in these settings.
Composite scores mask domain-level variation. A 3-star hospital may score in the top decile for safety but poorly on readmissions; the composite obscures this. CMS publishes domain-level scores separately on Care Compare for this reason.
Ratings lag clinical reality. CMS star ratings are updated annually using claims data that may be 12 to 24 months old at the time of publication, meaning a hospital undergoing rapid operational change — positive or negative — may not reflect that change in its current score.
Independent ratings are not regulated. Leapfrog, U.S. News, and similar private ratings are not subject to CMS oversight or federal audit. Their methodologies can change without regulatory review.
Patient experience scores measure perception, not clinical process. CAHPS-derived scores, which feed the Patient Experience domain, reflect reported satisfaction rather than adherence to clinical protocols. A high patient experience score does not confirm that a hospital follows evidence-based care guidelines for a given procedure.

Patients reviewing rating data alongside considerations such as Second Opinion in Medical Care or Care Coordination and Case Management gain a more complete operational picture of a facility's performance profile.

References

📜 1 regulatory citation referenced · 🔍 Monitored by ANA Regulatory Watch · View update log

Explore This Site

Regulations & Safety Regulatory References Tools & Calculators Bmi Health Metrics Calculator