1. Introduction
Residential and semi-residential (day-care) facilities play an essential role in caring for the elderly, as they support de-hospitalization and meet the care needs of individuals who are not self-sufficient and/or are affected by complex health issues. In Italy, about 21 in every 1000 elderly individuals reside in nursing homes (NHs), with around 16 out of every 1000 residents being not self-sufficient [
1]. Institutionalization rates increase with age, peaking at 76 per 1000 for those over 85 years old [
1]. The COVID-19 pandemic has underscored the vulnerability of NHs, where the risk of care errors is notably high, leading to adverse effects on quality of life, morbidity, and mortality [
2,
3,
4,
5,
6]. The heightened risk stems from various factors, including residents’ multi-morbidity and multiple therapies and the necessity for interdisciplinary coordination, functional dependency, and cognitive impairment, all of which increase the likelihood of serious consequences from errors [
2,
7]. In addition, the care model of NHs is considerably different from the acute care and outpatient settings, with most of the direct care provided by nurses. Additionally, NHs constitute a real and often permanent living environment for residents, impacting the quality of life and the transmission of diseases [
4]. These factors highlight NHs as a care system with unique safety concerns [
2].
The promotion of patient safety culture (PSC) has become an internationally recognized priority [
8,
9], with extensive research conducted in some healthcare settings like hospitals, while NHs have received less attention. Moreover, empirical studies on PSC in NHs predominantly originate from North American contexts, with a scarcity of evidence from European nations, as emphasized by Gartshore et al. in a 2017 scoping review [
10]. While some studies on PSC in NHs have been undertaken in Norway [
11,
12,
13], further research is needed to identify barriers to safe care delivery and potential areas for enhancement. It is acknowledged that safety culture varies across countries, necessitating tailored evaluations to devise effective interventions [
14,
15,
16,
17].
Measuring PSC remains a contentious issue, given that the core of culture comprises intangible and implicit assumptions [
18]. To address this, ‘safety climate’ (the perceived value placed on safety in an organization at a particular time point) has been proposed as a measurable correlate of safety culture, reflecting tangible characteristics through individuals’ attitudes and perceptions [
19]. In this article, we will use the term ‘culture’ (the values placed on safety and the extent to which people take personal responsibility for safety in an organization).
In recent years, various tools have been developed to measure PSC, with the Nursing Home Survey on Patient Safety Culture (NHSPSC) being recommended at the European level [
20]. This questionnaire, developed by the Agency for Healthcare Research and Quality (AHRQ), has demonstrated good psychometric properties across different countries [
21,
22,
23,
24], though its validation in Italian had not been conducted yet.
Despite the usefulness of safety climate questionnaires in pinpointing areas for improvement, safety culture is multidimensional and influenced by staff culture, beliefs, values, and attitudes [
25]. Understanding the predictive factors’ interplay and their relative impacts on safety assessments is vital for prioritizing corrective interventions [
26]. The study hypothesis is that each dimension of PSC can have a different influence on the formation of the overall judgment and overall perception of safety in the NH. Establishing the actual weight of each dimension in predicting patient safety is crucial for determining priority in implementing corrective interventions.
The aims of this study are:
To describe PSC in the NH setting within a northern Italian region;
To explore the factors influencing overall safety perceptions and identify their respective contributions to subjective judgments of safety.
3. Results
Out of the 1224 received questionnaires, 144 were deemed incomplete or lacked information pertinent to the present study’s outcome and were therefore excluded. Consequently, the analysis encompassed a sample of 1080 questionnaires (44% of those distributed), with response rates ranging from 18% to 82% across the 25 NHs. The characteristics of respondents are detailed in
Table 1.
Mean scores for the 12 PSC dimensions are presented in
Table 2. The distribution of PPA and PNA for each survey item and dimension can be found in
Appendix A (refer to
Table A1). The four dimensions with the highest mean scores (i.e., Feedback and Communication about mistakes, Handoffs, Overall Perceptions, and Supervisor Expectations and Actions Promoting Resident Safety, RS) attained mean scores ranging from 3.8 to 4, with PPAs between 68% and 76%. Conversely, the three dimensions with the lowest mean scores (Staffing, Non-punitive response to mistakes, and Management Support for RS) achieved values between 3 and 3.2, with PPAs ranging from 37.7% to 43%. Notably, for these three dimensions, 16 out of 25 NHs (64%), 12 out of 25 (48%), and 11 out of 25 (44%) attained mean scores equal to or less than 3 (further details can be found in
Table A3 of the
Appendix A).
Regarding the overall safety assessment collected in
Section 2, 74.3% of respondents indicated they would tell friends that their NH is safe for their family (E1). The mean value of the overall rating (‘Please give this nursing home an overall rating on resident safety’—E2) was 3.3. Specifically, 42% of respondents rated the level as ‘Very Good/Excellent’, 38% as ‘Good’, and 20% as ‘Fair/Poor’.
The variance in scores between NHs was moderate across all dimensions (ICC range: 0.11–0.20; refer to
Table 2), indicating the presence of heterogeneity among facilities. The dimension Management Support for Resident Safety exhibited the highest ICC value (ICC = 0.20), suggesting that NH characteristics can account for 20% of its variability. Overall, the contextual effect was significant (ICC > 0.05; the confidence intervals, in the last column, estimate the presence of a contextual effect in each dimension), supporting the decision to employ a multilevel approach in subsequent analyses. A detailed description of the results of the surveys on PSC, stratified by NH, is provided in
Table A3.
Table 3 presents the results of the exploratory correlation analysis, disaggregated within NHs (above the diagonal) and between NHs (below the diagonal) to differentiate individual- and facility-level correlations. All 12 dimensions and the Overall rating E2 were considered. The between-NH coefficients among the 12 dimensions exhibited high values ranging from 0.61 (between Management Support for RS and Compliance with procedures) to 0.94 (between Supervisor Expectations and Actions Promoting RS and Feedback and Communication); the consistency among these measures supports the multidimensional nature of safety culture. The correlation coefficients between the Overall rating E2 and the 12 dimensions between NH (last row of
Table 3) varied between 0.077 and 0.318, indicating only moderate relationships. In the
Appendix A, the frequency distribution of Overall rating (E2) and the dimension Overall perceptions of resident safety (Dimension 10) is further explored (
Figure A1). The score distribution revealed a tendency towards higher values of the Overall perceptions dimension across all scale points. This result was confirmed with the intra-rater approach with paired data; the value of weighted Cohen’s kappa is 0.31 (95% CI: 0.28–0.34), indicating a low or fair agreement between measures by following Cohen’s suggestions [
32].
Regarding the second aim,
Figure 1 illustrates the heterogeneity of the Overall rating among NHs.
Table 4 presents the results of the multilevel final model and dominance analysis: seven dimensions significantly impacted the composition of the overall rating, accounting for the years of work experience of respondents, which emerged as the only covariate. The most influential factors affecting the overall judgment were Organizational Learning, Management Support for RS, and Supervisor expectations and actions promoting RS. The standardized dominance weighs ranged from 0.16 to 0.12, indicating a moderate differential impact.
4. Discussion
In this cross-sectional study involving more than 1000 nursing NH providers, we aimed to highlight the safety perspectives of NH staff in Italy. The size of the sample, which represents almost half of all NHs in the study area, along with the satisfactory overall response rate, facilitated a valid portrayal of PSC among NH staff and identified areas for improvement within the NH setting.
The distribution of scores across dimensions exhibited heterogeneity, with a moderate portion of the variation (approximately between 10% and 20%) attributable to the facility level (i.e., affiliation with a specific NH). The observed heterogeneity between NHs suggests the need for strictly shared safety standards able to align expectations regarding safety behaviors. Moreover, the within and between correlations among dimensions suggest that individual factors beyond the facility level may also influence assessments. Indeed, the presence of safety subcultures within institutions is a well-documented phenomenon, although it has not been extensively studied in NHs, especially within the European region [
10,
11,
12,
13]. From a recent study conducted by our group, the presence of subcultures in Italian NHs appears to be associated with professional roles, as well as with overarching work-related factors such as seniority, working hours, shifts, and area of activity [
29].
To prevent the development of subcultures and achieve successful clinical governance, alignment of leadership with workers is crucial [
33,
34,
35]. Specifically, the support provided to safety culture via management is essential to consistently influence workers’ perception of safety and overall satisfaction [
36]. These observations are corroborated in our study by data from the dominance analysis, which emphasized how the three dimensions that most significantly affect overall judgment (Management Support for RS, Organizational Learning, and Supervisor Expectations and Actions Promoting RS) are all related to leadership.
From the responses to the individual items of Management Support for RS, a perception of management distance from frontline workers emerges, characterized by unsatisfactory receptivity to ideas and suggestions (“Management asks staff how the nursing home can improve resident safety” and “Management listens to staff ideas and suggestions to improve resident safety”) and inadequate implementation of safety walk rounds (“Management often walks around the nursing home to check on resident care”). The high percentage of neutral responses in this dimension (ranging from 16.5% to 39%) supports the perception of hierarchical structures. Moreover, one out of four respondents indicated that management was not actively involved in decisions on how to improve resident safety. As previously noted, managers play a pivotal role in strengthening adaptive capacity within organizations, particularly when they are receptive to new perspectives and foster bottom-up initiatives [
13,
37]. Involving staff through a bottom-up approach has also been identified as a valuable strategy for ensuring resilient performance in addressing the challenges posed by the COVID-19 pandemic, as evidenced in a study by Ree et al. from 2022 [
38]. Furthermore, safety walk rounds are an important and practical tool for enhancing PS within an institution [
39]. However, to effectively implement them, it is imperative to proactively cultivate a safety culture to prevent them from being perceived as control measures, particularly in contexts where a punitive culture prevails.
The score for Organizational Learning was not entirely satisfactory, with suboptimal results observed for three out of four items. Specifically, difficulties emerged in implementing changes to improve patient safety (“It is easy to make changes to improve resident safety in this nursing home”). This result somewhat contradicts the positive assessment given to actions taken to improve safety (“This nursing home is always doing things to improve resident safety”), suggesting that despite some proactivity in certain contexts, actions do not seem to yield the perception of change. Ambiguity also arose from the results regarding the ability to learn from adverse events when they occur (“This nursing home lets the same mistakes happen again and again”—negatively worded item). The results on feedback and communication about incidents were satisfactory, indicating that if anything is lacking, it may be the ability to learn from errors.
To enhance the overall perception of safety, management should focus efforts on promoting a climate that facilitates changes and actions for the improvement of safety, as well as monitoring the results of these actions. Additionally, the process of learning from past errors should be promoted from a supervisor/management level so that personnel can perceive that care and attention are allocated to the prevention of adverse events. Organizational learning encourages the dissemination of best practices and evidence-based guidelines throughout the healthcare system, ensuring that lessons learned from past incidents are integrated into future practices. By prioritizing organizational learning, healthcare institutions can proactively mitigate risks, improve care processes, and ultimately enhance patient outcomes, thereby fostering a safer and more reliable healthcare environment [
37].
The results concerning Supervisor Expectations and Actions Promoting RS underscore the significance of open communication in bolstering overall safety perceptions. Indeed, all items within the dimension are associated with transparent communication with staff and attentiveness to staff’s work and suggestions. By fostering transparency, trust, collaboration, and shared decision-making, open communication not only mitigates the risk of medical errors but also enhances the overall quality of care [
40]. Managers and supervisors must prioritize cultivating a culture of open communication where all stakeholders feel empowered to voice concerns, share information, and collaborate towards the common goal of providing safe and effective care to every patient.
The findings of the descriptive analysis unveiled notable discrepancies in evaluations across dimensions, particularly regarding Staffing, Non-punitive response to mistakes, and the previously discussed Management Support for RS. In fact, nearly half or more than half of the nursing homes recorded scores equal to or below 3 for these dimensions. At the individual level, the three dimensions attained PPAs around 40%, falling well below the satisfactory threshold of 60%, underscoring a pressing need for improvement. Similar outcomes were observed in prior studies [
11,
12,
13] and are consistent with data from the 2019 AHRQ database, which provides benchmarking data from AHRQ survey users [
41]. With the exception of Management Support for RS (66% PPA in the AHRQ database compared to 43% in our sample), the dimensions Staffing and Non-punitive response to mistakes exhibited the lowest scores, mirroring trends among the 191 nursing homes included in the AHRQ database. Specifically, Staffing emerged as the most critical area in our sample and demonstrated a comparable average PPA with the AHRQ database (i.e., 37.7% vs. 42%, respectively). For Non-punitive response to mistakes, the disparity between our sample and the reference database was more pronounced (i.e., 38.8% vs. 54%). It is noteworthy that the three dimensions with the highest scores in our sample (feedback and communication about incidents, Supervisor expectations and actions promoting RS, and Overall perceptions of RS) coincided with those scoring highest in the AHRQ database.
Regarding the Staffing dimension, the dominance analysis underscored its significance in shaping the final perception of safety. It is reasonable to assume that insufficient staffing levels and high turnover contribute to heavy workloads and difficulties in ensuring adequate patient safety, as indicated by low scores for items such as “We have enough staff to handle the workload”, “Staff have to hurry because they have too much work to do”, and “It is hard to keep residents safe here because so many staff quit their jobs”. Additionally, the notable percentage of neutral and missing responses for individual items is noteworthy. While these responses may genuinely reflect a lack of clear opinion, they may also signify a reluctance to express negative perspectives. The literature highlights how high turnover is a prevalent issue in long-term care settings [
42,
43,
44]. Turnover rates serve as useful indicators of NH quality and necessitate regular assessment and analysis to identify potential issues and provide necessary improvements [
45].
Indeed, evidence suggests that high turnover may result in several adverse consequences for NH residents, such as an increased occurrence of physical restraint [
45]. Moreover, it is likely that high turnover rates lead to a greater reliance on shortcuts during procedures, potentially compromising infection prevention and control, as evidenced during the COVID-19 pandemic [
46]. Our results partially support this hypothesis, as the two items regarding compliance with procedures (“Staff use shortcuts to get their work done faster” and “To make work easier, staff often ignore procedures”) garnered notable percentages of negative answers (respectively, 1 out of 4 and 1 out of 5 respondents agreed with these statements). Inadequate staffing may also have a detrimental impact on staff well-being, resulting in work overload and burnout [
47,
48]. Burnout, in turn, can affect both RS and the quality of care, creating a concerning cycle that underscores the importance of monitoring this indicator.
Regarding the Non-punitive response to mistakes dimension, the results highlighted the prevalence of a punitive safety culture among operators. To explain the deviation from the AHRQ database, we hypothesize that this is a particularly critical area in the Italian context. In general, an effective error-response mechanism necessitates that operators be adequately prepared to report mistakes, a responsibility that should be shouldered by management through _targeted training and continuous feedback. Providing feedback is a crucial aspect of fostering a positive PSC. A study by Zwijnenberg et al. delved into healthcare professionals’ perspectives on feedback from a PSC assessment [
49]. The vast majority (84%) of respondents indicated that feedback partly or wholly stimulated actions to improve PSC, enabling staff to navigate the learning process through the mistakes themselves.
Specifically, regarding the Italian setting, a study by Tereanu et al. explored PSC in Italian territorial prevention facilities in Northern Italy [
50]. The Non-punitive response to mistakes dimension scored a 39.5% PPA (38% among nurses and nurse aides) and ranked second lowest after Teamwork across units. The study also compared 10 composite measures with results from hospital settings (Italy and the US), health districts (Spain), and primary healthcare settings (Iran, Turkey). Italian hospitals scored lower (35%) than Italian territorial prevention facilities, which, in turn, scored lower than US hospitals (44%). Additionally, the study sample scored lower than the health district in Spain (42%). Overall, data from Italian settings indicate a generally low and less-developed safety culture in territorial facilities compared to hospitals, characterized by a persistent blame culture and under-reporting of incidents [
51].
We also observed that staff expressed the need for more training (“Staff have enough training on how to handle difficult residents”), while simultaneously perceiving difficulties in implementing changes. This indicates the necessity of providing practical training through improvement projects that involve collaboration between staff and management to effectively introduce changes. However, despite the survey results, the dominance analysis indicates that this dimension does not significantly influence the overall perception of safety.
Furthermore, although the scores for some dimensions were not entirely positive, the Overall Perception of Resident Safety (dimension 10) achieved a satisfactory PPA of 76.4%, and the Global assessment section also showed positive scores. Moreover, the correlation between the twelve dimensions and the Overall rating (E2) was only moderate. These unexpected results suggest that item E2 provides additional information compared to that of individual dimensions, prompting reflections on the process of judgment generation by staff regarding their own NH. When tasked with assessing specific safety aspects, staff seem capable of identifying limitations. However, there appears to be a lack of ability to recognize these limitations as important threats to overall safety. Promoting an appropriate “preoccupation with failure”, an essential element of a high-reliability organization, is crucial for improving safety culture. In this regard, sharing the results of the discrepancy between the scores of individual dimensions and the overall rating can help enhance this awareness.
In terms of actionable strategies that can be planned for implementing improvements, suggestions can be found in a practical guideline for PSC improvement promoted by the English NHS. The tool provides a comprehensive ‘toolkit’ to understand how to craft, create, and nurture a positive safety culture and offers a theoretical foundation for how to shift the culture. Among the key elements supporting a positive PSC are leadership, teamwork, communication, and organizational development [
52]. A recent review by Taji et al. indicates that strategies for improving PSC in the hospital setting can be categorized into educational, simulation, team strategies, and comprehensive programs [
53]. The review emphasizes that all types of strategies have a positive influence on PSC. Another recent review on strategies for improving PSC conducted by Mistri et al. highlights how education and training of healthcare professionals are crucial for strengthening systems and provides the descriptions of specific actions of improvement [
54].
Strengths and Limitations
This study is part of the first attempt to assess PSC in the NH setting in Italy. It should be noted that this study was conducted on a single Italian region and on a limited number of NHs, and therefore the results may not be fully representative of the entire long-term care setting in Italy. The 25 NHs included in this study constituted a convenience sample, which could introduce potential research bias. The significant variation in the response rate of individual NHs may conceal additional biases related to the specific characteristics of the NH. Data were self-reported and possibly subject to social desirability biases. We have, however, limited the collection of socio-demographic information, which could influence the tendency to provide answers that are considered ‘desirable’.
Additionally, the benchmarking comparison was performed using data from the AHRQ database, which primarily consists of information from North American NHs. Nevertheless, a notable strength of this study lies in the validation of the NHSPSC in Italian, providing a standardized tool for comparisons with other Italian settings, thereby enhancing the utility of benchmarking analyses.
In summary, this study serves as a foundational step for further exploration of PSC in the Italian NH context, through the development of a multi-centric study. Particularly, given the presumed association between PSC and actual safe care, further research is warranted to quantify this association with specific outcomes (such as falls, development of pressure ulcers, medication errors, adverse drug events, unplanned transfers to the hospital, etc.) within the country-specific NH context. Future research developments include the realization of a longitudinal study that could provide better insights into how improvements in management practices and organizational culture can influence PSC over time.