Designing and Psychometric Evaluation of a Questionnaire for Assessing Society's Perception of Flash Flood Risk

authors:

avatar Aziz Rahimizadeh 1 , avatar Saeed Fallah-Aliabadi ORCID 1 , * , avatar Aliakbar Vaezi 2 , avatar Ahad Heydari 3

Department of Health in Emergencies and Disasters, School of Public Health, Shahid Sadoughi University of Medical Sciences, Yazd, Iran
School of Nursing and Midwifery, Research Center for Nursing and Midwifery Care in Family Health, Shahid Sadughi University of Medical Science, Yazd, Iran
Department of Health in Disaster and Emergencies, School of Medicine, Kurdistan University of Medical Sciences, Sanandaj, Iran

how to cite: Rahimizadeh A, Fallah-Aliabadi S, Vaezi A, Heydari A. Designing and Psychometric Evaluation of a Questionnaire for Assessing Society's Perception of Flash Flood Risk. Health Scope. 2024;13(2):e146111. https://doi.org/10.5812/healthscope-146111.

Abstract

Background:

Public perception of risks associated with natural disasters like flash floods significantly influences disaster management effectiveness. Flash floods pose a major threat to life and property, and a lack of tools to evaluate societal risk perception creates a critical gap.

Objectives:

This study aimed to design and evaluate the psychometric properties of a questionnaire specifically assessing society's perception of flash flood risk.

Methods:

A two-stage approach was employed. The first stage involved collecting questionnaire items through a systematic literature review and a qualitative study. In the second stage, a comprehensive psychometric evaluation was conducted, including assessments of face validity, content validity, and construct validity. Reliability was established using Cronbach's alpha. Confirmatory factor analysis was further conducted with data collected from 136 community members who had experienced flash floods. Data analysis was performed using SPSS version 20 and AMOS software.

Results:

A combination of qualitative data and systematic review findings facilitated the development of 36 initial questionnaire items. Applying quantitative and qualitative construct validity measures led to the refinement of the instrument, resulting in 29 final items categorized into three domains: Risk perception (12 items), awareness (10 items), and preparedness (7 items). The internal consistency of the instrument was confirmed by a Cronbach's alpha coefficient of 0.88. Factor analysis further supported the good fit of the hypothesized model to the data.

Conclusions:

This study successfully developed and rigorously evaluated a questionnaire to assess society's perception of flash flood risk. This instrument offers valuable insights for informed decision-making and identification of factors influencing risk perception, ultimately contributing to improved disaster preparedness and management.

1. Background

Floods, as a natural occurrence, can have serious effects on people and communities. Every year, many people die due to natural disasters like floods, and many others suffer physical and material injuries (1). Additionally, floods can result in the loss of homes and jobs, causing both material and psychological harm to affected individuals (2). Flash floods, which occur rapidly and cause extensive harm, are usually associated with short, high-intensity rainfall and impact local areas. They typically affect watersheds of less than 1 000 km2 and have response times of a few hours or less. Iran, situated in the geographical path of the Alpine-Himalayan orogeny belt, has a varied climate and has historically experienced natural disasters such as flash floods (3).

Identifying high-risk areas and preparing for disasters like flash floods requires thorough knowledge and preparation (4). Many governments have developed contingency plans for events such as flash floods to minimize potential damage. Additionally, societal preparedness is crucial, as adequate knowledge and understanding of the risks can reduce potential damage and aid in planning and managing flash floods (5). However, without community support, even well-prepared organizations can fail in their disaster response efforts. Therefore, understanding how society perceives natural disasters like flash floods is essential for advancing national and local programs and leveraging the power of societal involvement in disaster management (6).

On the other hand, self-perception in social issues is important from the point of view that it helps people in society become aware of their own attitudes towards phenomena such as unknown feelings by observing their behavior (7).

Given that natural disasters such as floods occur annually in many disaster-prone countries, including Iran, it's vital for the government and responsible organizations to understand the increasing frequency of flash floods and the low-risk perception of society regarding this issue (8). Therefore, accurately gauging how people perceive floods is crucial for enhancing flood risk management, ensuring that appropriate and effective measures are taken to mitigate flood risks (9, 10). Various studies have been conducted to evaluate people's attitudes towards floods, using questionnaires or location-related software.

However, there is a limited number of tools available to evaluate society's perception of flash flood risk, and the present study aims to fill this gap by providing a new tool specifically tailored to evaluate the perception of flash flood risk in Iran (11-14).

2. Objectives

Due to the lack of reliable tools in Iran to measure societal self-perception regarding flash floods, this study aimed to validate and analyze the psychometric features and applicability of a questionnaire on flash flood risk perception in Iran.

3. Methods

The study comprised the design and psychometric evaluation of a questionnaire on society's perception of the risk of flash floods. The first phase involved a systematic review and qualitative studies to extract items of the initial tool. In the second phase, a quantitative approach was adopted for psychometric assessment.

3.1. First Phase: Item Generation

In the initial stage, a systematic review of available studies related to flash flood risk perception was conducted. Web of Science, Scopus, PubMed, and Google Scholar databases were searched to find studies using the keywords "risk perception," "flash flood," "sudden flood," and "dam break" until September 2023. Specific inclusion and exclusion criteria were established for selecting relevant articles on flash flood risk perception. Inclusion criteria encompassed research articles and theses in English focusing on this topic, while exclusion criteria included studies in languages other than English and Persian, those not directly addressing flash floods, letters to the editor, and conference abstracts. The screening process involved eliminating duplicates using EndNote software and independently reviewing titles, abstracts, and full texts by two authors to ensure alignment with the criteria. Data extraction utilized a standardized form to record essential details such as author information, publication year, research methods, sample demographics, and key findings. Quality evaluation of studies was conducted using the Joanna Briggs Institute (JBI) critical appraisal checklist, assessing elements like study objectives, sample size, participant characteristics, statistical analysis, and result congruence. Discrepancies were resolved through discussion and, if necessary, consultation with a third researcher. Studies meeting predefined criteria were included in the final review compilation. The selection process involved sequentially reading titles, abstracts, and full texts of studies, resulting in the identification of 25 relevant articles out of 1025 titles. Most of these articles utilized cross-sectional descriptive studies to assess residents' risk perception in the relevant areas.

To ensure comprehensive item coverage and to identify Iranian context-based items, a qualitative content analysis was conducted. Through content analysis, codes were extracted from interviews with the target group, meticulously examining interview content to identify patterns, important topics, and differing perspectives. In the qualitative study, 23 residents of Bakhtegan city, Fars province, Iran, were interviewed from December 2022 to February. People living in the city who had experienced flash floods and volunteered to participate in the study, and at the same time had information about flash floods, were included in the study using purposive sampling method. The main question included "Please describe your flash flood experience," and the interview was continued based on the participants' answers with probing questions. The duration of each interview varied from 30 to 55 minutes. Data collection employed the Graneheim and Lundman approach, and data categorization was carried out using MAXQDA 18 software. Trustworthiness was ensured through Guba and Lincoln criteria, including researcher rapport, data diversity, continuous comparison, and participant validation of findings (15). Detailed documentation of analysis stages and participant feedback enhanced validity and reliability. Detailed contextual descriptions aimed to increase the transferability of findings.

The study extracted factors such as environmental variables (residential location, proximity to the river), economic and social variables (education level, income, marital status, family size), knowledge, trust in the media and aid organizations, and flood experience. Subsequently, the initial questionnaire was designed using items derived from both qualitative methods and systematic review. By scrutinizing and eliminating redundant items from the two extraction methods, a total of 36 items were confirmed for inclusion in the designed questionnaire, encompassing both objective and subjective factors influencing risk perception.

3.2. Second Phase: Psychometric Evaluation of the Questionnaire

The second phase of this study involved the psychometric evaluation of the risk perception questionnaire for flash floods, including testing its validity and reliability, encompassing face validity, content validity, and construct validity (16).

Face validity assesses whether the questionnaire appears valid to subjects, patients, or observers, a criterion that can often be enhanced through appropriate wording alterations (17). To ensure face validity in this study, 10 experts including Ph.D. students, researchers, and subjective experts were asked to comment on the questionnaire's ease of completion, grammar and spelling, writing clarity, and appropriateness. They rated each item on a 5-level scale, and items with an impact score of one and a half or higher were retained (18).

Content validity was evaluated qualitatively and quantitatively. Thirteen experts were asked to provide detailed corrective feedback after studying the questionnaire, drawing from their expertise in disaster health, crisis management, and health education and promotion. Quantitative content validity entailed assessing the importance and appropriateness of the selected content. Content validity ratio (CVR) and Content Validity Index (CVI) were computed to ensure the selection of critical content and the appropriate design of measurement items. The numerical values of CVR were determined using a predefined table, and items scoring higher than 0.59 were considered significant and retained. For CVI, simplicity, relevance, and clarity were evaluated on a Likert Scale, and items with a resulting value exceeding 0.79 were deemed acceptable (19).

Regarding reliability, internal consistency was assessed using Cronbach's alpha coefficient for the entire questionnaire (20). At this stage, all residents of Bakhtegan city were eligible to participate in the study, regardless of whether they were directly exposed to flash floods or not.

Before conducting confirmatory factor analysis, assumptions of univariate normality, estimates of squared values, multivariate normal deviation, and outliers were evaluated using the Mahalanobis distance method. Missing data were handled using the maximum likelihood method. Subsequently, common dispersion between observed variables was examined to confirm linearity and address multicollinearity, enabling the use of parametric tests for confirmatory factor analysis.

4. Results

Quantitative validation of the risk perception measurement tool was conducted on 36 items. Minor corrections were made based on the participants' comments in the face validity stage in the wording and grammar of some items. The Impact Score results indicated that 35 questions scored equal to or greater than 1.5, prompting a check of CVI and CVR for these questions. Following review by thirteen panelists, questions with a CVR lower than 0.42 and a CVI lower than 0.79 were excluded. Consequently, after recalculating CVI and CVR for all questions, 6 items were removed, resulting in respective scores of 0.65 for CVI and 0.88 for CVR for the entire questionnaire.

Subsequently, 29 questions were confirmed, and internal reliability analysis indicated a satisfactory Cronbach's alpha coefficient of 0.89, signifying adequate internal stability of the questionnaire.

One hundred and fifty questionnaires were distributed to residents of Bakhtegan city, Fars’s province, Iran, yielding a 90.1% response rate. Participants responded to questions on a 5-point Likert Scale from completely agree to completely disagree. The study's Mean participant age was 35.23 years, with a mean work experience of 9.82 years. Of the participants, 57.4% were male and 42.6% were female. Distribution among educational levels showed that 25% had less than a diploma, 17.6% had a diploma, 29.4% had a bachelor's degree, and 17.6% had a master's degree or higher.

The mean question response scores and standard deviations for each question are presented in Table 1. The goodness-of-fit indices for the confirmatory factor analysis are detailed in Table 2, confirming the assumed model's strong fit with the observed data. Furthermore, the general model of the risk perception questionnaire, illustrating the relationships between items and their respective structures, is depicted in Figure 1.

Table 1.

Descriptive Indices of Final Items

VariablesItemsAverageStandard DeviationSkewnessKurtosis
Awareness 1I pay attention to the warnings issued about the possibility of flash floods.1.290.51.841.87
2I am aware of the life and financial consequences of flash floods.1.430.560.88- 0.2
3Having accident insurance has not made me careless about flood risks.1.790.911.270.95
4I am aware of how to take measures to reduce flood damage.1.830.910.920.4
5A flood can affect my life.1.680.941.360.87
6A flood can harm me materially.1.991.11.110.67
7My physical condition does not make me vulnerable to hazards.1.710.91.440.98
8The area where I live is vulnerable to flooding.1.960.941.650.92
9Considering my economic situation, I am worried about the consequences of the flood.1.710.811.291.81
10The presence of deterrent laws reduces my concern about the consequences of flooding.1.960.841.801.95
Preparation 1My previous experience with flash floods has increased my caution.1.751.261.381.46
2I have the ability to adapt to the conditions caused by the flood.1.591.241.71.99
3I take seriously the warnings issued regarding the possibility of flooding.1.640.871.030.95
4I secure my place of residence before heavy rains.1.740.991.211.45
5I warn my family members and people around me before the flood.1.960.771.10.66
6I follow flood safety recommendations.1.610.71.41.23
7The methods of receiving flood warning messages are effective in taking preventive measures against floods.1.941.170.81.3
Perception of risk1Seeing the deaths and injuries of people exposed to flash floods makes me more careful when flash floods occur.1.640.761.30.33
2I trust flash flood warning sources.1.570.971.341.17
3I trust the high accuracy of weather forecasts.1.501.121.31.8
4I feel threatened by the flood.1.781.11.1- 0.029
5I believe in preventive measures.1.631.141.14- 0.11
6Preventive behaviors reduce harm to me and my family.1.931.11.10.8
7My preventive behaviors reduce the damage to the environment.2.221.141.140.18
8My preventive behaviors reduce the financial losses caused by floods.2.070.870.871.7
9I am afraid of the flood.2.050.940.940.13
10When I hear the flood warning messages, I get scared.1.670.980.981.22
11Due to the protective measures taken, I am not worried about the possibility of flooding.1.890.870.871.29
12The preparedness of the relief forces eases my worries about flooding.1.890.740.740.59
Table 2.

Goodness of Fit Indices of the Final Questionnaire

Indices ObservedAcceptable Value
Chi-square ratio to degrees of freedom2.62< 0.05
Normed Fit Index (NFI)1Less than 3
Comparative Fit Index (CFI)1More than 0.9
RMSEA 0.105Less than 0.1: Excellent model fit
Between 0.1 and 0.5: Good model fit
Between 0.5 and 0.8: The fitness of the average model
CFI 10.9 ≤
PRATIO0.8600.5 ≤
The results of confirmatory factor analysis of the final questionnaire
The results of confirmatory factor analysis of the final questionnaire

5. Discussion

Understanding public perception of flash flood risk is crucial. Identifying the key factors influencing this perception requires accurate tools. Measuring objective factors like knowledge is straightforward, but capturing subjective ones like personal beliefs is more challenging. Until now, no reliable tool existed in Iran to measure these subjective factors, especially as they relate to flash floods.

Our new questionnaire addresses this gap. It incorporates both objective and subjective factors, allowing us to measure various dimensions of flash flood risk perception. We used a rigorous approach, combining qualitative research and a systematic review, to design the questionnaire, making it applicable to understanding risk perception in other societies as well.

The questionnaire contains three sections: Awareness, risk perception, and preparedness. The awareness section (10 items) assesses people's knowledge and understanding of flash floods. Recognizing risk is crucial for taking action. As research shows, individuals with accurate information are more likely to prepare for emergencies (21, 22). This recognition acts as a catalyst for other emergency response measures (23) and influences decision-making, especially in uncertain situations (24). Accurate risk assessments also help evaluate preparedness levels (25). Understanding people's awareness of flash floods allows us to identify areas for improvement and develop targeted risk management strategies.

The risk perception section (12 items) explores people's feelings, concerns, and beliefs about flash floods. Risk perception is influenced by social factors, exposure levels, and potential consequences. It's generally measured by sensitivity to the risk and perceived severity. Knowledge, past experiences, and individual vulnerability also play a role (26). People who find a risk significant and potentially harmful tend to have higher risk perception. The health belief model highlights this link between perceived risk and preventative behavior (27). Additionally, risk perception is a key component of social vulnerability during flood disasters, with higher perception leading to lower vulnerability (28).

Finally, the preparedness section (7 items) examines people's actions and readiness for flash floods. Effective preparedness plans help individuals and communities recover quickly from crises. This includes training, drills, risk planning, and infrastructure upgrades (29). Preparedness plays a crucial role in reducing potential damage (30-32). Our research used confirmatory factor analysis to assess the questionnaire's psychometric properties, confirming its good fit and validity (33).

5.1. Conclusions

The flash flood risk perception questionnaire, comprising objective and subjective components across three key areas—preparation, awareness, and perception—demonstrates robust validity and reliability. It serves as a valuable tool for informing policy-making, planning, prevention, promotion, preparedness, and response strategies in flood management. Additionally, it facilitates the analysis of flash flood prevention training efficacy and the assessment of relevant measures.

5.2. Limitations and Strengths of the Study

This study benefits from item extraction conducted through both qualitative and systematic review phases, enhancing the comprehensiveness of the items. Furthermore, all necessary steps for psychometric evaluation of the instruments were meticulously followed. However, due to the domains of items being derived from the qualitative study, exploratory factor analysis was not undertaken. Additionally, participants for face validity, internal consistency, and confirmatory factor analysis were exclusively selected from residents of a single city in Fars province, limiting the generalizability of findings. Future studies would benefit from including a more diverse range of participants to enhance the study's external validity.

Acknowledgements

References

  • 1.

    Marchi L, Borga M, Preciso E, Gaume E. Characterisation of selected extreme flash floods in Europe and implications for flood risk management. J Hydrol. 2010;394(1-2):118-33. https://doi.org/10.1016/j.jhydrol.2010.07.017.

  • 2.

    Llasat MC, Llasat-Botija M, Prat MA, Porcú F, Price C, Mugnai A, et al. High-impact floods and flash floods in Mediterranean countries: the FLASH preliminary database. Adv Geosci. 2010;23:47-55. https://doi.org/10.5194/adgeo-23-47-2010.

  • 3.

    Valipour A. [Investigation of Influential Factors in Urban Crisis Management During Floods (Case Study: Sadra City, Fars province)]. Urban Env Plann Dev. 2023;11(3):89-104. Persian. https://doi.org/10.30495/juepd.2023.1978527.1135.

  • 4.

    Bodoque JM, Díez-Herrero A, Eguibar MA, Benito G, Ruiz-Villanueva V, Ballesteros-Cánovas JA. Challenges in paleoflood hydrology applied to risk analysis in mountainous watersheds – A review. J Hydrol. 2015;529:449-67. https://doi.org/10.1016/j.jhydrol.2014.12.004.

  • 5.

    Haer T, Botzen W, Aerts JC. The effectiveness of flood risk communication strategies and the influence of social networks—Insights from an agent-based model. Env Sci Policy. 2016;60:44-52. https://doi.org/10.1016/j.envsci.2016.03.006.

  • 6.

    Figueiredo E, Valente S, Coelho C, Pinho L. Coping with risk: Analysis on the importance of integrating social perceptions on flood risk into management mechanisms - The case of the municipality of Águeda, Portugal. J Risk Res. 2009;12:581-602. https://doi.org/10.1080/13669870802511155.

  • 7.

    Wang S, Huang C, Sun C. Modeling self-perception agents in an opinion dynamics propagation society. Simulation. 2013;90(3):238-48. https://doi.org/10.1177/0037549713515029.

  • 8.

    Sharifi F, Samadi S, Wilson CA. Causes and consequences of recent floods in the Golestan catchments and Caspian Sea regions of Iran. Natural Hazards. 2011;61(2):533-50. https://doi.org/10.1007/s11069-011-9934-1.

  • 9.

    Fox-Rogers L, Devitt C, O’Neill E, Brereton F, Clinch J. Is there really “nothing you can do”? Pathways to enhanced flood-risk preparedness. J Hydrol. 2016;543:330-43. https://doi.org/10.1016/j.jhydrol.2016.10.009.

  • 10.

    Morss RE, Mulder KJ, Lazo JK, Demuth JL. How do people perceive, understand, and anticipate responding to flash flood risks and warnings? Results from a public survey in Boulder, Colorado, USA. J Hydrol. 2016;541:649-64. https://doi.org/10.1016/j.jhydrol.2015.11.047.

  • 11.

    Harlan SL, Sarango MJ, Mack EA, Stephens TA. A survey-based assessment of perceived flood risk in urban areas of the United States. Anthropocene. 2019;28:100217. https://doi.org/10.1016/j.ancene.2019.100217.

  • 12.

    Oubennaceur K, Chokmani K, Lessard F, Gauthier Y, Baltazar C, Toussaint J. Understanding Flood Risk Perception: A Case Study from Canada. Sustainability. 2022;14(5):3087. https://doi.org/10.3390/su14053087.

  • 13.

    Alexander M, Viavattene C, Faulkner H, Priest S. A GIS-based Flood Risk Assessment Tool: Supporting Flood Incident Management at the local scale. London, England: Middlesex University; 2011, [cited 2023]. Available from: https://www.researchgate.net/publication/257343362.

  • 14.

    Lechowska E. What determines flood risk perception? A review of factors of flood risk perception and relations between its basic elements. Natural Hazards. 2018;94(3):1341-66. https://doi.org/10.1007/s11069-018-3480-z.

  • 15.

    Guba EG, Lincoln YS. Competing paradigms in qualitative research. Handbook of qualitative research. Thousand Oaks, CA: Sage Publications, Inc; 1994. p. 105-17.

  • 16.

    Ali N, Tretiakov A, Whiddett D. A content validity study for a knowledge management systems success model in healthcare. J Inf Tech Theory a Appl. 2014;15(2):21.

  • 17.

    Hertel AW, Thomas IA, Gadiel RB, Neel M, Rybarczyk D, Bell JS. A substance user-self fit perception increases identification as a user of the substance. J Exp Psychol Appl. 2022;28(4):816-34. [PubMed ID: 35389682]. https://doi.org/10.1037/xap0000420.

  • 18.

    Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):166 e7-16. [PubMed ID: 16443422]. https://doi.org/10.1016/j.amjmed.2005.10.036.

  • 19.

    Hassan S, Tesio L, Kumbhare D. Standard Psychometric Criteria for Measurements in Physical and Rehabilitation Medicine. Am J Phys Med Rehabil. 2022;101(5):473-81. [PubMed ID: 34050063]. https://doi.org/10.1097/PHM.0000000000001815.

  • 20.

    Hair JF, Black WC, Babin BJ, Anderson RE, Tatham R. Multivariate data analysis . Uppersaddle River. New Jersey, United States: Pearson Prentice Hall; 2006.

  • 21.

    Netzel LM, Heldt S, Engler S, Denecke M. The importance of public risk perception for the effective management of pluvial floods in urban areas: A case study from Germany. J Flood Risk Manag. 2021;14(2). https://doi.org/10.1111/jfr3.12688.

  • 22.

    Ge Y, Yang G, Wang X, Dou W, Lu X, Mao J. Understanding risk perception from floods: a case study from China. Nat Hazards (Dordr). 2021;105(3):3119-40. [PubMed ID: 33424123]. [PubMed Central ID: PMC7783707]. https://doi.org/10.1007/s11069-020-04458-y.

  • 23.

    Zsido AN, Csokasi K, Vincze O, Coelho CM. The emergency reaction questionnaire - First steps towards a new method. Int J Disaster Risk Reduct. 2020;49:101684. [PubMed ID: 32501418]. [PubMed Central ID: PMC7243776]. https://doi.org/10.1016/j.ijdrr.2020.101684.

  • 24.

    Meléndez‐Landaverde ER, Werner M, Verkade J. Exploring protective decision‐making in the context of impact‐based flood warnings. J Flood Risk Manag. 2019;13(1). https://doi.org/10.1111/jfr3.12587.

  • 25.

    Atreya A, Czajkowski J, Botzen W, Bustamante G, Campbell K, Collier B, et al. Adoption of flood preparedness actions: A household level study in rural communities in Tabasco, Mexico. Int J Disaster Risk Reduction. 2017;24:428-38. https://doi.org/10.1016/j.ijdrr.2017.05.025.

  • 26.

    Ardakani MF, Vaezi AA, Jamali S, Akhondi A, Sotoudeh A. Evaluation of Educational Intervention on Standard Precautions among Healthcare Provider Based on Health Belief Model. La Prensa Medica Argentina. 2019;105(3). https://doi.org/10.47275/0032-745x-130.

  • 27.

    Sotoudeh A, Mazloomy Mahmoodabad SS, Vaezi AA, Fattahi Ardakani M, Sadeghi R. Determining Skin Cancer Protective Behaviors in the Light of the Protection Motivation Theory among Sailors in Bandar-Bushehr in the South of Iran. Asian Pac J Cancer Prev. 2020;21(12):3551-6. [PubMed ID: 33369451]. [PubMed Central ID: PMC8046327]. https://doi.org/10.31557/APJCP.2020.21.12.3551.

  • 28.

    Millstein SG, Halpern-Felsher BL. Perceptions of risk and vulnerability. J Adolesc Health. 2002;31(1 Suppl):10-27. [PubMed ID: 12093608]. https://doi.org/10.1016/s1054-139x(02)00412-3.

  • 29.

    Diakakis M, Priskos G, Skordoulis M. Public perception of flood risk in flash flood prone areas of Eastern Mediterranean: The case of Attica Region in Greece. Int J Disaster Risk Reduction. 2018;28:404-13. https://doi.org/10.1016/j.ijdrr.2018.03.018.

  • 30.

    Bubeck P, Botzen WJW, Kreibich H, Aerts JCJH. Detailed insights into the influence of flood-coping appraisals on mitigation behaviour. Global Env Change. 2013;23(5):1327-38. https://doi.org/10.1016/j.gloenvcha.2013.05.009.

  • 31.

    Bradford RA, O'Sullivan JJ, van der Craats IM, Krywkow J, Rotko P, Aaltonen J, et al. Risk perception – issues for flood management in Europe. Nat Hazards Earth Syst Sci. 2012;12(7):2299-309. https://doi.org/10.5194/nhess-12-2299-2012.

  • 32.

    Kienzler S, Pech I, Kreibich H, Müller M, Thieken AH. After the extreme flood in 2002: changes in preparedness, response and recovery of flood-affected residents in Germany between 2005 and 2011. Nat Hazars Earth Syst Sci. 2015;15(3):505-26. https://doi.org/10.5194/nhess-15-505-2015.

  • 33.

    Brown TA, Moore MT. Confirmatory factor analysis. Handbook of structural equation modeling. New York, NY, US: The Guilford Press; 2012. p. 361-79.