Integrated Colorectal Cancer Screening Based on Decision Support Information System

authors:

avatar Elham Maserat ORCID 1 , *

Department of Medical Informatics, Faculty of Medical Science,Tarbiat Modares University, Tehran, Iran

how to cite: Maserat E. Integrated Colorectal Cancer Screening Based on Decision Support Information System. J Clin Res Paramed Sci. 2024;13(1):e145700. https://doi.org/10.5812/jcrps-145700.

Abstract

Background:

Decision making modalities for cancer screening for many conditions and different stages have become increasingly complex. Reengineering of traditional and paper-based decision support information system as an innovation strategy facilitates scheduling and decision making and support the delivery of cancer screening services.

Objectives:

The aim of study is to business process reengineering based on decision support information system in order to integration of colorectal cancer screening plan in Iranian population.

Methods:

The research method used in this study is mix method research (MMR) which combines quantitative methods and qualitative methods. Data collection techniques and tools in this study are: (1) Situational analysis method by checklist. The status of the current information system was evaluated with a checklist and (2) interview and focus group discussion; it is based on the 37 views of experts.

Results:

In this study, present screening information system was surveyed of six dimensions. These dimensions were general specification, functions, technologies, data resources, users, manual and standards of screening information system. The present information system performed only 25.1% of the expected information system tasks. The next step, conceptual models of integrated CRC screening information system are developed and approved by experts.

Conclusions:

Reengineering is a powerful and significant change strategy that can bring quality improvements in decision making processes of colorectal cancer screening plan. Therefore, to support the successful reengineering of decision support information system, comprehensive survey of infrastructures is needed in order to improve the quality of colorectal cancer screening plan.

1. Background

Colorectal cancer (CRC) is the third most prevalent cancers and the fourth leading cause of cancer mortality worldwide, accounting for 700,000 deaths with 1.4 million new cases in 2012 (1). According to the GLOBOCAN 2012 v1.0, the global burden of CRC is expected to increase by 60% to more than 2.2 million new colorectal cancer cases and 1.1 million deaths by 2030 (1). Incidence of CRC will double by 2030 in Iran (2). The economic burden of CRC in Iran was estimated US$298,148,718 in 2012. With regarding to high economic burden on the health care organizations and high mortality rate of colorectal cancer, policies should be approved to reduce the disease, prevention, and early diagnosis of CRC (3). Colorectal cancer incidence and mortality are reduced with regular screening (4). Integrated colorectal cancer screening process maximizes convenience, safety and satisfaction of patient and minimizes healthcare system costs (5). Therefore effective interventions in CRC screening plan are needed to support complex decision making (6).

In recent decades, decision making strategies for screening have become more complex (7). Current decision making strategies are untenable because complexity and the restriction human decision making (8). Clinical decision making for screening plan is a multi-stage process. This process involves collecting and analyzing a large volume of information for selecting of appropriate evidence-based interventions (9). A data driven cancer screening strategy based on personalized approach improves clinical efficacy and detects at risk population in early stages with cost effective methods (10). Completeness and quality of data is a very significant factor in cancer prevention system and efficiency of decision making process (11). In this study, data resources of information system based on CRC screening were analyzed.

Information systems (IS) facilitate systematic monitoring of cancer screening programs (12). An IS any combination of data, hardware, software, infrastructure and trained staffs to support planning, control, communication and decision making (12, 13). This technology increases the delivery of cancer prevention services and decreases interaction barriers of between health care providers and at risk individuals (13). Information systems can help the managers make more strategic and high accuracy decisions (14). One of the key success elements for countries depends on information systems to coordinate with business process. Also business process of screening plan should be adjusted to support information system in health care organization (15).

Business Process Reengineering (BPR) is dynamic analysis and redesign of workflow & core business processes within and between organizations. Business Process Reengineering can improve quality and reduce costs and cycle time especially in cross-functional team works. Also BPR optimize data dissemination and decision making by technology (16). Then there is a significant relationship between the decision support system and workflow re-engineering (17, 18). Decision support information systems improve re-engineering of business operations of organizations (18). A decision support systems (DSSs) includes an interactive software-based system and ancillary equipment that support decision making activities of work businesses and organizations (12). Decision support systems must be integrated into the cancer workflow to improve efficiency, eliminate mistakes (8). In this investigation, work process of CRC screening program with an emphasis on decision support information system was analyzed and redesigned. In this study, in the first stage, the status of the decision support system and information system of colorectal cancer screening was evaluated, and then the desired conceptual models were presented according to the experts' opinion.

2. Objectives

The aim of this study is to provide a conceptual model of an integrated decision support system for colorectal cancer screening.

3. Methods

The methodology used in this study is mix method research (MMR) which combines quantitative and qualitative methods. This present was conducted in Research Institute Gastroenterology and Liver Disease (RIGLD), Shahid Beheshti University in Iran. A program for colorectal cancer screening with new and comprehensive perspectives is being performing by RIGLD. RIGLD covered most provinces in Iran (Figure 1).

Covered patients in colorectal cancer screening program of RIGLD by provinces. This Map was extracted of MehrSys software. This software was used database of covered population in colorectal cancer screening for drawing of this map. MehrSys software is under copyright of RIGLD and also database belongs to this institute.
Covered patients in colorectal cancer screening program of RIGLD by provinces. This Map was extracted of MehrSys software. This software was used database of covered population in colorectal cancer screening for drawing of this map. MehrSys software is under copyright of RIGLD and also database belongs to this institute.

In the first step, present information system for screening was surveyed and information deficiencies and gaps were determined. A 128-item checklist was designed for assessing required components for information system of CRC screening. Items most frequently included in the checklist related to functions (6 items, 58 sub-items), technologies (12 items), data resource (21 items), users (16 items), manual and standards (21 items) of screening information system. The validity of checklist is measured by determining the validity of content, which is based on the reviews and the opinions of the experts related to information system of CRC screening.

A comprehensive search was conducted for checklist items used to assess the main dimensions of the CRC screening information system. In this step, all relevant books, articles, research projects, thesis, manual and scientific reports were extracted from MEDLINE, IEEE, Scholar, Web of Sciences, Scopus, Proquest, websites and databases related to colorectal cancer screening information system. Fifteen people evaluated the reliability and validity of the checklist.

The second step of study was qualitative survey. Interview and focus group discussion were conducted based on the views of 37 clinical decision makers and technical experts were worked in colorectal cancer screening plan. Participants were informed about cancer screening program and computerized decision support system. The researcher explained the purpose of the study and confidentially of information for participation. Also researcher asked for consent to audio-record the interviews. Researchers explained the study and obtained initial consent for further contact from participants. In-depth and semi-structured interviews used to study the reengineering strategies of CRC screening program by decision support information system. Interviewing involves asking questions and getting answers from participants. All interviews were fully transcribed and coded and analyzed by two researchers. The next step focus groups with semi-structured discussions were used to analysis and approve of final conceptual models and workflows.

4. Results

Finding of this article were presented two parts. The first part, general characteristics of CRC screening information system was described and next step, components of system was assessed. The second part, conceptual models and workflows were presented.

4.1. General Characteristics of CRC Screening Information System

General characteristics of CRC screening information system in four elements were described. Present information system did not have any of these elements. These general characteristics consist of the following elements:

4.2. Vision

Developing an integrated, effective screening system aimed at improving the quality of the colorectal cancer control program.

4.3. Mission

Collecting, processing, distributing and continuous managing of comprehensive, timely and accurate data related to the screening program.

4.4. Responsible Committee for Information System

The members of the committee including a representative of the department of pathology, oncology, gastroenterology, genetics, epidemiology and statistics and health information technology.

4.5. Situational Analysis of Colorectal cancer (CRC) Screening Information System

Colorectal cancer Screening information system was surveyed by approved checklist. In this study, current screening information system was surveyed of six dimensions. These dimensions were general specification, functions, technologies, data resources, users, manual and standards of screening information system. The present information system was performed only 24.6% of the expected system information tasks. The rate of using technologies, data sources, users, standards and standard of the current information system was 44.6%, 61.9%, 93.7%, and 38% respectively. Table 1 was illustrated situational analysis of CRC screening information system.

Table 1.

Participants of by Academic Fields

Academic FieldsValues a
Epidemiology3 (8)
Genetics6 (16)
Biochemistry1 (3)
Molecular biology1 (3)
Pathology2 (5)
Oncology1 (3)
Gastroenterology5 (13)
General medicine4(11)
Anesthesiology 1 (3)
Surgery1 (3)
Psychometrics1 (3)
Executive expert 2 (5)
Software engineering3 (8)
Information technology engineering2 (5)
Statistics3 (8)

4.6. Approved Conceptual Models and Workflows of Colorectal cancer (CRC) Screening Information System

We designed Conceptual models and workflows of CRC screening information system. The conceptual models were designed based on the business process management methodology (19). 37 clinical decision makers and technical experts in the multiple steps approved these models and workflows (Table 2). Figure 2 present relationship model between information system and CRC screening planning. According to relationship model, goals and plans are developed and monitored through CRC screening information systems. By views of expert panel, continues interaction was integral part of CRC screening planning and information system. Figure 3 illustrate conceptual model of integrated CRC information system. Integrated CRC information system utilizes information technology such as the portal, dashboards, educational forum, e- training packages, mobile-based system and project management software. Redesigned information system can covers the provincial units of the screening program, central unit, health non-communicable diseases management unit, representative of the World Health Organization (WHO) and the at risk people in Iran. In the flowchart of the screening program, all the processes from invitation of at risk people to genetic and pathology process was re-engineered (Figure 4).

Table 2.

Situational Analysis of CRC Screening Information System

ItemCriteriaPresent System a
Information System Activities
Clinical ActivitiesSurvival estimating, Re-currency estimating, Mortality estimating , Risk factor estimating, Incidence trend estimating, At risk population estimating, recommendation, planning, reminder option, risk classification, early detection, pedigree design, cancer grade analyzing, procedure analyzing, clinical & demographic analyzing of patient, sporadic CRC patient analyzing, analyzing of first and second degree relatives with FAP, analyzing of first and second degree relatives with HNPCC, colonoscopy report analyzing, Polyp analyzing, IHC analyzing, APC analyzing, MSI analyzing, Monitoring of Covered population5 (20.8)
Educational &learning ActivitiesElectronic education to covered population, Electronic education to covered population staffs, Need assessment, Internal education exchange, External education exchange1 (20)
Research & Development/ Evidence base medicineResearch progress reporting, Research outcome reporting, Need assessment, Collaboration report for research, priorities and idea listing, Database developing, Research experience exchange reporting, Research resource reporting2 (25)
Management ActivitiesDecision making, Daily- monthly-annual reporting, Financial reporting, Infrastructural reporting, Tangible and intangible benefits analysis, burden of disease reporting, Need assessment for strategic planning, operational planning, Prioritization of services, Reporting of cost-effectiveness of the screening program1 (10)
Executive ActivitiesReporting of telephone counseling, Reporting of other counseling format, Pathology block reporting, Blood sample reporting, SWOT of executive activities, executive Activity documentation2 (25)
General activitiesNews publishing, Information exchange with related governmental and non-governmental organization1 (50)
TechnologiesPortal, Forum, E-package, Screening network, mobile based system, Management project software, Evidence based website, Decision support system, virtual colonoscopy, expert capsule for diagnosis, RFID for identifying of pathology Block, Dashboard for visual reporting 5 (44.6)
UsersMinistry of health (MOH), staffs of screening center, gastroenterology experts, staffs of genetic and clinical laboratory, researcher/ epidemiologists/ statistical expert, managers, patient, at risk populations, Deputy of Research of Ministry of Health, Medical Deputy of Ministry of Health, Research Institute, assurance company, colonoscopy center, oncologist, pathologists, psychologist, internal physician15 (93.7)
Data resourcesPathobiology center, mortality registry, Outpatient department, Radiology center, Hematology-Oncology center, Physician office, clinics, Unit of non-communicable diseases management, Health and Medical deputy of university, Immunohistochemistry center, Flow cytometry center, Ostomy association, Health information management of hospital, Deputies of ministry of health, Medical council of Iran, Health reference laboratory, Pharmacy, Red Crescent and pharmaceutical companies, Assurance company, Bioinformatics database, Website and portal related to CRC screening31 (61.9)
Manuals and StandardsHIPAA, Documentation standard, Amsterdam & Revised Bethesda guidelines, Clinical guidelines, Genetic guidelines, Standards of clinical reporting, Standards of screening workflow, Information management manual and standard, Risk assessment guideline, Cancer registry standard, Nomenclatures of screening procedure, ATC, ICPC, SNOMED, LOINC, Information exchange standard, DICOM, ICD-O, ISO standards, ISCO 8 (38)
Relationship between information system and CRC planning.
Relationship between information system and CRC planning.
Conceptual model of Integrated CRC information system.
Conceptual model of Integrated CRC information system.
Data flow diagram of CRC Planning.
Data flow diagram of CRC Planning.

5. Discussion

Information system can help for cost effective interventions of CRC screening and increase interaction between health care providers and patients (13). One of the most important clinical tasks of information system is risk assessment (20). However findings of study demonstrate limited clinical tasks were conducted in the present screening information system.

Shared decision-making based on technology increase awareness and can help at risk individuals for selecting informed options for prevention (21). Also computer-based decision system can increase quality of decision making beyond traditional and static strategies of CRC screening (22). Present screening information system in educational task focus only on traditional education for decision making of patients and health care providers. While information systems follow the educational and research objectives of health care organizations and increase productivity (23). These technologies can transform the traditional interaction between clinicians and patients into a more productive and structured relationship (24). The educational objectives of the existing system are limited to the population covered by the screening program and the e-training of health care providers were not carried out. The e-interaction of information between experts and needs assessment was not carried out.

Managers state more effective planning for a screening program can support with up-to-date and accurate information (24). The present information system is not capable of providing management reports, only limited to daily and routine reports.

Technologies used in the present screening information system were less than 50%. Present information system does not use any computerized technologies such E-forum, portal, dashboard, experience network and evidence based website. The web-based decision support tools, based on decision model such as analytic hierarchy process (AHP) facilitate colorectal cancer prevention processes (25). The technologies used in information systems enhance the system's ability to delivery services. One of the effective technologies in screening programs is decision support system; this technology does not used in present screening information system. While decision support systems via deep models can support ongoing cancer follow-up (26).

Today, concerning the high amount of information create in the CRC screening process, much time should be spent on retrieval of information. Standard tools such as classification and nomenclature system optimize the process of data retrieval of big and complex database (27). Also standards of information exchange such as health level 7 (HL7) facilitate interaction and improve quality of data (28). In the present system, limited standards were used. Considering the benefits of using standards, especially their role in integration and information exchange, compliance with standards and guidelines seems necessary. With regarding to the importance of information systems in improving the quality of cancer screening programs and deficiencies of existing screening information system, the effective factors and deficiency reasons must be identified and eliminated.

Wagholikar et al. CRC screening workflow significantly improved the performance of decision systems and increased quality of information (29). Accurate design of work process and integration of information increases the effectiveness of the screening program (24). In the present system, there were no standardized work processes and there was no interactive between the goals of the screening program and the current information system. Given this key role of standard work processes in increasing the effectiveness of the screening program; work processes of colorectal cancer screening based on decision support information system were re-engineered. Studies show that the reengineering of work processes and their correction in the standard format plays a significant role in availability of useful and complete information and increase productivity of decision-making system (29). Therefore, in this paper, we reengineer colorectal cancer screening program based on decision support information system. This is expected to increase the effectiveness of the screening program with accurate implementation of these standard work processes.

5.1. Conclusions

Recent reviews shows situational analysis of information system is essential option for comprehensive implementation of integrated colorectal cancer screening. It is evident that the use of these systems offers tremendous opportunities to increase the quality of care, to support health care providers and to allow quick and easy access to the heterogonous health information resources. Therefore one of the key aspects to achieve integrated system of colorectal cancer screening is situational analysis of information system. In this paper, colorectal cancer screening information system was analyzed by principle dimensions. The criteria included in CRC screening information system, a 128-item checklist, can help researchers to describe important aspects of information system related to CRC screening. With regarding to the importance of information systems in the managing of cancer screening programs and existing deficiencies of present screening information system, the effective factors related to deficiencies must be identified and eliminated.

Reengineering is a powerful & significant change strategy that can bring quality improvements in decision making processes of colorectal cancer screening plan. We reengineer cancer screening work process based on decision support information system after from situational analysis of information system. In this stage, interoperable contents identified and new work process by business process management methodology was developed. As a conclusion, it is recommended to support the successful implementation of reengineering plan; significant infrastructures such as educational, technical, cultural and financial infrastructures were analyzed.

Acknowledgements

References

  • 1.

    Arnold M, Sierra MS, Laversanne M, Soerjomataram I, Jemal A, Bray F. Global patterns and trends in colorectal cancer incidence and mortality. Gut. 2017;66(4):683-91. [PubMed ID: 26818619]. https://doi.org/10.1136/gutjnl-2015-310912.

  • 2.

    Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, et al. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2015;136(5):E359-86.

  • 3.

    Vahdatimanesh Z, Zendehdel K, Kbari Sari AA, Farhan F, Nahvijou A, Delavari A, et al. Economic burden of colorectal cancer in Iran in 2012. Med J Islam Repub Iran. 2017;31:115. [PubMed ID: 29951416]. [PubMed Central ID: PMC6014770]. https://doi.org/10.14196/mjiri.31.115.

  • 4.

    Berland LL, Monticciolo DL, Flores EJ, Malak SF, Yee J, Dyer DS. Relationships Between Health Care Disparities and Coverage Policies for Breast, Colon, and Lung Cancer Screening. J Am Coll Radiol. 2019;16(4 Pt B):580-5. [PubMed ID: 30947890]. https://doi.org/10.1016/j.jacr.2018.12.025.

  • 5.

    Baumel M, White EC, inventors. Colo-rectal cancer screening system and method. United States. 2008 .

  • 6.

    Kistler CE, Hess TM, Howard K, Pignone MP, Crutchfield TM, Hawley ST, et al. Older adults' preferences for colorectal cancer-screening test attributes and test choice. Patient Prefer Adherence. 2015;9:1005-16. [PubMed ID: 26203233]. [PubMed Central ID: PMC4508065]. https://doi.org/10.2147/PPA.S82203.

  • 7.

    Javan Amoli AH, Maserat E, Safdari R, Zali MR. Electronic Risk Assessment System as an Appropriate Tool for the Prevention of Cancer: a Qualitative Study. Asian Pac J Cancer Prev. 2015;16(18):8595-8. [PubMed ID: 26745122]. https://doi.org/10.7314/apjcp.2015.16.18.8595.

  • 8.

    Walsh S, de Jong EEC, van Timmeren JE, Ibrahim A, Compter I, Peerlings J, et al. Decision Support Systems in Oncology. JCO Clin Cancer Inform. 2019;3:1-9. [PubMed ID: 30730766]. [PubMed Central ID: PMC6873918]. https://doi.org/10.1200/CCI.18.00001.

  • 9.

    Maserat E, Seied Farajollah SS, Safdari R, Ghazisaeedi M, Aghdaei HA, Zali MR. Information Engineering and Workflow Design in a Clinical Decision Support System for Colorectal Cancer Screening in Iran. Asian Pac J Cancer Prev. 2015;16(15):6605-8. [PubMed ID: 26434882]. https://doi.org/10.7314/apjcp.2015.16.15.6605.

  • 10.

    Sharma A, Hostetter J, Morrison J, Wang K, Siegel E. Focused Decision Support: a Data Mining Tool to Query the Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial Dataset and Guide Screening Management for the Individual Patient. J Digit Imaging. 2016;29(2):160-4. [PubMed ID: 26385814]. [PubMed Central ID: PMC4788622]. https://doi.org/10.1007/s10278-015-9826-0.

  • 11.

    Gooran N, Aminsharifi S, Maserat E, Soltani M, Fatemi SR. The role of information systems in cancer prevention. Gastroenterol Hepatol Bed Bench. 2010;3:164-8.

  • 12.

    Passman LJ, Farias AM, Tomazelli JG, de Abreu DM, Dias MB, de Assis M, et al. SISMAMA--implementation of an information system for breast cancer early detection programs in Brazil. Breast. 2011;20 Suppl 2:S35-9. [PubMed ID: 21440845]. https://doi.org/10.1016/j.breast.2011.02.001.

  • 13.

    Jimbo M, Nease DE, Ruffin MT, Rana GK. Information technology and cancer prevention. CA Cancer J Clin. 2006;56(1):26-36. quiz 48-9. [PubMed ID: 16449184]. https://doi.org/10.3322/canjclin.56.1.26.

  • 14.

    Atta MT. The effect of usability and information quality on decision support information system (DSS). Arts and Social Sciences Journal. 2017;8(2):257.

  • 15.

    Cook TS. Large datasets, logistics, sharing and workflow in screening. Br J Radiol. 2018;91(1090):20170751. [PubMed ID: 29470098]. [PubMed Central ID: PMC6350485]. https://doi.org/10.1259/bjr.20170751.

  • 16.

    Jha M, Jha S, O'Brien L. Combining big data analytics with business process using reengineering.In: Espana S, Ralyte J, Souveyet C, editors. IEEE RCIS 2016: IEEE International Conference on Research Challenges in Information Science, 10th. Grenoble, France. IEEE; 2016. p. 1-6.

  • 17.

    Rousan MAA. Decision Support Systems Effect on Reengineering Field Research on Jordanian Tourism Companies. Int J Acad Res Business Social Sci. 2014;4(4). https://doi.org/10.6007/IJARBSS/v4-i4/786.

  • 18.

    Abu Naser SS, Al Shobaki MJ. Enhancing the Use of Decision Support Systems for Re-Engineering of Operations and Business-Applied Study on the Palestinian Universities. SSRN Electronic Journal. 2016;2(5). https://doi.org/10.2139/ssrn.2814456.

  • 19.

    Weske M. Business Process Management Architectures. Berlin, Heidelberg: Springer; 2012. https://doi.org/10.1007/978-3-642-28616-2_7.

  • 20.

    Wang Y, Zhu G, Engel B. Health risk assessment of trihalomethanes in water treatment plants in Jiangsu Province, China. Ecotoxicol Environ Saf. 2019;170:346-54. [PubMed ID: 30544095]. https://doi.org/10.1016/j.ecoenv.2018.12.004.

  • 21.

    Owens OL, Felder T, Tavakoli AS, Revels AA, Friedman DB, Hughes-Halbert C, et al. Evaluation of a Computer-Based Decision Aid for Promoting Informed Prostate Cancer Screening Decisions Among African American Men: iDecide. Am J Health Promot. 2019;33(2):267-78. [PubMed ID: 29996666]. https://doi.org/10.1177/0890117118786866.

  • 22.

    Syrowatka A, Kromker D, Meguerditchian AN, Tamblyn R. Features of Computer-Based Decision Aids: Systematic Review, Thematic Synthesis, and Meta-Analyses. J Med Internet Res. 2016;18(1). e20. [PubMed ID: 26813512]. [PubMed Central ID: PMC4748141]. https://doi.org/10.2196/jmir.4982.

  • 23.

    Maserat E, Safdari R, Maserat E, Zali MR. Endoscopic electronic record: A new approach for improving management of colorectal cancer prevention. World J Gastrointest Oncol. 2012;4(4):76-81. [PubMed ID: 22532880]. [PubMed Central ID: PMC3334383]. https://doi.org/10.4251/wjgo.v4.i4.76.

  • 24.

    Maserat E, Fatemi R, Zali MR. New perspective for integrated information management in national colorectal cancer screening in Iran. Asian Pac J Cancer Prev. 2009;10(4):701-6.

  • 25.

    Suner A, Karakulah G, Dicle O, Sokmen S, Celikoglu CC. CorRECTreatment: a web-based decision support tool for rectal cancer treatment that uses the analytic hierarchy process and decision tree. Appl Clin Inform. 2015;6(1):56-74. [PubMed ID: 25848413]. [PubMed Central ID: PMC4377560]. https://doi.org/10.4338/ACI-2014-10-RA-0087.

  • 26.

    Park SY, Sargent D, Richmond D. Breast density follow-up decision support system using deep convolutional models. Medical Imaging 2019: Computer-Aided Diagnosis. San Diego, USA. SPIE; 2019. p. 101-9.

  • 27.

    Kop R, Hoogendoorn M, Moons LM, Numans ME, ten Teije A. On the Advantage of Using Dedicated Data Mining Techniques to Predict Colorectal Cancer. Artificial Intelligence in Medicine: 15th Conference on Artificial Intelligence in Medicine. Pavia, Italy. 2015. p. 133-42.

  • 28.

    Metroka AE, Papadouka V, Ternier A, Zucker JR. Effects of Health Level 7 Messaging on Data Quality in New York City's Immunization Information System, 2014. Public Health Rep. 2016;131(4):583-7. [PubMed ID: 27453603]. [PubMed Central ID: PMC4937120]. https://doi.org/10.1177/0033354916662217.

  • 29.

    Wagholikar K, Sohn S, Wu S, Kaggal V, Buehler S, Greenes RA, et al. Workflow-based data reconciliation for clinical decision support: case of colorectal cancer screening and surveillance. AMIA Summits on Translational Science Proceedings. 2013;2013:269.