Figures
Abstract
Translational medicine is becoming increasingly dependent upon data generated from health care, clinical research, and molecular investigations. This increasing rate of production and diversity in data has brought about several challenges, including the need to integrate fragmented databases, enable secondary use of patient clinical data from health care in clinical research, and to create information systems that clinicians and biomedical researchers can readily use. Our case study effectively integrates requirements from the clinical and biomedical researcher perspectives in a translational medicine setting. Our three principal achievements are (a) a design of a user-friendly web-based system for management and integration of clinical and molecular databases, while adhering to proper de-identification and security measures; (b) providing a real-world test of the system functionalities using clinical cohorts; and (c) system integration with a clinical decision support system to demonstrate system interoperability. We engaged two active clinical cohorts, 747 psoriasis patients and 2001 rheumatoid arthritis patients, to demonstrate efficient query possibilities across the data sources, enable cohort stratification, extract variation in antibody patterns, study biomarker predictors of treatment response in RA patients, and to explore metabolic profiles of psoriasis patients. Finally, we demonstrated system interoperability by enabling integration with an established clinical decision support system in health care. To assure the usefulness and usability of the system, we followed two approaches. First, we created a graphical user interface supporting all user interactions. Secondly we carried out a system performance evaluation study where we measured the average response time in seconds for active users, http errors, and kilobits per second received and sent. The maximum response time was found to be 0.12 seconds; no server or client errors of any kind were detected. In conclusion, the system can readily be used by clinicians and biomedical researchers in a translational medicine setting.
Citation: Abugessaisa I, Saevarsdottir S, Tsipras G, Lindblad S, Sandin C, Nikamo P, et al. (2014) Accelerating Translational Research by Clinically Driven Development of an Informatics Platform–A Case Study. PLoS ONE 9(9): e104382. https://doi.org/10.1371/journal.pone.0104382
Editor: Peter MA. van Ooijen, University of Groningen, University Medical Center Groningen, Netherlands
Received: October 30, 2013; Accepted: July 14, 2014; Published: September 9, 2014
Copyright: © 2014 Abugessaisa et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research is supported by Stockholm County Council (SLL), Swedish Research Council (Tegnér), Swedish Research Council, CERIC (Tegnér, Abugessaisa), Swedish Research Council, SerC (Tegnér, Abugessaisa), FP7 SYNERGY-COPD (Tegnér), IMI BTCure project (Klareskog, Abugessaisa), and Åke Wibergs Stiftelsen medicine research (Abugessaisa, Nikamo). The contribution of Nikamo was supported by Edvard Welande stiftelse Finsenstiftelse and Magn and Bergvalls Stiftelse. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Translational medicine, aimed at understanding etiology, molecular pathogenesis, clinical features, and prevention and treatment of diseases, depends on quantitative and high-quality data from patients during different stages of disease [1]. To this end, large amounts of clinical data are as a rule captured in electronic medical records (EMR), but increasingly also occasionally in dedicated registries on patients with specific diagnoses, thus capturing information on clinical characteristics of disease, laboratory data, response to therapies, and comorbidities. The success of translational medicine also relies on efficient utilization of data generated from emerging genomics technologies. Hence, to collect and manage large volumes of heterogeneous data has been recognized as a major enabler of translational informatics research [2]. However, unfortunately, these two pillars of translational medicine, clinical records and molecular data, along with their different parts, generally reside in disconnected informatics systems (figure 1). There is therefore an urgent need to reduce these barriers to accessing, sharing, reusing, and analyzing these different sources of data. A development mitigating this gap, thus enabling these data to be searchable across current data silos, would clearly spearhead the development and application of systems [3] and network-based [4], [5] approaches supporting predictive precision medicine, as currently advocated by both the medical [6] and computational research communities [7].
Since these data are as a rule stored in different domains (clinical and research), a single case-control study needs to collect the data several times during a study, and this cycle must be repeated whenever a new case-control study is initiated.
These challenges and opportunities for systems-based translational research have been duly recognized recently. Several parallel efforts have consequently been undertaken to address this unmet need. Open-source initiatives include the i2b2 suite [8], a scalable software platform facilitating repurposing of clinical data into the research setting. This platform has been used to build a system for monitoring clinical trials by combining i2b2 with GenePattern, a suite of bioinformatics tools from Broad Institute [9]. This development has been orchestrated by the pharmaceutical company Johnson and Johnson and the Innovative Medicines Initiative (IMI) eTRIKS project (http://www.imi.europa.eu/content/etriks). However, the resulting system, referred to as tranSMART [10], requires professional software engineering support for the curation and import of data and applications, thus constituting a significant barrier for clinicians. To meet the requirements of clinicians, Stanford Medical Center has developed the STRIDE system [11], to support ongoing clinical research at Stanford University. For a review of these efforts including their pros and cons, and challenges in a broader context, see [12]. In contrast to these open-source or local efforts, a commercial vendor may first of all provide better support and usable graphical user interface (GUI) for clinicians and translational researchers, and secondly provide a secure platform capable of dealing with sensitive patient data in conjunction with molecular data. This possibility has recently been examined; one of the leading commercial platforms on the market, the Oracle Health Sciences Clinical Development Center suite developed by Oracle (http://www.oracle.com/us/corporate/press/350422), was evaluated in a translational research environment [13]. The study concluded that although the system performed well from a technical and usability point of view, there were still pending issues for a hospital or research group. In view of both open-source and commercial efforts, there is therefore ample room for new developments and further investigations of the real needs of clinical users. To this end, our requirements at Karolinska University Hospital, Karolinska Institutet and Stockholm County Council have guided and motivated us to initiate a research and development project aimed at building an informatics system for integrating healthcare and clinical research databases, hence bridging the clinical and research domains as illustrated in figure 1.
Here we show that our study design provides us with a firsthand view of real translational needs from clinical and biomedical users. Our case study describes and evaluates the first version of this system, T-MedFusion, which not only can integrate different kinds of data, thereby enabling translational research, but can also accelerate the research process by providing specific and detailed examples in the area of chronic inflammatory diseases such as psoriasis and rheumatoid arthritis (RA).
Materials and Methods
The RA study obtained approval from the ethical board at Karolinska Institute, Stockholm, Sweden.
Detailed and technical description of the assembly of methods and open-source software engineering tools used to develop T-MedFusion will be reported in a complementary manuscript. In brief, the T-MedFusion currently contains datasets from different ongoing clinical research studies at Karolinska University Hospital, such as the study of Venous thromboembolism, Non-Small Cell Lung Cancer and chronic inflammatory diseases.
Understanding translational researchers' data needs
In this section, we will illustrate our approach to acquire and collect end-user's needs and requirements mainly in two therapeutic areas; Psoriasis and Rheumatoid arthritis (RA).
We started by identifying the requirements and types of database sources, the data structure, type of queries and interfaces for clinical researchers, as well as ethical and organization rules and regulations. This initial step helped to define data sources, the storage method, use cases, and experimental platforms used to generate laboratory data. The identification of these components allowed us to create the required architecture for T-MedFusion. After defining the architecture layers of T-MedFusion, we used a prototype as a complementary method to simulate the behavior of the system, enabling end users to refine their ideas and requirements about the system. We developed multiple versions (prototypes) and asked the researchers to use the system to try different types of data extraction, retrieval, patient stratification, and so forth.
The users of T-MedFusion are biomedical and clinical researchers at the Center for Molecular Medicine (CMM), a translational medicine research environment hosting researchers and clinicians affiliated with different departments at the Karolinska Institute working with patient cohorts obtained from the clinical practice under the ruling of the Karolinska University Hospital and Stockholm County Council. To develop and test our method, we selected research groups conducting investigations targeting chronic inflammation diseases with an active cohort of patients at the clinic.
Clinical and metabolic profiles for psoriasis cases and controls
Psoriasis is a common disease affecting 2–3% of the human population including both men and women [14]. Psoriasis is said to be chronic, but the natural disease course is actually not known. Psoriatic arthritis (PsA) affects one-third of patients over time [15]. PsA is a clinical diagnosis based on clinical findings; at present there are no biomarkers available. Ample epidemiologic evidence supports a link between severe psoriasis and cardiovascular events [16], [17]. Pathogenic mechanisms are incompletely known. Epidemiology also shows that psoriasis associates positively with metabolic dysfunction including obesity and vice versa, i.e., obesity increases the risk of developing psoriasis. However, putative mechanistic links between psoriasis and obesity are unclear. Hence, there is clear interest to perform future investigations across these diseases, thus defining the need for an integrative informatics platform supporting such queries across diseases.
The genetic contribution to psoriasis is overwhelming, and HLA-C is the main associated gene [18]. How HLA-C contributes to disease is still unknown, but it may involve altered presentation of a presumed autoantigen. Several recent genome-wide association studies have identified additional associated genes, the majority of which are involved in the immune system. These studies include unselected patient materials and reveal genes common to major subtypes, whereas genes associated with specific phenotypes may be missed. A striking example is the recent identification of the gene for pustular psoriasis, a rare and severe phenotype, where two independent groups reported mutations in the interleukin-36-receptor antagonist leading to deregulation of inflammation [19], [20]. Psoriasis is immune-mediated and T cells play a prominent role. Depletion of T cells or interference with their activation are effective therapeutic strategies [21]. The hypothesis is that T cells under the influence of dendritic cells drive the disease. Novel treatments targeting such pathways provide powerful tools to understand psoriasis.
To address and investigate the above research questions, a data integration environment is required. The EMR (electronic medical record) of psoriasis patients and the clinical lab results of the cohort of 747 psoriasis patients stored at the dermatology clinic were used. All cases were included within 12 months of onset of skin disease and examined by the dermatologist in the group. All patients with joint irritations were examined by a specialist rheumatologist to ascertain the diagnosis of PsA. The metabolic profile, blood lipids, fasting blood sugar, and body mass index (BMI) of the cohort and the matched controls are stored in different systems at the clinic and CMM. The metabolic profile for each individual in the cohort consists of data collected at onset of disease (during 2000–2004) and 10 years after onset. The latter part of the study is ongoing; to date 225 individuals have been included for follow-up investigation.
Rheumatoid arthritis (RA)
RA is a chronic inflammatory joint disease. In addition to the synovial joints, RA may affect other organs. RA has a significant effect on the patient's life and employment. In Sweden, the incidence of RA is 0.5–1%; the cumulative prevalence was 0.77% [22].
T-MedFusion enables immunological studies of RA patients, aiming at increasing understanding of disease initiation and perpetuation. To perform such studies, researchers need to take into account and access both the genetic and serological profiles of the included patient material. The patient cohorts diagnosed with RA (defined by ACR 1987 or later ACR/Eular 2010) present three profiles: human leukocyte antigen-DR (HLA-DR) genotyping, genotype of 65 SNPs all predisposing for RA [23] (table 1), and detection of anti citrullinated peptide antibodies (ACPA:s) using the anti-CCP assays or antibodies IgG antibodies against citrullinated alpha-enclose peptide-1 (CEP-1) and citrullinated type-II collagen (citC1I) IgG antibodies against citrullinated vimentin [24], [25].
Data sources and schemas in T-MedFusion
We started with the identification of data elements in the domain of knowledge (psoriasis and RA), identifying all entities (objects) composing the domain and the relationship among them. We used formal methods to define and model database sources. We used concept mapping [26] as a technique to define concepts and their attributes. Our starting point was therefore to identify and understand the data structure, regulations, and nature of each data source.
Patient clinical data
For each of the above diseases, the recruited patients have their clinical record stored within the hospital. A previously established system for exchange of structured data between the clinical records and a specific national registry for RA patients (named Swedish Rheumatology Quality of Care Registry (SRQ) was used for transfer of data from the clinical records to the Quality of Care Registry. However, a substantial part of the structured clinical data are also entered directly into the quality of care registry by the respective physicians (for information on the Swedish Rheumatology Quality of Care registry for RA; see [13], [27]. In the present study, the clinical data from RA patients come from patients from Karolinska University Hospital registered in the Swedish Rheumatology Quality Registry. Researchers need to apply specifically for each study to the Register Steering Committee, after ethical approval of the study, to receive coded data from the register in order to perform research using the registry data.
In T-MedFusion we modeled and implemented attributes describing the disease duration (temporal), disease activity, and medication for RA patient (figure 2).
For the psoriasis patients, clinical phenotypes for the patients were collected at two time points, the first in 2002 and the 10-year follow-up starting in 2012. The basic clinical phenotype includes the development of the disease (healed, guttate, or plaque), psoriasis area severity index (PASI), BMI, low-density lipoprotein (LDL) levels, high-density lipoprotein (HDL) levels, triglyceride (TG) levels, HDL/LDL ratio, general skin examination, nails assessment, treatment, and so forth) (figure 3).
Biobank and cell register
The biobank and cell registry stores and manages biological specimens from patients and from relevant individuals in the population. Biological specimens are available mainly in the context of specific research into one or several diseases (RA and psoriasis). The biobank contains DNA, RNA, serum, plasma, information on different preparation methods and information on sample volume and of specific information on where the specimen is stored viable cells that are captured and stored from some patients, and the information on these cells is stored in the cell registry database, which contains quantitative information about the number of cells available and other attributes.
Genotype variants, serology, and autoantibody
The genotype variants and serology data source contains information derived from the biobanked specimens, and these databases contain extensive information concerning the following: genotypes, both HLA-type and extensive SNP data; serology, covering titers of different RA-related autoantibodies (both IgG and IgA), such as CCP (Cyclic Citrullinated Peptide); and fine specificities [24], [25]. For each patient a different measure from the synovial fluid and serum was stored. In addition, reference SNPs are stored and categorized according to gene risk level (Risk, major, minor). See table 1 for the list of selected SNPs with their allele frequencies.
System usability and interoperability
Through our research and implementation of T-MedFusion we used the iterative process development method, in which we allowed biomedical and clinical researchers to join in the process by testing the user interface and providing us with feedback for a new version.
To assure the usefulness of the system, we decided to consider and explore two complementary approaches. The first approach is to make all user interaction based on a graphical user interface (GUI). The minimum requirements of the interface were to allow clinical and biomedical researchers to perform simple and complex queries on the fused databases. A simple query operates on a single source database, while a complex query retrieves data from fused database sources. In both cases, logical operations are supported. Such operations allow filtering the results according to specific expressions. The user interface enables the retrieval of a single record or group of records for a particular patient or sample. Also, it allows exporting output files into different file formats. The database is aggregated to the patient/sample level. The GUI for SNP data stored in T-MedFusion is illustrated in figure S1 serves as an example of the GUI layout in T-MedFusion.
The second approach is to perform a system performance evaluation study. Here we measure user satisfaction and acceptance of the system behavior based on the result of the performance evaluation. Through the performance evaluation and testing we obtained a quantitative measure to prove the effectiveness of the integration process and identify bottlenecks to overcome.
At the system level, we conducted a performance test to monitor the system's behavior under the following conditions:
- Increase the number of concurrent virtual users and monitor the reaction of the web service to the increased load.
- Operate the test for 120 hours (five days).
- Increase the number of virtual users from 1 to 20.
- Apply matrix and performance results.
- Response time: The elapsed time between the end of any inquiry or demand on a computer system and the beginning of a response (user query or sample selection).
- Average response time (during 120 hours). Maximum response time.
- Percentage of errors (during 120 hours), to identify any type of errors during the integration process.
- Test scenario: The investigator wants to select cells based on HLA type with preconditions of a cell count greater than 50,000,000 and SNP rs2064476 = AG and GG. This scenario involved integration of data from multiple sources available for the integration system. We obtained very good response time per virtual user, and we benchmarked the results with other systems.
The workflow and the implementation of the performance evaluation methods are illustrated in figure 4. The test was performed on a server running Redhat 5.5 Linux; the server configuration is Windows Intel 1.8 GHZ and 8 GB RAM. The server was running other applications during the test.
T-MedFusion supports interoperability with other systems as well. Through a friendly interface, the user can export the result of the query to many different formats. Importantly, we support integration via web services and provide the database in XML format and schema.
We implemented a web service (WS) in simple object access protocol (SOAP). The advantage of the WS implementation is that it allowed us to integrate T-MedFusion with the clinical decision support system (CDSS), as further elaborated in the Results section. Frequently in research and clinical environments we encounter different kinds of system for different functions. Such systems are developed by different vendors, each as a rule relying upon a different technology platform. A powerful best approach in integrating different software systems is to release WS based on well-defined service contracts in XML format.
Results
As indicated within the introduction section, T-MedFusion has demonstrated the usefulness and capabilities to handle data from health care, clinical research and molecular data in different therapeutic areas and clinical specialties (Cardiovascular. Oncology, Dermatology and Rheumatology) within Karolinska institute and Karolinska University Hospital.
Here we first we explain the de-identification and security procedures implemented to protect patient and research data. These security requirements were the result of a dialogue between translational researchers and principal biomedical investigators, together with computational researchers. Secondly we report the results from a real-use case study of the system from investigators working on either psoriasis or rheumatoid arthritis, thus addressing the issue of the added practical value of an informatics system. Finally, we describe how to integrate T-MedFusion with the Clinical Decision Support System (CDSS) in the hospital clinic.
De-identification: Protecting patient privacy
The need for sharing and repurposing patient data in the translational research environment is constrained by several organizational and legal restrictions. One of the main barriers is the legitimate concern for protection of patient privacy [28]. It is therefore mandatory for any research institute to assure the protection of the patient information before making it accessible through any kind of platform. Coding processes approved by the local ethical committee were used for protection of identity of patients. Only a very limited group of named responsible clinicians/scientists have access to the coding keys, which allow identification of distinct individuals.
The de-identification process represents the first security layer in this system. This was complemented with additional layers to protect both privacy and the intellectual property rights and ownership of the database. In the next section we provide more details on the security protocol implemented in the system.
Multilayer security approach
In the present test cases, the users of the system were granted the necessary credentials to access the coded data either inside the firewall of the Center for Molecular Medicine (CMM) at Karolinska University Hospital or as a remote user outside CMM. Adhering to good practice, the database server was isolated from the application server. This solution has both advantages and disadvantages and has been debated with regard to server consolidation and multitier architecture [29].
The data stored in T-MedFusion were completely de-identified: all individually identifiable attributes were removed and replaced with virtual attributes for joining different schemas and helping in multiple table queries. The system was installed on a Linux web server and accessible through a web browser. The user requires a credential provided by the Principal Investigator (PI) to log in to the system through the browser. All tasks executed by the user were tracked. Saving documents and operations like deleting and uploading data required additional privileges and permission as determined by the PI See figure S2.
Our system has therefore been designed to be PI driven, thereby ensuring control of data and use in the hands of the PI instead of the local or central IT staff. This came through as a very clear requirement in the interaction with the users as a paramount requirement in the design of the system. The PI control of the system, in conjunction with a user-friendly interface, were key factors for success, since the need for daily support from software engineering to use the system was alleviated. It is clear that without this PI driven design we would not have been able to proceed further.
Improving cellular and immunological research in rheumatology
To assess the utility of the T-MedFusion platform for translational research, we asked whether the system could facilitate cellular and immunological research in the clinical rheumatology research unit. For example, it has hitherto been strenuous for researchers to systematically preselect cell samples based on clinical parameters.
At the rheumatology research laboratory, previous studies have been performed using donated patient material from Karolinska University Hospital. Patients donate several types of samples, primarily blood and synovial fluid, from which serum, DNA, and viable cells are retrieved and deposited in the RA biobank. The inclusion criteria for samples in a specific study, is typically based on serology and the availability of cells, while clinical information with regard to the samples is collected in the clinical setting and in the Swedish Rheumatology Quality of Care Registry; data from these sources are normally available to the cellular researcher only after specific search for information for each individual patients, something that has been a time-consuming and strenuous exercise.
Using our method, investigators are able to select research material based on the availability of the cell samples from the biobank, suitable genotype or serology status, and disease parameters from the clinical database (quality registry) in an efficient way. This facilitates and accelerates ongoing and future RA research at the clinical rheumatology research unit by enabling the identification of predictive markers such as immunological phenotypes.
For example, a common need is to be able to execute searches across several different data types using complex Boolean search criteria. As a rule, performing such queries requires each individual database to generate a list of hits. The next step is to combine these lists corresponding to the concatenated search criteria. This process is not only cumbersome but also prone to the introduction of errors. The simplified workflow supported by T-MedFusion, enabled by the introduction of methods instantiating data integration capabilities is as follows:
Pick a cell sample from the biobank based on the following criteria (Cx) using a Boolean search such that C1 AND C2 AND C3 is true:
C1: Identify all samples where HLA-DR = ('*01/*04','*03/*04','*04','*04/*04','*04/*07','*04/*08','*04/*09','*04/*10','*04/*11','*04/*12','*04/*13','*04/*14','*04/*15','*04/*16').
C2: Only consider samples where the cell count is larger than 50×10∧6 cells.
C3: SNP rs2064476 = Nucleobase: Adenine & Guanine (AG) and Guanine & Guanine (GG) from genotype data source.
The result of the Boolean query is shown in table 2.
Another example of workflow that also requires searches across different data sources is the challenge of determining how many patients are available with a certain human leukocyte antigen (HLA-DR) allele, antibody pattern, and disease severity from which cryopreserved cells, serum, and DNA samples are donated to the biobank.
A third example addresses the following question: Are there clinical differences (such as disease activity) between anti-CCP IgG versus anti-CCP single-positive and IgA/IgG double-positive RA patients? T-MedFusion provides the end users with a wide range of query capabilities to interact and retrieve the data from multiple data sources in a user-friendly and easy way. Tables 3-6 show example queries that are possible to perform.
As demonstrated above, the methods introduced by the T-MedFusion system make it feasible to perform complex queries across distinct data types without requiring manual concatenation of lists obtained from elaborate searches in distinct databases. Significantly reducing the barriers to performing these kind of queries facilitates translational research in that in-house data can be reused and investigated much more thoroughly.
Extract variation in antibody patterns
In addition to performing complex queries across distinct databases, investigators often want to extract time series patterns for longitudinal cohorts from either one or several data sources. Our system facilitates such analysis. For example, to explore the level of anti-citrullinated protein antibodies (ACPA) for an entire cohort and establish longitudinal cohort variation in antibody patterns, we can visually inspect the data in figure 5. For established longitudinal cohorts in RA or any other disease, the extraction and visualization of the time series will enable the investigator to study which fine specificities the anti-citrulline response displays (i.e., beyond the CCP-test). This method could be applied to any similar data for a cohort of patients.
Each column in the x-axis represents one patient with four different serum concentrations. The y-axis represents concentration levels of the different serums (CCP, Cit C1 IgG, Cit Eno IgG and Cit Fib IgG).
Studying biomarker predictors of treatment response in RA patients
Recently, several effective immunologically designed treatments, commonly referred to as biological, have become available in the standard care of RA patients, improving their prognosis profoundly. However, the disease course varies widely among patients, and it is also clear that each of the new biological therapies is usually very effective in only a fraction of patients [30]. Non-responders to one specific therapy may, however, still respond to another drug, in part because it modifies another pathogenic pathway, which then may presumably be more prominent in the disease pathogenesis in that particular patient. Therefore, there is an urgent need in the clinic to identify (molecular) biomarkers that can predict the response to specific treatments at baseline. This may therefore support the accurate decision in selecting the correct treatment from the start, and the changes to biomarkers over time may also yield valuable information about the effects of such treatments. The T-MedFusion system is poised to be useful in the identification of such biomarkers, since the investigator can cross-link a response to therapy from the register-based follow-up data with molecular information collected in the research unit.
For example, with the availability of large numbers of biological samples collected at different time points for patients, an important issue for clinicians and investigators is to select samples according to predefined criteria within a defined time window for follow-up, in order to match those to clinical response data. One example is the selection of serum samples for RA patients at the baseline visit at treatment start and also at a follow-up visit, having available data on the outcome measure, e.g., disease activity scores (DAS) at these time points. To answer such a query, users need to extract the following information: treatment and DAS-related parameters from the clinical database, as well as sample and temporal information (sample donation date and time) from the biobank. The following algorithm describes the scenario of seeking serum samples in order to study the predictive value of biomarkers on patient response to treatment from the quality-of-care registry. From the RA biobank we have the following data:
- Total number of patients recruited in the study = 1622 active patients in the clinical database.
- Total number of serum samples in the biobank = 30,765. The samples are collected at the RA clinic and stored in the RA biobank at the CMM.
- Identify and retrieve the clinical data for the cohort.
- Extract treatment and DAS data for the selected cohort.
- Identify and retrieve serum samples for the cohort in step 1.
- Fuse the results from steps 1 and 3.
- The result from step 4 is 22,279 (serum samples) out of 30,765 samples (according to predefined criteria on the serum sample volume and status in the freezer).
- Extract all patients under treatment A = 1276 patients. Then extract two types of serum for this cohort according to:
- Initiation of DAS time window: Sample is selected if the sample has been collected at most 30 days before the DAS start date or up to 40 days after: 3204 serum samples satisfied this condition.
- End DAS time window: Sample is selected if the sample has been collected at most 75 days before the DAS end date or up to 152 days after: 1952 serum samples satisfied the condition.
- Repeat step 6 for treatment B, 95 patients: found 30 samples at Start DAS time window and 24 at End DAS time window.
- Repeat step 6 for treatment C, 251 patients: found 215 samples at Start DAS time window and 221 at End DAS time window.
The system provides a summary of the above findings, as illustrated in table 7.
Without the integration capabilities of the T-MedFusion system, the above workflow would have been difficult and time-consuming to execute. Our methods readily thus enabled an integrative analysis of biomarkers corresponding to the following therapeutics: Infliximab, Adalimumab, Etanercept, Methotrexate (MTX).
Cohort stratification using waterfall filtering
In many cases an investigator needs to run a multi-criteria filtering process and stratify the research cohort. This type of filtering requires a complex query method. Through a waterfall filtering process, T-MedFusion supports patient stratification, as illustrated in figure 6. In this case the user wants to find all RA cases who are anti-CCP+ (having antibodies against cyclic citrullinated peptides), start with anti-TNF (anti-tumor necrosis factor) treatment, and have a baseline DAS28 with a follow-up visit in the two- to three-month time window. The system calculates the change in DAS28 and further filters the patients to a specific DAS28 value (X).
Exploration of metabolic profiles for psoriasis patients
Next we sought to evaluate the applicability of T-MedFusion methods in another disease area, namely translational research on psoriasis. We therefore created a database structure capable of storing the metabolic profiles of psoriasis cases and controls, with the aim being to explore whether a metabolic profile in a subset of psoriasis patients is associated with SNPs identified in other studies, such as SNPs of relevance for cardiometabolic disease and diabetes. Criteria that need to be fulfilled in the first round are the following:
Criteria of obesity and hyperlipidemia: BMI>29; LDL>4.3; Triglycerides>2.6, the total number of patients = 747 patients. The result is illustrated in table 8.
In the second round the criteria to be fulfilled are: BMI<25, Triglycerides<2 and LDL<4.
Total number of patients = 747 patients.
The results are illustrated in table 9.
For the entire cohort the system allows the researcher to visually explore the change in the psoriasis area severity index (PASI) at time 00 and after 10 years. PASI is a quantitative measurement of the severity of the skin disease, integrating involvement, redness, and thickness of lesions. In conclusion, our method permits a longitudinal analysis of a patient's metabolic profile.
Integration with clinical decision support system
At the RA clinic a clinical decision support system (CDSS) generated within the Swedish Rheumatology Quality of Care Register supports the doctors in their decisions about diagnosis, status of disease, and medication plan. The CDSS provides a simplified view of the patient's illness, treatment, and outcome. Currently the CDSS is based on data from the Quality of Care Registry, which also includes selected clinical laboratory test results. However, there is a need to integrate the clinical data and lab data with additional molecular data and findings from research.
Therefore, the current architecture of T-MedFusion was designed to provide a high level of interoperability with different bioinformatics tools and workflows. This is possible through the so-called service-oriented architecture (SOA) [31]. The main feature of the SOA is enabling the reuse of information while maintaining a soft connection between the end users of the information platform (service consumer) versus the generators (systems). Using this architecture model the system can be interoperable with other infrastructures, thus making it possible to exchange different types of data stored in T-MedFusion with data stored in other systems. To illustrate this point we have performed a system-level integration between T-MedFusion and the RA CDSS (from the Quality of Care Registry) at Karolinska University Hospital.
The integration of T-MedFusion with the CDSS for RA at this stage will propagate the results of the ACPA tests from the research lab to the clinic. The knowledge about whether the patient is ACPA positive or negative is an important predictor for the need for result of treatment with some biologicals used in RA [32]. T-MedFusion can therefore enable the translation of the research results into clinical practice for predicting the eligibility of the patient for a specific treatment.
To introduce such information into the health-care system, the T-MedFusion transfers the research results about ACPA directly into the CDSS. The level of anti-citrullinated protein antibodies (ACPA) includes four parameters:
- CCP serum: Cyclic citrullinated peptide (CCP) - a diagnostic test for RA.
- Cit C1 IgG Serum: Cit C1 immunoglobulin G serum.
- Cit Eno IgG Serum: Cit enolase immunoglobulin G serum.
- Cit Fib IgG Serum: Cit fibrinogen immunoglobulin G serum.
The variant of RA (the ACPA-positive RA subset), is one of the genetically best characterized disease variants that exist, and a large number of studies have confirmed the effects of the genetic variants in RA diagnosis and treatment. Our entire approach is to firstly allow the clinicians to use the novel analyses of genetically complex diseases where different molecular phenotypes, here fine specificities of autoantibody re-activities, can be investigated. A second goal is to create a bridge between bench and bedside and translate research results to clinical care. Research wise, there has been very rapid development in this field recently (see [33], [34], [35]). All this combines to make the case of RA a very good example to demonstrate here.
The integration of T-MedFusion with the CDSS was achieved through the service integration platform hosted by Stockholm County Council as part of a specific project named 4D, where RA serves as a pilot project. The integration, using a web service based on requests and responses from the XML-based messaging protocol SOAP, was defined and agreed on in a service contract. The service contract (SC) is a technical agreement between the service provider (T-MedFusion) and consumer (CDSS). The exchange format and service communicate through service-oriented architecture and XML schemas. The SC consists of a web service description language (WSDL; figure 7) file with the associated XML schemas (XSD; figure 8), which is a document that describes all the rules, syntax and elements provided in the contract. The workflow and communication between the T-MedFusion and the CDSS is illustrated in figure 9.
The e-index monitors the update service from T-MedFusion. Whenever a new ACPA result arrives, the e-index sends a notification to the CDSS. The CDSS sends a GetACPAresultRequest to T-MedFusion and as response obtains ACPA results for one or several patients. Streaming of the response and request services and communications between the systems are conducted through exchange of security certificates.
A data-sharing model
T-MedFusion addresses researchers' challenges to maintain and manage research data in a long-term and persistent manner [36]. The system enables simplified procedures for uploading data from different formats. In addition to the database management, the implementation of T-MedFusion increases collaboration possibilities and the sharing of research data and results across different research groups working in similar or different therapeutic areas. It also facilitates collaboration between biologists and bioinformaticians to further run advanced bioinformatics and computational modeling analysis. This since the process of accessing and mapping which data is available is significantly simplified, as this step is as a rule a major hurdle in numerous inter-disciplinary collaborative projects.
Outcome of the technical performance study
The results of the performance test are illustrated in data file (SM: Data file S1. Performance evaluation results) and table 10. We recorded the average response time in seconds for active users, http errors, and received and sent kbit per second. The maximum response time was found to be 0.12 second; no errors were detected. We observed some peaks during the second day of the test because heavy computation was run on the server, which took a lot of CPU time and memory.
The results show that the system response time is of sufficient quality and scales up with increasing workload (number of virtual users from single user up to twenty users at the same time).
Discussion
Our work as illustrated in this case study, effectively integrates requirements from the clinical and the software engineering perspectives in a translational medicine setting. The three principal achievements can be summarized as (a) a design of a user-friendly web-based investigator-driven system for data management and integration, while adhering to proper de-identification and security measures, using a modular three-layer architecture; (b) providing a real-world test of the system using clinical cohorts of rheumatoid arthritis and psoriasis; and (c) demonstrating interoperability, in that the system supports and integrates with a clinical decision support system for health care.
Below we elaborate on the challenges and opportunities in pursuing clinically driven informatics development, which includes developing appropriate tools facilitating data quality control and curation, data import, data integration, and possibilities for generalization to other disease areas while still having a modular and interoperable system. We close the discussion by some final remarks on future developments.
A clinically driven approach to integrate clinical and biomedical databases entails a number of challenges that might not have been readily apparent if a purely software engineering approach had been at work. For example, to have a system where the PI is in control of the environment is of uttermost importance, which should be considered together with the need for a user-friendly system enabling daily use by non-computer experts. To identify and meet those needs we therefore developed the methods and algorithms in close dialogue with clinical researchers in clinical settings. For example, we do not require the users to write query statements in scripting languages and thereby spend time dealing with syntax and computer commands. We augmented the query interface with information visualization methods to support cohort discovery through data visualization techniques. Moreover, we introduced a waterfall model to query and filter the cohorts using a wide range of inclusion and exclusion criteria. Finally, T-MedFusion reduces the required time to preselect biological samples based on clinical parameters such as disease activity and medication. The user interface allows the preparation of the research material according to the availability of the samples, suitable genotype or serology status, and various disease parameters.
Yet this work raised several challenges. It became clear that there is an urgent need for development of semi-automatic tools to facilitate the tasks such as quality control of data, import of data, identification of inconsistencies, and annotation. Such tools should be user-friendly in the hands of the clinical and biomedical scientist, while still being grounded in solid software engineering. Current systems targeting monitoring of clinical trials, [8] and [11], currently require sophistication in computer science beyond that of the translational scientist. Hence, extracting, importing, and loading data through the graphical user interface of the T-MedFusion system has been simplified by providing a wizard-based interface for importing data sets generated in the research lab (in several formats) into the system, thus enabling the biomedical scientist to perform data import without dealing with a command shell tool like Oracle SQL*Loader (sqlldr) [37], or an ETL tool like Pentaho (Kettle) data integration software package, in which the users need proper training in the design of metadata and taxonomy [38].
For a more extensive discussion of remaining challenges with respect to medical informatics systems, see [13] and [12]. An additional obstacle is that the quality and reusability of the data is also dependent upon proper annotation, which currently requires hands-on knowledge of the particular biomedical domain, generally beyond the abilities of the software architect. Hence, it is a challenge to develop methods that can mitigate this gap between the importance of annotation and the current more or less manual procedures for performing this work.
To support the practical demands from the users, we benefited from requirement engineering methods to determine their requirements. This guided our development and modification of techniques for data integration and system architecture. This is also important since we aim to design a system amenable to extension into other disease areas. Integration of several databases for large cohorts creates opportunities to query and understand relationships among the different data sets collected for the same patient. To achieve this feature, our methods provide a wide range of query capabilities with a usable interface. The main challenge met by the T-MedFusion system is the need for an underlying system architecture in which information can be stored, queried, accessed, annotated, and shared in numerous ways, while still respecting that different end users have different needs in terms of interface and research workflow.
We anticipate that the kind of system we have developed can readily be extended to cover other translational areas of research within the Karolinska University Hospital in a first wave of development. At a later stage T-MedFusion may serve as a mature platform that could be connected with transnational efforts at an international level. As a proof of principle we have presented the integration to the health care system and tools for clinical decision support, thus suggesting that the T-MedFusion platform can communicate readily with other national and transnational systems. This user-friendly design geared towards translational research has to a large degree approximated the components and functionalities of T-MedFusion, thereby serving as a “local” integrative and interoperable informatics platform.
There are several potential applications for the methods we introduced beyond the ones we have illustrated using RA and psoriasis. For example, in the cardiovascular disease area we have implemented the methods to study biomarkers for venous thromboembolism (VTE). In that project, clinical investigators are for example collecting lifestyle information for about 200 patients to be integrated with their EMRs, laboratory and screening tests, and VTE treatment. We are currently testing the same methods to integrate clinical data targeting approximately 150 patients diagnosed with lung cancer (non-small-cell lung carcinoma). Here our aim is to predict the outcome of stereotactic body radiation therapy (SBRT) [39], including induced side effects and toxicity. Furthermore, we are currently assessing whether it is feasible to apply the same architecture model to manage the breeding and associated genetics databases associated with experimental animal models.
Translation informatics systems should provide a technology-independent model of integration, which we illustrated in the last part of the Results section by describing how the service contract, defined as a set of rules governing the integration requirements between service consumers and service providers, facilitates interaction between researchers and clinicians and permits a secure flow of data between the bench and the clinic for an RA patient.
By providing interoperable and scalable systems as T-MedFusion, we aim to support researchers and clinicians in better understanding the capability of information system and software engineering to translate basic research results into clinical practice. Without appropriate understanding of the end users' needs at the clinic and in biomedical research, it is difficult to achieve progress. Likewise, nontechnical issues of ethics and security are highly important for gaining trust, facilitating the flow of information from bench to bedside, and providing the quantitative and high-quality data on patients and diseases that translation medicine critically depends on. Some sort of software infrastructure, such as T-MedFusion, is a prerequisite for repurposing clinical data into the research setting. In our continued work, we intend to improve the tool support for enabling and managing genomics and proteomics data from high throughput platforms. We expect that the fusion of different types of clinical information with rich omics data will improve the understanding of complex diseases and provide new insights into treatment methods and the efficacy and toxicity of drugs. Translational medicine is becoming increasingly dependent upon data captured in health care, clinical research, and molecular research. Yet there is an urgent need for integrative, interoperable informatics systems mitigating current barriers, thereby enabling systems analysis of diseases and therapeutic interventions. We conclude that the system can readily be used in a translational medicine setting in the hands of clinicians or biomedical researchers, while still being built according to robust and interoperable software engineering principles.
Supporting Information
Figure S1.
User interface for SNP data stored in MedFusion.
https://doi.org/10.1371/journal.pone.0104382.s001
(TIF)
Figure S2.
Schematic description of the security layers of T-MedFusion.
https://doi.org/10.1371/journal.pone.0104382.s002
(TIF)
Acknowledgments
The authors would like to thank Yvonne Kallberg for her valuable comments and feedback during prototype development of T-MedFusion and data curation.
Author Contributions
Conceived and designed the experiments: IA JT. Wrote the paper: IA JT MS VM SS. Usability evaluation: LK MS VM SS GT CS PN. Provided the link to the Swedish Rheumatology Quality Registry: LK SL. Read and proofed the final manuscript: All authors.
References
- 1. Armstrong AW, Reddy SB, Garg A (2012) Novel approach to utilizing electronic health records for dermatologic research: developing a multi-institutional federated data network for clinical and translational research in psoriasis and psoriatic arthritis. Dermatology online journal 18: 2.
- 2. Schadt EE, Linderman MD, Sorenson J, Lee L, Nolan GP (2010) Computational solutions to large-scale data management and analysis. Nature reviews Genetics 11: 647–657.
- 3. Clermont G, Auffray C, Moreau Y, Rocke DM, Dalevi D, et al. (2009) Bridging the gap between systems biology and medicine. Genome Med 1: 88.
- 4. Tan K, Tegner J, Ravasi T (2008) Integrated approaches to uncovering transcription regulatory networks in mammalian cells. Genomics 91: 219–231.
- 5. Vidal M, Cusick ME, Barabasi AL (2011) Interactome networks and human disease. Cell 144: 986–998.
- 6. Hood L, Flores M (2012) A personal view on systems medicine and the emergence of proactive P4 medicine: predictive, preventive, personalized and participatory. N Biotechnol 29: 613–624.
- 7. Hunter P, Coveney PV, de Bono B, Diaz V, Fenner J, et al. (2013) A vision and strategy for the virtual physiological human: 2012 update. Interface Focus 3:
- 8. Murphy SN, Weber G, Mendis M, Gainer V, Chueh HC, et al. (2010) Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). Journal of the American Medical Informatics Association: JAMIA 17: 124–130.
- 9. Reich M, Liefeld T, Gould J, Lerner J, Tamayo P, et al. (2006) GenePattern 2.0. Nature genetics 38: 500–501.
- 10. Szalma S, Koka V, Khasanova T, Perakslis ED (2010) Effective knowledge management in translational medicine. J Transl Med 8: 68.
- 11. Lowe HJ, Ferris TA, Hernandez PM, Weber SC (2009) STRIDE—An integrated standards-based translational research informatics platform. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium 2009: 391–395.
- 12. Tegner J, Abugessaisa I (2013) Pediatric systems medicine: evaluating needs and opportunities using congenital heart block as a case study. Pediatric research 73: 508–513.
- 13. Abugessaisa I, Gomez-Cabrero D, Snir O, Lindblad S, Klareskog L, et al. (2013) Implementation of the CDC translational informatics platform - from genetic variants to the national Swedish Rheumatology Quality Register. Journal of translational medicine 11: 85.
- 14. Nestle FO, Kaplan DH, Barker J (2009) Psoriasis. The New England journal of medicine 361: 496–509.
- 15. Gladman DD (2009) Psoriatic arthritis. Dermatologic therapy 22: 40–55.
- 16. Mallbris L, Akre O, Granath F, Yin L, Lindelof B, et al. (2004) Increased risk for cardiovascular mortality in psoriasis inpatients but not in outpatients. European journal of epidemiology 19: 225–230.
- 17. Gelfand JM, Neimann AL, Shin DB, Wang X, Margolis DJ, et al. (2006) Risk of myocardial infarction in patients with psoriasis. JAMA: the journal of the American Medical Association 296: 1735–1741.
- 18. Nair RP, Stuart P, Henseler T, Jenisch S, Chia NV, et al. (2000) Localization of psoriasis-susceptibility locus PSORS1 to a 60-kb interval telomeric to HLA-C. American journal of human genetics 66: 1833–1844.
- 19. Marrakchi S, Guigue P, Renshaw BR, Puel A, Pei XY, et al. (2011) Interleukin-36-receptor antagonist deficiency and generalized pustular psoriasis. The New England journal of medicine 365: 620–628.
- 20. Onoufriadis A, Simpson MA, Pink AE, Di Meglio P, Smith CH, et al. (2011) Mutations in IL36RN/IL1F5 are associated with the severe episodic inflammatory skin disease known as generalized pustular psoriasis. American journal of human genetics 89: 432–437.
- 21. Lowes MA, Bowcock AM, Krueger JG (2007) Pathogenesis and therapy of psoriasis. Nature 445: 866–873.
- 22. Neovius M, Simard JF, Askling J (2011) Nationwide prevalence of rheumatoid arthritis and penetration of disease-modifying drugs in Sweden. Annals of the rheumatic diseases 70: 624–629.
- 23. Stahl EA, Raychaudhuri S, Remmers EF, Xie G, Eyre S, et al. (2010) Genome-wide association study meta-analysis identifies seven new rheumatoid arthritis risk loci. Nature genetics 42: 508–514.
- 24. Hansson M, Mathsson L, Schlederer T, Israelsson L, Matsson P, et al. (2012) Validation of a multiplex chip-based assay for the detection of autoantibodies against citrullinated peptides. Arthritis research & therapy 14: R201.
- 25. Snir O, Widhe M, von Spee C, Lindberg J, Padyukov L, et al. (2009) Multiple antibody reactivities to citrullinated antigens in sera from patients with rheumatoid arthritis: association with HLA-DRB1 alleles. Annals of the rheumatic diseases 68: 736–743.
- 26. Wang WM, Cheung CF, Lee WB, Kwok SK (2008) Self-associated concept mapping for representation, elicitation and inference of knowledge. Know-Based Syst 21: 52–61.
- 27. Askling J, Fored CM, Geborek P, Jacobsson LT, van Vollenhoven R, et al. (2006) Swedish registers to examine drug safety and clinical issues in RA. Annals of the rheumatic diseases 65: 707–712.
- 28. O'Keefe CM, Connolly CJ (2010) Privacy and the use of health data for research. Medical Journal of Australia 193: 537–541.
- 29.
Scourias J (1995) Aspects of Client/Server Database Systems.
- 30. van Vollenhoven RF (2009) Treatment of rheumatoid arthritis: state of the art 2009. Nature reviews Rheumatology 5: 531–541.
- 31. Joachim N, Beimborn D, Weitzel T (2013) The influence of SOA governance mechanisms on IT flexibility and service reuse. Journal of Strategic Information Systems 22: 86–101.
- 32. Tak PP (2012) A personalized medicine approach to biologic treatment of rheumatoid arthritis: a preliminary treatment algorithm. Rheumatology 51: 600–609.
- 33. Eyre S, Bowes J, Diogo D, Lee A, Barton A, et al. (2012) High-density genetic mapping identifies new susceptibility loci for rheumatoid arthritis. Nature genetics 44: 1336–1340.
- 34. Raychaudhuri S, Sandor C, Stahl EA, Freudenberg J, Lee HS, et al. (2012) Five amino acids in three HLA proteins explain most of the association between MHC and seropositive rheumatoid arthritis. Nature genetics 44: 291–296.
- 35. Klareskog L, Malmstrom V, Lundberg K, Padyukov L, Alfredsson L (2011) Smoking, citrullination and genetic variability in the immunopathogenesis of rheumatoid arthritis. Seminars in immunology 23: 92–98.
- 36.
Ohno-Machado L (2012) To share or not to share: that is not the question. Science translational medicine 4: 165 cm115.
- 37.
Blackwell B, Ravada S (2003) Oracle's technology for bioinformatics and future directions. Proceedings of the First Asia-Pacific bioinformatics conference on Bioinformatics 2003 - Volume 19. Adelaide, Australia: Australian Computer Society, Inc. pp. 35–42.
- 38.
Casters M, Bouman R, Dongen Jv (2010) Pentaho Kettle Solutions: Building Open Source ETL Solutions with Pentaho Data Integration: Wiley Publishing. 720 p.
- 39. Okunieff P, Petersen AL, Philip A, Milano MT, Katz AW, et al. (2006) Stereotactic Body Radiation Therapy (SBRT) for lung metastases. Acta oncologica 45: 808–817.