This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.

Background

In the past few decades, medically related data collection saw a huge increase, referred to as big data. These huge datasets bring challenges in storage, processing, and analysis. In clinical medicine, big data is expected to play an important role in identifying causality of patient symptoms, in predicting hazards of disease incidence or reoccurrence, and in improving primary-care quality.

Objective

The objective of this review was to provide an overview of the features of clinical big data, describe a few commonly employed computational algorithms, statistical methods, and software toolkits for data manipulation and analysis, and discuss the challenges and limitations in this realm.

Methods

We conducted a literature review to identify studies on big data in medicine, especially clinical medicine. We used different
combinations of keywords to search PubMed, Science Direct, Web of Knowledge, and Google Scholar for literature of interest
from the past 10 years.

Results

This paper reviewed studies that analyzed clinical big data and discussed issues related to storage and analysis of this type
of data.

Conclusions

Big data is becoming a common feature of biological and clinical studies. Researchers who use clinical big data face multiple challenges, and the data itself has limitations. It is imperative that methodologies for data analysis keep pace with our ability to
collect and store data.

Big data refers to very large datasets with complex structures that are difficult to process using traditional methods and tools. The term process includes, capture, storage, formatting, extraction, curation, integration, analysis, and visualization [1-9]. A popular definition of big data is the “3V” model proposed by Gartner [10], which attributes three fundamental features to big data: high volume of data mass, high velocity of data flow, and high variety of data types. The notion of big data can be traced back to the 1970s [11-13] when scientists realized that they lacked the tools to analyze datasets of large size. In those days, big data was merely several to hundreds of megabytes [14]; now datasets of terabytes are common [15, 16]. Therefore, the “big” in big data reflects the limits of data storage and computational power existing at a given point in time.

Table 1 shows the growth of global big data volume and computer science papers on big data since 2009. This table exemplifies that stored data will be in the tens of zettabytes range by 2020, and research on how to deal with big data will grow exponentially as well.

Big data is gathered in many disciplines and is made possible by ubiquitous information-sensing devices and software [19]. An example is web logs: websites such as Google or Facebook automatically record user information at each visit. Other examples come from the stock market [20], earthquake surveillance [21], political elections [22], behavioral studies [23], sports [24], pharmaceutical reports [25], health care [26, 27], electronic medical records [28], imaging data [29], genome data [30, 31], and entrepreneur transaction records [32]. Data collection is sometimes interdisciplinary. As an example, a sudden increase in Google search terms such as “flu symptoms” and “flu treatments” can be used to predict an increase in flu patients presenting to hospital emergency rooms [33]. This example also demonstrates that big data has promising predictive power and return on investment. Return on investment of big data has also been suggested for clinical big data [34, 35].

Although arguably valuable, big data is difficult to analyze due to the massive volume of the raw data and its diversity, as shown in Figure 1. Therefore, instead of the raw big data, a large dataset is often extracted from the raw data to generate a secondary storage of data for analysis purposes. This data extraction is applied, for example, when a computer tomography scan is involved in clinical trials and only the physician diagnosis based on the scan is included in data analysis. Similarly, a large volume of descriptive data on various kinds of samplings, tests, or assays can be extracted with only the key parameters kept. As a consequence, the data analyzed in clinical medicine is usually from secondary datasets that contain only data of interest. The secondary datasets, although still large, are not terabytes in size. Additionally, due to the nature of clinical trials, a large dataset in clinical medicine usually does not have an overwhelming number of samples. Kjaergard et al [36] defined clinical trials with 1000 or more participants as large, and the studies in clinical medicine titled big/large, data/dataset generally have thousands of attributes, but only hundreds of samples [37-39].

For this paper, we reviewed the literature to determine the features of clinical big data and determine the methods used for manipulation and analysis of these data. This paper is focused on clinical medicine rather than general health care issues; therefore, we mainly reviewed the studies that appeared relevant to clinicians. We examined the selected studies to extract information on research interests, goals, and achievements, and the implemented methodologies. Our intention was not to conduct an exhaustive systematic review, but instead to enable a literature-based discussion of how the big data issue has been addressed in clinical medicine. Based on our findings, we discuss the challenges and limitations of analysis of large clinical datasets.

Big data plays an important role in medical and clinical research and has been leveraged in clinically relevant studies. Major research institute centers and funding agencies have made large investments in the arena. For example, the National Institutes of Health recently committed US $100 million for the big data to Knowledge (BD2K) initiative [40]. The BD2K defines “biomedical” big data as large datasets generated by research groups or individual investigators and as large datasets generated by aggregation of smaller datasets. The most well-known examples of medical big data are databases maintained by the Medicare and Healthcare Cost and Utilization Project (with over 100 million observations). One of the differences between medical big data and large datasets from other disciplines is that clinical big data are often collected based on protocols (ie, fixed forms) and therefore are relatively structured, partially due to the extraction process that simplify raw data as mentioned above. This feature can be traced back to the Framingham Heart Study [41], which has followed a cohort in the town of Framingham, Massachusetts since 1948. Vast amounts of data have been collected through the Framingham Heart Study, and the analysis has informed our understanding of heart diseases, including the effects of diet, exercise, medications, and obesity on risk [42]. There are many other clinical databases with different scopes, including but not limited to, prevalence and trend studies, risk factor studies, and genotype-phenotype studies.

Prevalence and Trend Studies

One of the major uses for clinical big data is in analysis of the prevalence or trends of a disease or phenotype among different populations. An early big data study evaluated a cohort consisting of 890,394 US veterans with diabetes followed from 2002 through 2006 [43]. Bermejo-Sanchez et al [44] observed 326 of the birth defect Amelia among 23 million live births, stillbirths, and fetal anomalies from 23 countries and 4 continents, and found the trend of higher prevalence of Amelia among younger mothers. Histological features that differ between chronic idiopathic inflammatory bowel disease and normality and between Crohn’s disease and ulcerative colitis were identified in 809 large bowel endoscopic biopsies [45]. Kelly et al [46] studied the prevalence of hip abnormalities of 8192 subjects with hemophilia A and B. Siregar et al [47] performed a population-based study on patients after cardiac surgery in all 16 cardiothoracic surgery centers in the Netherlands. Elshazly et al [48] examined 1.3 million US adults for patient-level discordance of non-high-density lipoprotein cholesterol and low-density lipoprotein cholesterol. Chan and McGarey [49] summarize how large datasets can be analyzed to achieve population-based conclusions, specifically for determination of secular trends, health disparities, geographic variation, and evaluation of specific diseases and treatments. This paper also summarized the strengths and limitations of large-sized datasets and addressed issues such as missing data and bias. These issues will also be discussed in brief below.

Risk Factor Studies

Clinical big data can also be used to determine causality, effect, or association between risk factors and the disease of interest. Ursum et al [50] examined the relationships between seroconversion and patient age with inflammatory effects of autoantibodies in 18,658 rheumatoid arthritis patients and controls, and showed that citrullinated proteins and peptides were more reliable markers for rheumatoid arthritis than was Immunoglobulin M rheumatoid factor. Ajdacic-Gross et al [51] examined the data on 11,905 Swiss conscripts from 2003 for stuttering and found that there was no single overwhelming risk factor for stuttering, although premature birth and parental alcohol abuse appeared influential. Data collected on 14,433 patients from the 155 Veterans Administration medical centers in all 50 US states, Puerto Rico, and the District of Columbia were used to identify the alcohol dependence of medications [52]. By analysis of 53,177 cases of contrast administration in 35,922 patients from the Radiology and Cardiac Catheterization Laboratory databases, an increase in contrast nephropathy was associated with use of sodium bicarbonate [53]. Echocardiography and electrocardiogram-gated single-photon emission computed tomography traces for the evaluation of left ventricular ejection fraction were compared in 534 patients [54]. Zhang et al [55] examined clinical data of 16,135 adult patients and elucidated the relationships between glycemic, blood glucose level, and intake of insulin with mortality. Mitchel et al [56] studied the effect of 2 types of insulin on 7720 patients selected from 8 million in UK. Kobayashi et al [57] analyzed 19,070 records on right hemicolectomy from 3500 Japanese hospitals and successfully developed a risk model. It should be noted that in these studies, the terms of “association” and “causality” must be rigorously distinguished; most of the studies claimed association, whereas causality was rarely asserted.

Genotype–Phenotype Studies

With the advancement of genotyping technology, an increasing amount of risk-factor studies have attempted to assess association on the genetic level through evaluation of gene expression and/or genomic data obtained from patients and controls. For example, clinical and genetic data from 5700 patients who had been treated with warfarin were used to create an algorithm to estimate the appropriate dose [58]. Causality of autism spectrum disorders has been investigated by analysis of 31,516 clinical cases on copy number variation in patients versus 13,696 controls [59]. Koefoed et al [60] made efforts to assess the effects of signal transmission and calculated all combinations of three genotypes from 803 single-nucleotide polymorphism (SNP) genotypes (2.3 billion combinations) for 1355 controls and 607 patients with bipolar disorder. These studies are similar to risk-factor studies, yet often the big data is significantly larger in volume due in genetic analyses than in risk-factor studies.

Method Development Studies

A number of studies have taken advantage of clinical big data to establish new methods or techniques, or to develop new tools to enable analysis of data and decision making. In a typical example, Hill et al [61] designed an interface to use clinical data to evaluate risk ratios for various diseases to aid in evaluation of treatment options. Liu et al [62, 63] have used large-scale data analysis to optimize diagnosis of breast cancer from full-field digital mammography images. Lin et al [64] made efforts to formalize the phenotype variable in the database Genotypes and Phenotypes. Stephen et al [65] developed an algorithm to categorize pediatric patients presenting with respiratory distress into different subtypes using clinical variables from a clinical data warehouse. Clinical data warehouses or databases have been created from radiotherapy clinical trial data [66], gene mutations [67], cancer patient data [68, 69], kidney disease patient data [70], and gastrointestinal surgery patient data [71]. Additionally, studies have focused on personalized big data [72], citizen-centric health care versus patient-centric health care [72, 73], medication orders [74, 75], and decision making and information management/retrieval in general [75-80]. The dramatic increase in the number of studies with large scope in the past few years indicates an increasing desire of researchers to manipulate clinical big data; “big data-assisted clinics” may be expected in the near future.

DiscussionDiversity of Data in Clinical Medicine

The huge body of medical research that has been performed using large datasets demonstrates the broad spectrum of data resources used and shows that the structure of the medical dataset depends on the research question. Data from different subareas of medical research have broad diversity in terms of numbers of entries, types of data stored (or levels), dimensionality, and sample size [81]. Datasets obviously differ greatly in size: gene expression datasets derived from high-throughput microarray and next-generation sequencing technologies, such as those that analyze SNPs and copy number variations, tend to be massive, whereas clinical trial dataset are not as big. Phan et al [82] suggested that data in medicine be divided into four different levels: the molecular level (eg, genome data), cellular and tissue level (eg, stem cell differentiation data), clinical and patient level (eg, clinical trial data), and biomedical knowledge base level (ie, a comprehensive data collection). Additionally, data tend to have different levels of dimensionality (ie, number of attributes or parameters, p) and sample sizes (ie, number of records/entries, n). Typical datasets fall into one of three categories, as summarized by Sinha et al [83]: large n, small p; small n, large p; and large n, large p. Thanks to advancements in computational technology, most algorithms can handle low-dimensional data (ie, large n, small p) without encountering significant difficulty.

Most clinical data, however, is high-dimensional (ie, small n, large p or large n, large p) due to a limited number of patients. One typical example comes from a study of 69 Broca’s aphasic patients (ie, n=69) who were tested with nearly 6000 stimulus sentences (ie, p~6000) [84]. With similar dimensionality, Mitchell et al [39] studied bipolar disorder where the sample consisted of only 217 patients. For high-dimensional data, each point, sample, or element is described by many attributes [83] with the involvement of the “curse of dimensionality” [85]. Because high-dimensional data are sparse in dimensions, most classification or clustering approaches do not work well because the increase in problem space reduces the overall density of data samples. To solve this problem, compression methods and significance testing are usually used to either reduce the dimensionality or select relevant features before data analysis by some sort of data preprocessing [83].

Methods for Manipulation of Clinical Big Data Technologies for Data Storage and Handling

Due to the massiveness and complexity of big data, nonrelational and distributed databases such as Apache Hadoop [86], Google BigTable [87], NoSQL [88], and massively parallel-processing databases are used rather than traditional relational databases to store data. A large number of biostatistics software packages have been used to handle large clinical datasets, some of which enabled the features of cloud-based or distributed computing. Popular software packages include, but are not limited to, SAS [36, 51-53], Mplus [51], SPSS [36, 39, 45], PP-VLAM [89], Stata [90], and R [91]. These technologies and tools greatly facilitate the handling of big data.

Methodologies for Data Preprocessing

Clinical raw big data can be highly diverse and uninformative without preprocessing. Extraction of a diagnosis from raw computer tomography data is an example of one of the predominant manners in which clinical big data are preprocessed. This type of processes relies on a specialist’s personal expertise and can be a source of bias. Most early analyses of big data, including that collected by the Framingham Heart Study adopted some form of preprocessing; therefore, challenges exist in curation [6]. As an alternative to expert preprocessing, computational algorithms or statistical approaches, including compression methods, significance testing, or normalization [92] can be implemented to preprocess raw big data. This methodology may also introduce bias and can cause uncertainty problems during data integration.

In some scenarios, visualization can be a part of data preprocessing (as well as result exhibition). Typical examples in this regard include the use of heat maps [93], gene alignments [94], protein structure visualization [95], scatterplot matrix, tree visualization, network visualization, parallel coordinates, stacked graphs, etc. When the big data of interest are scattered or stored at different resources, data integration [96, 97] and federation [98] is an important phase during data preprocessing. Approaches such as the Information Manifold [97], which allows browsing and querying of multiple networked information sources, can provide solutions to uncertainty problems after data integration and mapping [99].

Statistical Approaches to Data Analysis

A number of popular statistical methods have been implemented in clinical data analysis. The most common include linear regression and logistic regression [30], latent class analysis [100], principle component analysis [101], and classification and regression trees [100]. Additionally, logarithmic and square-root transformations [58], naive Bayes methods [102], decision trees [103], neural networks [104], support vector machines [105], and hidden Markov models [83] are also used to study problems in medical data.

When a dataset is not overly complicated, a single test (eg, a simple Student’s t test) should be powerful enough to reject a null hypothesis, and single hypothesis testing is the methodology to adopt [106]. Sometimes one cannot establish the significance of a hypothesis until different statistical tests have been applied to the same dataset. Multiple testing is often used to identify correlations that deserve further investigation [107]. Algorithms for false discovery rate [108] and family-wise error rate [109] calculation have been implemented for multiple testing in studies on gene expression data and datasets with similar levels of complexity.

Challenges and Limitations of Use of Clinical Big DataOverview

Big data itself has many limitations. These limitations include “adequacy, accuracy, completeness, nature of the reporting sources, and other measures of the quality of the data”, as summarized previously [110]. The consequences of these limitations are succinctly summarized in the book titled “Models. Behaving. Badly.” [111]. Modeling can often lead to a biased statistical correlation or inference, sometimes known as a “false discovery”. Clinical big data users face a large spectrum of challenges, including but not limited to sample size, selection bias, interpretation problem, missing values, dependence problems, and data handling methodologies.

Sample Size

One of the counterintuitive challenges in analysis of big data clinical datasets is that sometimes the sample size is not as big, compared with the number of attributes to allow statistically significant analysis. Population survey methods are sometimes adopted because these methods can provide larger datasets. However, the authenticity and accuracy of this type of data are arguably limited; hence, survey methods cannot be reliably used to produce an adequate description or prediction [39].

Selection Bias

Any dataset is a selection of data rather than the whole data world; therefore, selection bias is a very real limitation [112] even if the sample size is big. In that sense, all studies of clinical data have this limitation to some degree [39].

Interpretation Problem

Gebregziabher et al [43] stated that the datasets generated through many translational research projects to answer questions of public health interest are not self-explanatory due to complexity and inadequate description/documentation of the dataset's parameters and associated metadata. The methodologies for interpreting the data can therefore be subject to all sorts of philosophical debate. For example, the data may not be totally naïve or objective and interpretation may be biased by subjective assumptions and/or manipulations by individual analysts.

Missing Values

It is common problem that large datasets have missing values, and in many cases the problem can be significant [44]. A typical example is the Framingham Heart Study where data on serum uric acid are largely missing. Additionally, the covariates (ie, attributes) may not fully capture the degree of risk for patients and may cause uncertainty in results [53].

Dependence Problems

One issue that has been often neglected is the dependence of data. Dependence between either attributes or samples in datasets can cause the degrees of freedom to decrease and/or some statistical principles to no longer apply. Examples of this are found when the same patients are evaluated multiple times through follow-up and when correlations in gene expression are drawn based on samples from different patients treated with similar medications [83]. As many statistical methods do not account for dependence, results from these tests may be unreliable if this issue is not properly addressed before the data analysis.

Data Handling Methodologies

Effective processing of big data has always been a challenge. One must consider all the aspects of the dataset, including collection, curation, extraction, integration, interpretation, imputation, and selection of appropriate statistical methods, during processing and analysis. It has been claimed that analyses of large datasets are often suboptimal due to the researcher’s lack of knowledge of the available tools and methodologies [83]. On the other hand, algorithms to handle big data are also underdeveloped to some extent and deserve more attention [113].

Conclusions

This paper reviewed studies that analyzed clinical big data and that discuss issues related to data storage and analysis. Big data is becoming a common feature of biological and clinical studies. Today, a single biophysical researcher can generate terabytes of data in hours. Over the last decade, clinical datasets have grown incredibly in size, mostly due to use of modern technologies for collection and recording of data. Researchers who use clinical big data face multiple challenges, and the data itself has limitations. It is imperative that methodologies for data analysis keep pace with our ability to collect and store data.

AbbreviationsBD2K

Big Data to Knowledge

CS

computer science

SNP

single-nucleotide polymorphism

ZB

zettabytes

WW did the search and primary review of the literature cited in this article and wrote the manuscript. EK guided the research and critically revised the manuscript.

None declared.

1WenkebachUPollweinBFinstererUVisualization of large datasets in intensive careProc Annu Symp Comput Appl Med Care199218221482864PMC22480222WangJChenYHuaRWangPFuJA distributed big data storage and data mining framework for solar-generated electricity quantity forecastingProc. SPIE 8333, Photonics and Optoelectronics Meetings (POEM)201110.1117/12.9196403WangJZChenYJHuaRWangPFuJA distributed big data storage and data mining framework for solar-generated electricity quantity forecastingProc. SPIE 8333, Photonics and Optoelectronics Meetings (POEM) 2011201110.1117/12.9196404FuJChenZHWangJCHeMQWangJZDistributed storage system big data mining based on HPC application-A solar photovoltaic forecasting system practiceInformation-Tokyo2012159374937555BrinkmannBHBowerMRStengelKAWorrellGASteadMLarge-scale electrophysiology: acquisition, compression, encryption, and storage of big dataJ Neurosci Methods2009180118519210.1016/j.jneumeth.2009.03.02219427545S0165-0270(09)00157-5PMC27201286HoweDCostanzoMFeyPGojoboriTHannickLHideWHillDPKaniaRSchaefferMSt PierreSTwiggerSWhiteORheeSYBig data: The future of biocurationNature20084557209475010.1038/455047a18769432455047aPMC28191447CalatroniARoggenDTrosterGCollection and curation of a large reference dataset for activity recognitionIeee Sys Man Cybern 20112011303510.1109/ICSMC.2011.60836388O'DriscollADaugelaiteJSleatorRD'Big data', Hadoop and cloud computing in genomicsJ Biomed Inform201346577478110.1016/j.jbi.2013.07.00123872175S1532-0464(13)00100-79LeeKKTangWCChoiKSAlternatives to relational database: comparison of NoSQL and XML approaches for clinical data storageComput Methods Programs Biomed201311019910910.1016/j.cmpb.2012.10.01823177219S0169-2607(12)00280-510BeyerMADouglasLThe Importance of 'Big Data': A Definition2013-08-252012http://www.gartner.com/it-glossary/big-data/6J7x1gswQ11OlbersDMüllerPWillebrandJInverse technique analysis of a large data setPhysics of the Earth and Planetary Interiors1976122-324825210.1016/0031-9201(76)90054-612BythDEEisemannRLde LacyIHTwo-way pattern analysis of a large data set to evaluate genotypic adaptationHeredity197637221523010.1038/Hdy.1976.8413ChaudronJAssenlineauLRenonHA new modification of the Redlich—Kwong equation of state based on the analysis of a large set of pure component dataChemical Engineering Science197328383984610.1016/0009-2509(77)80018-314GraefeJFWoodRWDealing with large data setsNeurotoxicol Teratol1990125449454224703115AckermanMJBig dataJ Med Pract Manage20122821531542316703816TrellesOPrinsPSnirMJansenRCBig data, but are we ready?Nat Rev Genet20110312322410.1038/nrg2857-c121301471nrg2857-c117analysisATKBig Data and the Creative Destruction of Today's Business Models2013-11-252013http://www.atkearney.com/strategic-it/ideas-insights/article/-/asset_publisher/LCcgOeS4t85g/content/big-data-and-the-creative-destruction-of-today-s-business-models/101926LOmyDbvg18HaleviGMoedHFThe Evolution of Big Data as a Research and Scientific Topic: Overview of the Literature2013-11-252012http://www.researchtrends.com/issue-30-september-2012/the-evolution-of-big-data-as-a-research-and-scientific-topic-overview-of-the-literature/6LOn9qSGu19HutchinsJIhlerASmythPProbabilistic analysis of a large-scale urban traffic sensor data setKnowledge Discovery from Sensor Data201058409411410.1007/978-3-642-12519-5_620SleutelSDe NeveSBeheydtDLiCHofmanGRegional simulation of long-term organic carbon stock changes in cropland soils using the DNDC model: 1. Large-scale model validation against a spatially explicit data setSoil Use Manage200622434235110.1111/j.1475-2743.2006.00045.x21CianchiniGDe SantisABalasisGMandeaMQamiliEEntropy based analysis of satellite magnetic data for searching possible electromagnetic signatures due to big earthquakesMa Comput Sci Eng2009293522IssenbergSHow President Obama's campaign used big data to rally indicidual votersTechnol Rev20131161384923KesslerRCBrownRLBromanCLSex differences in psychiatric help-seeking: evidence from four large-scale surveysJ Health Soc Behav1981032214964724070624LewisMMoneyball: The Art of Winning an Unfair Game: WMoneyball: The Art of Winning an Unfair Game2003New York, New YorkW. W. Norton & Company25EkinsSWilliamsAJWhen pharmaceutical companies publish large datasets: an abundance of riches or fool's gold?Drug Discov Today20101519-2081281510.1016/j.drudis.2010.08.01020732447S1359-6446(10)00270-926Grimley EvansJTallisRCA new beginning for care for elderly people?BMJ2001322729080780811290619PMC111999227JeeKKimGHPotentiality of big data in the medical sector: focus on how to reshape the healthcare systemHealthc Inform Res2013192798510.4258/hir.2013.19.2.7923882412PMC371744128MurdochTBDetskyASThe inevitable application of big data to health careJAMA2013309131351135210.1001/jama.2013.39323549579167424529TogaAWThe clinical value of large neuroimaging data sets in Alzheimer's diseaseNeuroimaging Clin N Am2012221107118, ix10.1016/j.nic.2011.11.00822284737S1052-5149(11)00178-XPMC355555730BakkePSZhuGGulsvikAKongXAgustiAGCalverleyPMDonnerCFLevyRDMakeBJParéPDRennardSIVestboJWoutersEFAndersonWLomasDASilvermanEKPillaiSGCandidate genes for COPD in two large data setsEur Respir J201137225526310.1183/09031936.000917092056212909031936.0009170931SolomonBDNguyenADBearKAWolfsbergTGClinical genomic databaseProc Natl Acad Sci U S A2013110249851985510.1073/pnas.1302575110236966741302575110PMC368374532LiuXLDuJPLiWZZuoMHanZMData warehousing for data mining based on Olap technologyCiict 2008: Proceedings of China-Ireland International Conference on Information and Communications Technologies2008China-Ireland International Conference on Information and Communications Technologies26-28 Sept. 2008Beijing, China1767910.1049/cp:2008078633LohrSThe New York Times2012The Age of Big Datahttp://www.nytimes.com/2012/02/12/sunday-review/big-datas-impact-in-the-world.html?pagewanted=1&_r=06J7xJAwId34McCannEEHR Boosts ROI2013-11-252013http://www.healthcareitnews.com/news/ehr-boost-roi-revenue-medical-group6LOnNYQHV35groupCIWEMR Benefits and Return on Investment Categories2013-11-252008http://www.informatics-review.com/wiki/index.php/EMR_Benefits_and_Return_on_Investment_Categories6LOndM19u36KjaergardLLVillumsenJGluudCReported methodologic quality and discrepancies between large and small randomized trials in meta-analysesAnn Intern Med20011241351198298911730399200112040-0001037ManciaGOmboniSRavogliAParatiGZanchettiAAmbulatory blood pressure monitoring in the evaluation of antihypertensive treatment: additional information from a large data baseBlood Press199543148156767064838ReicheltJGHeimdalKMøllerPDahlAABRCA1 testing with definitive results: a prospective study of psychological distress in a large clinic-based sampleFamilial Cancer200231212810.1023/B:FAME.0000026820.32469.4a39MitchellPBJohnstonAKCorryJBallJRMalhiGSCharacteristics of bipolar disorder in an Australian specialist outpatient clinic: comparison across large datasetsAust N Z J Psychiatry200943210911710.1080/000486708026072201915391890792187540NHGRIRequest for Information (RFI): Input on Development of Analysis MethodsSoftware for Big Data2013-08-272013http://grants.nih.gov/grants/guide/notice-files/NOT-HG-13-014.html6JB6Y33gd41WolfPAAbbottRDKannelWBAtrial fibrillation as an independent risk factor for stroke: the Framingham StudyStroke1991228983988186676542HubertHBFeinleibMMcNamaraPMCastelliWPObesity as an independent risk factor for cardiovascular disease: a 26-year follow-up of participants in the Framingham Heart StudyCirculation1983675968977621983043GebregziabherMEgedeLGilbertGEHuntKNietertPJMauldinPFitting parametric random effects models in very large data sets with application to VHA national dataBMC Med Res Methodol20121216310.1186/1471-2288-12-163230953251471-2288-12-163PMC354216244Bermejo-SánchezECuevasLAmarEBakkerMKBiancaSBianchiFCanfieldMACastillaEEClementiMCocchiGFeldkampMLLandauDLeonciniELiZLowryRBMastroiacovoPMutchinickOMRissmannARitvanenAScaranoGSiffelCSzabovaEMartínez-FríasMLAmelia: a multi-center descriptive epidemiologic study in a large dataset from the International Clearinghouse for Birth Defects Surveillance and Research, and overview of the literatureAm J Med Genet C Semin Med Genet2011157C428830410.1002/ajmg.c.303192200295645CrossSSHarrisonRFDiscriminant histological features in the diagnosis of chronic idiopathic inflammatory bowel disease: analysis of a large dataset by a novel data visualisation techniqueJ Clin Pathol2002551515711825925PMC176956646KellyDC ZhangQM SoucieJManco-JohnsonMDimicheleDJoint Outcome Subcommittee of the Coordinating Committee for the Universal Data Collection Databasethe Hemophilia Treatment Center Network InvestigatorsPrevalence of clinical hip abnormalities in haemophilia A and B: an analysis of the UDC databaseHaemophilia201319342643110.1111/hae.120732325262147SiregarSRoesKCvan StratenAHBotsMLvan der GraafYvan HerwerdenLAGroenwoldRHStatistical methods to monitor risk factors in a clinical database: example of a national cardiac surgery registryCirc Cardiovasc Qual Outcomes20136111011810.1161/CIRCOUTCOMES.112.968800233228066/1/11048ElshazlyMBMartinSSBlahaMJJoshiPHTothPPMcEvoyJWAl-HijjiMAKulkarniKRKwiterovichPOBlumenthalRSJonesSRNon-high-density lipoprotein cholesterol, guideline targets, and population percentiles for secondary prevention in 1.3 million adults: the VLDL-2 Study (very large database of lipids)J Am Coll Cardiol2013111962211960196510.1016/j.jacc.2013.07.04523973689S0735-1097(13)03075-149ChanLMcGareyPUsing large datasets for population-based health researchGallin JI, Ognibene FP. eds. Principles and Practice of Clinical Research. 3rd ed2012Maryland Heights, MOElsevier, Inc37138150UrsumJBosWHvan de StadtRJDijkmansBAvan SchaardenburgDDifferent properties of ACPA and IgM-RF derived from a large dataset: further evidence of two distinct autoantibody systemsArthritis Res Ther2009113R7510.1186/ar270419460147ar2704PMC271412151Ajdacic-GrossVVetterSMüllerMKawohlWFreyFLupiGBlechschmidtABornCLatalBRösslerWRisk factors for stuttering: a secondary analysis of a large data baseEur Arch Psychiatry Clin Neurosci2010260427928610.1007/s00406-009-0075-41982685652MonnellyEPLocastroJSGagnonDYoungMFioreLDQuetiapine versus trazodone in reducing rehospitalization for alcohol dependence: a large data-base studyJ Addict Med20082312813410.1097/ADM.0b013e318165cb562176898201271255-200809000-0000353FromAMBartholmaiBJWilliamsAWChaSSPfluegerAMcDonaldFSSodium bicarbonate is associated with an increased incidence of contrast nephropathy: a retrospective cohort study of 7977 patients at mayo clinicClin J Am Soc Nephrol200831101810.2215/CJN.0310070718057306CJN.03100707PMC239099054Habash-BseisoDERokeyRBergerCJWeierAWChyouPHAccuracy of noninvasive ejection fraction measurement in a large community-based clinicClin Med Res2005327582160121243/2/75PMC118343655ZhangYHemondMSUncovering the predictive value of minimum blood glucose through statistical analysis of a large clinical datasetAMIA Annu Symp Proc2009200972572920351948PMC281538056MorganCLEvansMToftADJenkins-JonesSPooleCDCurrieCJClinical effectiveness of biphasic insulin aspart 30:70 versus biphasic human insulin 30 in UK general clinical practice: a retrospective database studyClin Ther2011331273510.1016/j.clinthera.2011.01.02321397771S0149-2918(11)00070-157KobayashiHMiyataHGotohMBabaHKimuraWKitagawaYNakagoeTShimadaMTomitaNSugiharaKMoriMRisk model for right hemicolectomy based on 19,070 Japanese patients in the National Clinical DatabaseJ Gastroenterol2013072710.1007/s00535-013-0860-82389298758International Warfarin Pharmacogenetics ConsortiumKleinTEAltmanRBErikssonNGageBFKimmelSELeeMTLimdiNAPageDRodenDMWagnerMJCaldwellMDJohnsonJAEstimation of the warfarin dose with clinical and pharmacogenetic dataN Engl J Med2009360875376410.1056/NEJMoa080932919228618360/8/753PMC272290859Moreno-De-LucaDSandersSJWillseyAJMulleJGLoweJKGeschwindDHStateMWMartinCLLedbetterDHUsing large clinical data sets to infer pathogenicity for rare copy number variants in autism cohortsMol Psychiatry201318101090109510.1038/mp.2012.13823044707mp2012138PMC372084060KoefoedPAndreassenOABennikeBDamHDjurovicSHansenTJorgensenMBKessingLVMelleIMøllerGLMorsOWergeTMellerupECombinations of SNPs related to signal transduction in bipolar disorderPLoS One201168e2381210.1371/journal.pone.00238122189785810-PONE-RA-20023PMC316358661HillBProulxJZeng-TreitlerQExploring the use of large clinical data to inform patients for shared decision makingStud Health Technol Inform20131928518552392067862LiHGigerMLYuanYChenWHorschKLanLJamiesonARSennettCAJansenSAEvaluation of computer-aided diagnosis on a large clinical full-field digital mammographic datasetAcad Radiol200815111437144510.1016/j.acra.2008.05.00418995194S1076-6332(08)00280-8PMC259710663LiHGigerMLLanLBancroft BrownJMacMahonAMussmanMOlopadeOISennettCComputerized analysis of mammographic parenchymal patterns on a large clinical dataset of full-field digital mammograms: robustness study with two high-risk datasetsJ Digit Imaging201225559159810.1007/s10278-012-9452-z22246204PMC344710164LinKWTharpMConwayMHsiehARossMKimJKimHEFeasibility of using Clinical Element Models (CEM) to standardize phenotype variables in the database of genotypes and phenotypes (dbGaP)PLoS One201389e7638410.1371/journal.pone.007638424058713PONE-D-13-01003PMC377675465StephenRBoxwalaAGertmanPFeasibility of using a large Clinical Data Warehouse to automate the selection of diagnostic cohortsAMIA Annu Symp Proc2003101914728522D030003072PMC148006866RoelofsEPersoonLNijstenSWiesslerWDekkerALambinPBenefits of a clinical data warehouse with data mining tools to collect data for a radiotherapy trialRadiother Oncol2013108117417910.1016/j.radonc.2012.09.01923394741S0167-8140(12)00444-667StensonPDMortMBallEVShawKPhillipsADCooperDNThe Human Gene Mutation Database: building a comprehensive mutation repository for clinical and molecular genetics, diagnostic testing and personalized genomic medicineHum Genet2013092810.1007/s00439-013-1358-42407791268HuHBrzeskiHHutchinsJRamarajMQuLXiongRKalathilSKatoRTenkillayaSCarneyJReddRArkalgudvenkataSShahzadKScottRChengHMeadowSMcMichaelJSheuSLRosendaleDKvecherLAhernSYangSZhangYJordanRSomiariSBHookeJShriverCDSomiariRILiebmanMNBiomedical informatics: development of a comprehensive data warehouse for clinical and genomic breast cancer researchPharmacogenomics20045793394110.1517/14622416.5.7.93315469411PGS05071369SavasSA curated database of genetic markers from the angiogenesis/VEGF pathway and their relation to clinical outcome in human cancersActa Oncol201251224324610.3109/0284186X.2011.6367582215011870SinghSKMalikAFirozAJhaVCDKD: a clinical database of kidney diseasesBMC Nephrol2012132310.1186/1471-2369-13-23225402881471-2369-13-23PMC352011771SuzukiHGotohMSugiharaKKitagawaYKimuraWKondoSShimadaMTomitaNNakagoeTHashimotoHBabaHMiyataHMotomuraNNationwide survey and establishment of a clinical database for gastrointestinal surgery in Japan: Targeting integration of a cancer registration system and improving the outcome of cancer treatmentCancer Sci2011102122623010.1111/j.1349-7006.2010.01749.x2096136172ChawlaNVDavisDABringing big data to personalized healthcare: a patient-centered frameworkJ Gen Intern Med201328(suppl 3)S660S66510.1007/s11606-013-2455-82379791273HanYItäläTHämäläinenMCitizen Centric Architecture approach - taking e-health forward by integrating citizens and service providersStud Health Technol Inform2010160Pt 29079112084181674BoussadiACarubaTZapletalESabatierBDurieuxPDegouletPA clinical data warehouse-based process for refining medication orders alertsJ Am Med Inform Assoc201219578278510.1136/amiajnl-2012-00085022523345amiajnl-2012-000850PMC342284275HernandezPPodchiyskaTWeberSFerrisTLoweHAMIA Annu Symp Proc20092014-01-09Automated mapping of pharmacy orders from two electronic health record systems to RxNorm within the STRIDE clinical data warehousehttp://europepmc.org/abstract/MED/20351858/reload=0;jsessionid=4aLVRuWM5ugKTsb134ug.06MVbvtUxj76CuggiaMGarcelonNCampillo-GimenezBBernicotTLaurentJFGarinEHappeADuvauferrierRRoogle: an information retrieval engine for clinical data warehouseStud Health Technol Inform20111695845882189381677ZhouXChenSLiuBZhangRWangYLiPGuoYZhangHGaoZYanXDevelopment of traditional Chinese medicine clinical data warehouse for medical knowledge discovery and decision supportArtif Intell Med2010482-313915210.1016/j.artmed.2009.07.01220122820S0933-3657(09)00105-578ZapletalERodonNGrabarNDegouletPMethodology of integration of a clinical data warehouse with a clinical information system: the HEGP caseStud Health Technol Inform2010160Pt 11931972084167679HanssSSchaafTWetzelTHahnCSchraderTTolxdorffTIntegration of decentralized clinical data in a data warehouse: a service-oriented design and realizationMethods Inf Med200948541441810.3414/ME924019657544924080EvansRSLloydJFPierceLAAMIA Annu Symp Proc20122014-01-09Clinical use of an enterprise data warehousehttp://europepmc.org/abstract/MED/23304288/reload=0;jsessionid=P5NVyPK8BYs9OV0Ra8hg.06MVc6BqLh81HarrisonJHIntroduction to the mining of clinical dataClin Lab Med20082811710.1016/j.cll.2007.10.00118194715S0272-2712(07)00110-282PhanJHQuoCFChengCWangMDMultiscale integration of -omic, imaging, and clinical data in biomedical informaticsIEEE Rev Biomed Eng20125748710.1109/RBME.2012.22124272323199083SinhaAHripcsakGMarkatouMLarge datasets in biomedicine: a discussion of salient analytic issuesJ Am Med Inform Assoc200916675976710.1197/jamia.M278019717808M2780PMC300212884DraiDGrodzinskyYA new empirical angle on the variability debate: quantitative neurosyntactic analyses of a large data set from Broca's aphasiaBrain Lang200696211712810.1016/j.bandl.2004.10.01616115671S0093-934X(05)00116-185BellmanRKalabaRDYNAMIC PROGRAMMING AND STATISTICAL COMMUNICATION THEORYProc Natl Acad Sci U S A195743874975116590080PMC52853286BorthakurDThe Hadoop Distributed File System: Architecture and Design2013-11-252007https://hadoop.apache.org/docs/r0.18.0/hdfs_design.pdf6LOoNyUXR87ChangFDeanJGhemawatSBigtable: A Distributed Storage System for Structured Data2006the 7th USENIX Symposium on Operating Systems Design and Implementation (OSDI’06)2006Seattle, WA, US20521888LittSNoSQL: The Unix Database (With awk)2013-11-252007http://www.troubleshooters.com/lpm/200704/200704.htm6LOp7PTH689van der BurgtYETabanIMKonijnenburgMBiskupMDuursmaMCHeerenRMRömppAvan NieuwpoortRVBalHEParallel processing of large datasets from NanoLC-FTICR-MS measurementsJ Am Soc Mass Spectrom200718115216110.1016/j.jasms.2006.09.00517055738S1044-0305(06)00822-190Stata CorporationStata reference manual : release 6Stata Reference Manual Set, 4vol: Release 61999College Station, TXStata Corp91R Development Core Teamofficial website for R2014-01-08Vienna, AustriaThe R Project for Statistical Computinghttp://www.r-project.org/6MU3hBSqT92BolstadBMIrizarryRAAstrandMSpeedTPA comparison of normalization methods for high density oligonucleotide array data based on variance and biasBioinformatics20031921851931253823893PleilJDStiegelMAMaddenMCSobusJRHeat map visualization of complex environmental and biomarker measurementsChemosphere201184571672310.1016/j.chemosphere.2011.03.01721492901S0045-6535(11)00286-494Garcia-BetancurJCMenendezMCDel PortilloPGarciaMJAlignment of multiple complete genomes suggests that gene rearrangements may contribute towards the speciation of MycobacteriaInfect Genet Evol201212481982610.1016/j.meegid.2011.09.02422008279S1567-1348(11)00354-695AitaTNishigakiKA visualization of 3D proteome universe: mapping of a proteome ensemble into 3D space based on the protein-structure compositionMol Phylogenet Evol201161248449410.1016/j.ympev.2011.06.02021762784S1055-7903(11)00309-596LenzeriniMData Integration: A Theoretical Perspective2002Proceedings of the ACM Symposium on Principles of Database Systems (PODS)2002Roma, Italy23324610.1145/543613.54364497HalevyARajaramanAOrdilleJData integration: the teenage years2006VLDB '06 Proceedings of the 32nd international conference on Very large data bases2006Seoul, Korea91698HaasLMLinETRothMAData integration through database federationIBM Syst. J200241457859610.1147/sj.414.057899ShyuCYtrebergFMReducing the bias and uncertainty of free energy estimates by using regression to fit thermodynamic integration dataJ Comput Chem200930142297230410.1002/jcc.2123119266482100TaylorWGladmanDHelliwellPMarchesoniAMeasePMielantsHCASPAR Study GroupClassification criteria for psoriatic arthritis: development of new criteria from a large international studyArthritis Rheum20065482665267310.1002/art.2197216871531101GschwindRRobertYAnalyse der zeitlichen Veränderungen der Papillen-Reflexion mittels HauptkomponentenanalyseKlin Monatsbl Augenheilkd20081900424910.1055/s-2008-1050370102SantaféGLozanoJALarrañagaPBayesian model averaging of naive Bayes for clusteringIEEE Trans Syst Man Cybern B Cybern20063651149116117036820103FarréJCabreraJARomeroJRubioJMTherapeutic decision tree for patients with sustained ventricular tachyarrhythmias or aborted cardiac arrest: a critical review of the Antiarrhythmics Versus Implantable Defibrillator trial and the Canadian Implantable Defibrillator StudyAm J Cardiol2000869A44K51K11084100S0002914900012911104LisboaPJA review of evidence of health benefit from artificial neural networks in medical interventionNeural Netw2002151113911958484S0893-6080(01)00111-3105ChenHFIn silico log P prediction for a large data set with support vector machines, radial basis neural networks and multiple linear regressionChem Biol Drug Des200974214214710.1111/j.1747-0285.2009.00840.x19549084JPP840106AickinMGenslerHAdjusting for multiple testing when reporting research results: the Bonferroni vs Holm methodsAm J Public Health199686572672810.2105/Ajph.86.5.726107BenderRLangeSAdjusting for multiple testing—when and how?Journal of Clinical Epidemiology200154434334910.1016/S0895-4356(00)00314-0108BrobergPA comparative review of estimates of the proportion unchanged genes and the false discovery rateBMC Bioinformatics2005619910.1186/1471-2105-6-199160868311471-2105-6-199PMC1199583109van der LaanMJDudoitSPollardKSMultiple testing. Part II. Step-down procedures for control of the family-wise error rateStat Appl Genet Mol Biol2004310.2202/1544-6115.1041110SandersCMSaltzsteinSLSchultzelMMNguyenDHStaffordHSSadlerGRUnderstanding the limits of large datasetsJ Cancer Educ201227466466910.1007/s13187-012-0383-722729362111DermanEModelsModels.Behaving.Badly. Why Confusing Illusion with Reality Can Lead to Disaster, on Wall Street and in Life2012New York, New YorkFree Press112KobayashiTKishimotoMSwearingenCJFilopoulosMTOharaYTokudaYOshikawaHYoshidaKUtsunomiyaMKimuraMOkadaMMatsuiKYaziciYDifferences in clinical manifestations, treatment, and concordance rates with two major sets of criteria for Behçet's syndrome for patients in the US and Japan: data from a large, three-center cohort studyMod Rheumatol201323354755310.1007/s10165-012-0696-822752504113JacobsAThe pathologies of big dataCommun ACM20095283610.1145/1536616.1536632