Published on 25.10.14 in Vol 2, No 2 (2014): Jul-Dec
Design and Development of a Linked Open Data-Based Health Information Representation and Visualization System: Potentials and Preliminary Evaluation
Background: Healthcare organizations around the world are challenged by pressures to reduce cost, improve coordination and outcome, and provide more with less. This requires effective planning and evidence-based practice by generating important information from available data. Thus, flexible and user-friendly ways to represent, query, and visualize health data becomes increasingly important. International organizations such as the World Health Organization (WHO) regularly publish vital data on priority health topics that can be utilized for public health policy and health service development. However, the data in most portals is displayed in either Excel or PDF formats, which makes information discovery and reuse difficult. Linked Open Data (LOD)—a new Semantic Web set of best practice of standards to publish and link heterogeneous data—can be applied to the representation and management of public level health data to alleviate such challenges. However, the technologies behind building LOD systems and their effectiveness for health data are yet to be assessed.
Objective: The objective of this study is to evaluate whether Linked Data technologies are potential options for health information representation, visualization, and retrieval systems development and to identify the available tools and methodologies to build Linked Data-based health information systems.
Methods: We used the Resource Description Framework (RDF) for data representation, Fuseki triple store for data storage, and Sgvizler for information visualization. Additionally, we integrated SPARQL query interface for interacting with the data. We primarily use the WHO health observatory dataset to test the system. All the data were represented using RDF and interlinked with other related datasets on the Web of Data using Silk—a link discovery framework for Web of Data. A preliminary usability assessment was conducted following the System Usability Scale (SUS) method.
Results: We developed an LOD-based health information representation, querying, and visualization system by using Linked Data tools. We imported more than 20,000 HIV-related data elements on mortality, prevalence, incidence, and related variables, which are freely available from the WHO global health observatory database. Additionally, we automatically linked 5312 data elements from DBpedia, Bio2RDF, and LinkedCT using the Silk framework. The system users can retrieve and visualize health information according to their interests. For users who are not familiar with SPARQL queries, we integrated a Linked Data search engine interface to search and browse the data. We used the system to represent and store the data, facilitating flexible queries and different kinds of visualizations. The preliminary user evaluation score by public health data managers and users was 82 on the SUS usability measurement scale. The need to write queries in the interface was the main reported difficulty of LOD-based systems to the end user.
Conclusions: The system introduced in this article shows that current LOD technologies are a promising alternative to represent heterogeneous health data in a flexible and reusable manner so that they can serve intelligent queries, and ultimately support decision-making. However, the development of advanced text-based search engines is necessary to increase its usability especially for nontechnical users. Further research with large datasets is recommended in the future to unfold the potential of Linked Data and Semantic Web for future health information systems development.
JMIR Med Inform 2014;2(2):e31
- Linked Open Data;
- Semantic Web;
- health information systems;
- public health;
- public health informatics;
Information is a foundation for effective decision-making. This information need is even more critical in public health organizations to support areas such as epidemiologic surveillance, health outcome assessment, program evaluation and performance measurement, public health planning, and policy analysis . In order to satisfy this, we need better and more flexible health data representation, analysis, querying, and visualization methods. The amount of available online health data both in structured and unstructured formats is constantly increasing. The World Health Organization (WHO), for example, has established a data repository providing access to over 50 datasets on priority health topics including mortality and prevalence of human immunodeficiency virus infection/acquired immunodeficiency syndrome (HIV/AIDS) in different WHO regions [ ]. Moreover, the United Nations [ ] and the Centers for Disease Control and Prevention (CDC) [ ] have online data repositories on the different indicators for different countries.
While these are important initiatives to publish health data online, there has been relatively little attention paid to data representation methods in most health data portals so far . Current data representation and distribution methods with only tabular formats, such as comma-separated values (CSV), PDF, and Excel—and little metadata—makes health information integration, comparison, and reuse very difficult. Additionally, even though different indicators have relationships to each other, the datasets are not linked in most portals. Vocabularies and data formats are inconsistent, which makes finding, assembling, and normalizing these datasets time consuming and prone to errors [ ].
Exploiting the different kinds of public health information about a given topic is a challenging task because data is spread across different platforms in heterogeneous formats. Better data management methods and tools are required to move from a Web of documents, only understandable by human users, to a Web of Data in which information is expressed in a format that can be read and used by machines. This would enable us to find, share, and integrate information more easily .
Linked Data, as explained by Tim Berners-Lee , is a method to publish structured data by using standard Web technologies to connect related data and make them accessible on the Web. The Linked Data publishing pattern uses HTTP uniform resource identifiers (URIs) for identifying data items, the Resource Description Framework (RDF) for describing data, and links to describe the relationships. Other standards used in Linked Open Data (LOD) applications include Resource Description Framework Schema (RDFS) for describing RDF vocabularies, and SPARQL Protocol and RDF Query Language (SPARQL) for querying RDF graphs [ ].
The primary goal of the Linked Data initiative is to make the World Wide Web (WWW) not only useful for interlinking documents, but also for sharing and interlinking data . The movement is driven by the hypothesis that these technologies could revolutionize global data sharing, integration, and analysis, just like the classic Web-revolutionized information sharing and communication over the last two decades. However, to our knowledge there are not many studies on the potential of LOD for public health data management.
Motivated by the universal hypothesis of Linked Data to revolutionize data sharing, integration, and analysis, the main objectives of this work are (1) to test the potential of LOD for health data representation and visualization, (2) to identify the available technologies and tools for Linked Data-based health information system development, and (3) to evaluate the usability level of LOD-based systems by end users.
In this paper, we present the development of the system from data modeling to visualization and potential LOD tools available for development. Identifying the tools and testing the potential of LOD will be helpful as an input to the health informatics and Semantic Web community in the research effort to find ways to represent data in a flexible manner.
Our methodology was “Integration-oriented development and evaluation” in the sense that we used the available LOD tools to develop the system and then we reflected on the development process, the potentials, and finally on usability for end users. We gave special emphasis to the data management process as efficient data management and conversion is the backbone of the LOD-based system development . We used the RDF for data representation, Fuseki triple store for data storage, and Sgvizler for information visualization. Additionally, we integrated a SPARQL query interface for interacting with the data. We primarily used the WHO health observatory dataset to test the system. All the data were represented using RDF and interlinked with other related datasets on the Web of Data using Silk [ ], a link discovery framework for Web of Data. A preliminary usability assessment was conducted following the System Usability Scale (SUS) method. The final revised SUS questionnaire used for the evaluation is shown in . The details, with more focus on the data management process, are explained throughout this paper.
Data Modeling and Conversion
Shared vocabularies are a key to enable interoperability in healthcare systems by providing an agreed-upon terminology that can be looked up through URIs that cannot be referenced . We have identified potential health, statistical, spatial, and time vocabularies and ontologies to share the data in a reusable way and then mapped them to the external ontologies using predicates (see ). We used the common RDF [ ], RDFS [ ], Web Ontology Language (OWL) [ ], friend of a friend (FOAF) [ ], and Data Cube [ ] vocabularies for data annotation. Those are standard vocabularies to represent data in LOD by expressing relationships between the data. We use the Data Cube vocabulary for all the statistical data to represent, not only the numbers, but also advanced metadata with space and time dimensions of the observation. Some of the standard predicates were replaced with more generic elements from the Data Cube vocabulary (eg, qb:prevalence instead of qb:observation) to make them more understandable to health professionals and healthcare managers. We assume that using some of the terms that are already known by health professionals will make the system more usable and easily adaptable. After identifying the ontologies and vocabularies, the original data was converted in a semi-automated way to avoid information loss. Conversion using Excel2RDF is done by selecting the range of data values and headers from the spreadsheet that are to be converted. Then, the headers are fed into the mapping wizard, which assists the mappings of row/column concepts to RDF vocabularies. Excel data triplication using Excel2RDF is discussed by Pesce et al [ ].
|prefix MeSH||Interlinked with <owl:sameAs>|
|prefix Diseasome||Interlinked with <owl:sameAs>|
|Prefix geo||geo:lat, geo:long|
|prefix qb||qb:prevalence qb:slice qb:item|
|prefix scovo||qb:prevalence qb:slice qb:item|
|Time series||prefix time||Time: year ( from 1990-2010)|
The main difference between existing health information system development and Linked Data-based systems is the way data is represented and stored. Current systems mostly use tabular formats (eg, Excel, CSV) or relational database systems such as Oracle. Linked Data-based systems, however, usually build on triple stores as their main data storage. This triple-based representation enables integration of data available from various sources without the need for physical storage of the RDF triple that corresponds to the relational data . These systems provide data management and data access via application programming interfaces (APIs) and query languages to RDF data. For this work, we used the Fuseki triple store [ ]. It provides representational state transfer (REST)-style SPARQL HTTP Update, SPARQL Query, and SPARQL Update using the SPARQL protocol over HTTP [ ].
The primary intention of representing health data using the LOD approach is to be able to discover and link health data from different sources and use them in new applications. Interlinking data from our RDF datasets to other datasets, which are already in the LOD cloud, was challenging. It requires identification of similar link types in our datasets, and then finding suitable matching links in external datasets. Zevari et al point out similar challenges in link discovery in health datasets .
We developed a Linked Open Health Data (LOHD) system that integrates spatial and statistical health data from various sources. In the system, users can query HIV-related information about African countries and the system will support them in querying and visualizing the data in both space and time.
LOHD System Architecture
For the system development, we preferred a multilayer architecture, which provides flexibility and reusability. For example, data management, query processing, and visualization are logically separate processes. The advantages of a multilayer architecture have been discussed in the literature in detail [- ]. By breaking up the system into a hierarchy, different layers can be developed sequentially and modified asynchronously without affecting the entire system architecture [ ]. The architecture of our system is composed of 4 main layers (see ): (1) the data layer, (2) the transformation layer, (3) the service layer, and (4) the presentation layer. The data layer stores the converted and interlinked data. The transformation layer is the processing layer where every SPARQL query is processed using crawling pattern to localize data from the Web of Linked Data. The service layer controls the data access and bridges the client to the server via service protocols. The presentation layer allows the users to interact with the services using either retrieval or visualization tools. All the system architecture layers and the underlying LOD application tools are shown in .
Coherent LOD visualizations enable nontechnical users to use the Web of Data  and increase the usability and accessibility of Linked Data-based systems [ ]. In most Linked Data-based systems, the user is expected to write SPARQL queries, which is challenging for nontechnical users. To overcome those challenges, we integrate a live visualization interface using Sgvizler. Once the query is selected, the users have the option to choose the visualization method for the data output. All the visualization methods available on Sgvizler are supported by our system. In the following sample queries, we show some of the visualizations based on spatial or temporal queries.
Time Series Visualization of Linked Data
Time series visualizations help to display patterns and trends that are not readily apparent in the numbers themselves. In traditional databases, time series visualization is mostly done by external applications which are cumbersome and time consuming. But in Linked Data-based systems, you can write your query and choose the visualization type from the drop-down menu.shows the trend of HIV prevalence in Ethiopia, as an example, and the system automatically shows the live visualization of the trend for the requested year.
Geographical Visualization of Linked Data
Location is becoming a basic attribute for health data . Location-based visualizations are mostly difficult using traditional databases unless they are exported to geographic information system (GIS) software for further analysis. In LOD-based systems, location-based visualizations are facilitated by the ability to write queries and choose the visualization method. shows an example where the visualization shows the prevalence of HIV based on each country’s location on the African map. When someone clicks on the icon of the country, it will show the basic information about the country and the trend of HIV for the specified time period in the query.
Indicator-Based Visualization of Linked Data
Indicators are the basic components of any health data. Most international disease prevalence comparisons and local-level reporting are done using indicators in a specific period of time. LOD-based systems support queries with different indicators—such as HIV prevalence rate by country or region, antiretroviral therapy (ART) coverage rate, population or gross domestic product (GDP)—and make a correlation analysis between those variables over time. In, we show a 3-dimensional correlation analysis with time series animation.
The system was evaluated in a small-scale user study to get feedback from healthcare data managers and users regarding the usability and learnability of the system. A total of 19 participants were selected for this evaluation, both with a technical and nontechnical background. The participants had no relationship with the investigator and the selection was done purposefully to ensure we recruited participants who currently work on health data management, and to get a proportional mix of different professions. Of the 19 selected participants, 17 of them responded to the questionnaire (89%). The technical participants (9/17, 53%) were data managers with IT backgrounds, health information system developers, and system administrators in different healthcare organizations in Africa. The nontechnical participants (8/17, 47%) were public data users, such as demographic data managers, doctors, and public health professionals. The evaluation was done based on the SUS with some wording amended, tailored for our participants (see). In the evaluation, we were interested in the feedback from the participants on the query-based data access. The Linked Data search engine was not provided to participants, given its early stage of development for complex query request. The SUS is mostly regarded as a quick and easy way to conduct a usability assessment [ ]. Even though the tool is self-described as “quick and dirty”, it has been evaluated in many studies (more than 600 articles) as valid and reliable [ ]. Based on the SUS scoring criteria, the final calculated score was 82, which is well above the average SUS score of 68. summarizes the evaluation responses for each criteria of the system usability.
Additionally, 2 open-ended questions were asked to the users to better understand their views and their specific requirements for using the system. The frequent answers for those questions can be explained by dividing them into 2 groups. The participants with technical backgrounds were relatively happy and 8 out of 9 (89%) of them mentioned that such systems would be useful in the future. The nontechnical participants (8/8), however, mentioned that the system was not easy to use. This is understandable seeing that the current Linked Data tools demand writing queries. Publishing the data in machine-understandable form and making live visualization without having to use external applications were the most frequently mentioned benefits of the system by the participants of the evaluation (15/17, 88%). The need to write queries in the optional interface and identifying the appropriate visualization tool were reported as being the difficult aspects of such systems by 16 of the 17 (94%) participants.
|SUS evaluation criteria||Strongly agree, n (%)||Agree, n (%)||Neutral, n (%)||Disagree, n (%)||Strongly disagree, n (%)|
|I think that I would like to access my data this way.||10 (59)||3 (18)||-||4 (24)||-|
|I found the system unnecessarily complex.||2 (12)||5 (29)||-||10 (59)||-|
|I thought the system was easy to use.||4 (24)||5 (29)||-||7 (41)||1 (6)|
|I think that I would need the support of a technical person to be able to use this system.||6 (35)||1 (6)||-||7 (41)||3 (18)|
|I found the various functions in this system well integrated.||12 (71)||2 (12)||-||3 (18)||-|
|I thought there was too much inconsistency in this system.||3 (18)||2 (12)||-||10 (59)||1 (6)|
|I would imagine that most people would learn to use this system very quickly.||6 (35)||1 (6)||2 (12)||6 (35)||3 (18)|
|I found the system very cumbersome to use.||4 (24)||2 (12)||-||11 (65)||1 (6)|
|I felt very confident using the system.||12 (71)||-||-||5 (29)||-|
|I needed to learn a lot of things before I could get going with this system.||7 (41)||1 (6)||-||9 (53)||-|
We developed a Linked Data-based health information representation, querying, and visualization system. We used the system to represent and store the data, facilitating flexible queries and different kinds of visualizations. There are other ongoing efforts to convert healthcare- and life science-related datasets to a Linked Data cloud such as Linked Open Drug Data (LODD), LinkedCT, Open Biomedical Ontologies (OBO), and the World Wide Web Consortium’s (W3C) Health Care and Life Sciences working groups [, ]. Thanks to such initiatives and recently developed Semantic Web tools, converting data to RDF has become straightforward. However, just converting the data to RDF and publishing it online is not enough [ , ]. The main difficulty is to integrate the data representation methods to application-level tools and make them usable for health information consumers in a shared, semantically meaningful, easily discoverable, and reusable manner.
In our system, we represented the health data with its important dimensions—magnitude, time, and space—in the form of RDF and we used both manual and automatic interconnection methods to enrich the data. We integrated visualization and retrieval methods for the data to make data visualization and retrieval possible with already available tools. There was a similar initiative by Zappa et al to integrate mutation data in the LOD cloud . The methodology we follow for development is similar except that they use another tool for the data conversion. What makes our work different is that in addition to converting the data and making it available in RDF, we focus on integrating additional query and visualization interface tools to make the system more usable, especially for nontechnical users.
Our system development method was integration oriented in the sense that it reflects the way to convert the different dimensions of the data to Linked Data and integrate them with already developed tools, enabling the system to support information access. In selecting our tools, we found out that RDF is currently a robust data model to represent data with metadata [, ] that gives the opportunity of integrating data and availing data for query. Our selection of Sgvizler for visualization was motivated by its current support of different types of visualization and its integration with HTML webpages by letting the user specify queries of interest [ ]. One of the difficulties we noticed here is that for complex queries, Sgvizler is relatively slow. This may make it difficult to use for big data and complex query-based systems. Nonetheless, we believe that advanced-level, live correlation visualization of certain disease trends in space and time dimensions from different sources is one of the biggest promises of Linked Data-based systems in the future.
Measuring the degree of advancement that a Linked Data representation brings to public health data is difficult to quantify. Nonetheless, from the technology perspective, the data becomes search engine discoverable and machine understandable, which addresses the main issues of the current health data silos problem . While Linked Data and Semantic Web technologies are not as mature as other database technologies, they present a promising alternative in public health information portal development. A good example that can explain this is the data representation scheme in the World Bank database [ ], which includes both a portal for downloading data as Excel or PDF files, as well as a Linked Data version for downloading the data as RDF with the ability to query their endpoints. The main advantage of having Linked Data as an additional option in the World Bank database can be seen in the results of search engine results. If you input “Prevalence of HIV in Egypt” and “GDP of Egypt” into search engines, we can clearly see the data representation limitation of health portals. Since the World Bank data is represented in a machine-understandable and search engine-discoverable way, you can see the graphs and additional descriptions, which are very useful for an end user searching for them.
The user evaluation of our system confirms the existing usability limitations of Linked Data mentioned by different authors [, , , , ]. Linked Data is currently mostly used by the Semantic Web community and other users with a strong technical background. To make the Linked Data-based systems more usable by end users, we need to develop enhanced tools that can avoid the need to write queries.
In our evaluation, 41% (7/17) of the participants (strongly agree and agree together) reported that they need the support of a technical person to use this system, which is high when compared to other system evaluations [, ]. Yet this is an expected result given the current technical nature of data access in LOD when using queries. The promising result from the evaluation is that 70% (12/17) of the participants are confident in using and understanding the visualizations of the system. This indicates that the LOD-based representation of public health data offers a new perspective in the future of health data portal development.
There are some limitations in this work. Primarily, the amount of data we used is small to generalize the robustness of the LOD tools. As already outlined in different studies [- ] Semantic Web technologies work well with small datasets but might not be the best option with big datasets. Secondly, our user evaluation was based on a small set of participants and the SUS scale, which has its own limitations, making generalization of the usability assessment result difficult.
For future research we recommend integrating and testing an advanced-level search engine to ensure that LOD-based systems are more usable outside the Semantic Web community. Additionally, implementing and testing a similar system with a big dataset by describing the data more robustly with domain-specific, additional ontological vocabularies, interlinking with more ontologies, and including more visualization options for grouped data is recommended. Moreover, implementation of advanced-level correlation analysis visualization from different sources will make LOD technology more interesting and usable by healthcare professionals.
The system introduced in this article shows that LOD has a promising potential in the representation of complex health-related data. This is mainly due to its reusable and interoperable manner that can serve intelligent queries, and ultimately support decision-making. However, the development of advanced LOD search engines is necessary to increase its usability.
We thank the WHO for publishing the data online and for making it freely available. We also want to thank the participants of the evaluation and the anonymous reviewer who gave us important comments for the improvement of the paper.
BT developed and implemented the system, guided the evaluation and wrote the manuscript. CK and TK contributed to the study design and in critically revising the manuscript. FF contributed to the manuscript design and to the critical evaluation of the manuscript. All authors read and approved the final manuscript.
Conflicts of Interest
Multimedia Appendix 1
Final revised SUS questionnaire for the evaluation.PDF File (Adobe PDF File), 102KB
- Studnicki J, Berndt DJ, Fisher JW. Using information systems for public health administration. In: Novick LF, Morrow CB, Mays GP, editors. Public Health Administration: Principles for Population-Based Management. 2nd edition. Sudbury, MA: Jones and Bartlett; 2008:353-380.
- World Health Organization. 2011. Global Health Observatory URL: http://www.who.int/gho/database/en/ [accessed 2014-04-15] [WebCite Cache]
- UNAIDS. 2012. UNAIDS HIV database and visualization URL: http://www.unaids.org/en/dataanalysis/ [accessed 2014-04-15] [WebCite Cache]
- Centers for Disease Control and Prevention. 2012. HIV/AIDS database URL: http://www.cdc.gov/hiv/statistics/basics/ [accessed 2014-04-15] [WebCite Cache]
- Gao S, Mioc D, Yi X, Anton F, Oldfield E, Coleman DJ. Towards Web-based representation and processing of health information. Int J Health Geogr 2009;8:3 [FREE Full text] [CrossRef] [Medline]
- Battista ADL, Villanueva-Rosales N, Palenychka M, Dumontier M. SMART: A Web-based, ontology-driven, Semantic Web query answering application. In: Proceedings of the Semantic Web Challenge. Spain: CEUR Workshop Proceedings; 2007 Presented at: Semantic Web Challenge; November 13, 2007; Busan, South Korea URL: http://ceur-ws.org/Vol-295/paper17.pdf
- Berners-Lee T. World Wide Web Consortium. 2009. Linked data URL: http://www.w3.org/DesignIssues/LinkedData.html [accessed 2014-08-04] [WebCite Cache]
- Hitzler P, Janowicz K. Linked data, big data, and the 4th paradigm. Semant Web 2013;4(3):233-235 [FREE Full text]
- Bizer C, Heath T, Berners-Lee T. Linked data - the story so far. Int J Semant Web Inf Syst 2009 Feb 12;5(3):1-22 [FREE Full text] [CrossRef]
- Gür N, Sanchez LD, Kauppinen T. GI systems for public health with an ontology-based approach. In: Proceedings of the AGILE'2012 International Conference on Geographic Information Science. 2012 Presented at: AGILE'2012 International Conference on Geographic Information Science; April 24-27, 2012; Avignon, France p. 86-91 URL: http://www.agile-online.org/Conference_Paper/CDs/agile_2012/proceedings/papers/Paper_Guer_GI_Systems_for_Public_Health_with_an_Ontology_Based_Approach_2012.pdf
- Isele R, Jentzsch A, Bizer C, Volz J, Petrovski P. University of Mannheim. Silk: A link discovery framework for the Web of Data URL: http://wifo5-03.informatik.uni-mannheim.de/bizer/silk/ [accessed 2014-08-04] [WebCite Cache]
- Mohammad. GitHub. 2013 Jun 04. Excel2rdf plugin URL: https://github.com/waqarini/excel2rdf [accessed 2014-05-08] [WebCite Cache]
- Tao C, Jiang G, Wei W, Solbrig HR, Chute CG. Towards Semantic Web-based representation and harmonization of standard meta-data models for clinical studies. AMIA Jt Summits Transl Sci Proc 2011;2011:59-63 [FREE Full text] [Medline]
- World Wide Web Consortium.: RDF Working Group; 2011. Resource description framework (RDF) URL: http://www.w3.org/RDF/ [accessed 2014-05-08] [WebCite Cache]
- Schema.org. 2012. What is Schema.RDFS.org? URL: http://schema.rdfs.org/ [accessed 2014-05-08] [WebCite Cache]
- World Wide Web Consortium. 2013. OWL Web ontology language current status URL: http://www.w3.org/standards/techs/owl [accessed 2014-08-04] [WebCite Cache]
- xmlns.com. 2014 Jan 14. FOAF vocabulary specification 0.99 URL: http://xmlns.com/foaf/spec/ [accessed 2014-05-08] [WebCite Cache]
- Tennison J. World Wide Web Consortium. 2014 Jan 16. RDF data cube vocabulary URL: https://github.com/waqarini/excel2rdf [accessed 2014-10-15] [WebCite Cache]
- Pesce ML, Breitman KK, Casanova MA. Surfacing scientific and financial data with the Xcel2RDF plug-in. In: 2nd Workshop on Developing Tools as Plug-Ins (TOPI).: IEEE; 2012 Presented at: IEEE Conference on Developing Tools as Plug-Ins (TOPI); June 3, 2012; Zurich, Switzerland p. 73-78. [CrossRef]
- Oracle Spatial and Graph RDF Semantic Graph Developer's Guide. 2013. 10 RDF views: relational data as RDF URL: http://docs.oracle.com/database/121/RDFRM/sem_relational_views.htm [accessed 2014-08-04] [WebCite Cache]
- Apache Jena. 2013. Fuseki: serving RDF data over HTTP URL: http://jena.apache.org/documentation/serving_data/ [accessed 2014-05-08] [WebCite Cache]
- Hu Y, Janowicz K, McKenzie G, Sengupta K, Hitzler P. A Linked-Data-driven and semantically-enabled journal portal for scientometrics. Lecture Notes in Computer Science 2013;8219:114-129. [CrossRef]
- Zaveri A, Lehmann J, Auer S, Hassan MM, Sherif MA, Martin M. Publishing and interlinking the Global Health Observatory dataset: towards increasing transparency in global health. Semant Web 2012;1.
- Callahan A, Cruz-Toledo J, Dumontier M. Ontology-based querying with Bio2RDF's Linked Open Data. J Biomed Semantics 2013 Apr 15;4 Suppl 1:S1 [FREE Full text] [CrossRef]
- Hassanzadeh O, Kementsietsidis A, Lim L, Miller RJ, Wang M. LinkedCT: A linked data space for clinical trials. The Computing Research Repository (CoRR) 2009 Aug 04;abs/0908.0.
- Yamamoto Y, Yamaguchi A, Yonezawa A. Building Linked Open Data towards integration of biomedical scientific literature with DBpedia. J Biomed Semantics 2013;4(1):8 [FREE Full text] [CrossRef] [Medline]
- Jentzsch A, Isele R, Bizer C. Silk: Generating RDF links while publishing or consuming Linked Data. In: CEUR Workshop Proceedings. 2010 Presented at: International Semantic Web Conference; November 9, 2010; Shanghai, China.
- Skjæveland MG. Data 2000. Sgvizler URL: https://code.google.com/p/sgvizler/ [accessed 2014-05-08] [WebCite Cache]
- Brunetti JM, Auer S, García R. The Linked Data Visualization Model. In: CEUR Workshop Proceedings. 2012 Presented at: International Semantic Web Conference; November 11-15, 2012; Boston, USA.
- Kopanitsa G, Hildebrand C, Stausberg J, Englmeier KH. Visualization of medical data based on EHR standards. Methods Inf Med 2013;52(1):43-50. [CrossRef] [Medline]
- Andes N, Davis JE. Linking public health data using geographic information system techniques: Alaskan community characteristics and infant mortality. Stat Med 1995;14(5-7):481-490. [Medline]
- Sauro J. MeasuringU. Denver, CO; 2011 Feb 02. Measuring usability with the System Usability Scale (SUS) URL: http://www.measuringusability.com/sus.php [accessed 2014-05-08] [WebCite Cache]
- Mazumdar S, Petrelli D, Ciravegna F. Exploring user and system requirements of Linked Data visualization through a visual dashboard approach. Semant Web 2011 Nov 20:1-18.
- Zappa A, Splendiani A, Romano P. Towards linked open gene mutations data. BMC Bioinformatics 2012;13 Suppl 4:S7 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G. The Semantic Web and healthcare consumers: a new challenge and opportunity on the horizon? IJHTM 2003;5(3/4/5):194-212. [CrossRef]
- Reynolds D. World Wide Web Consortium. 2010. Data Cube implementations URL: http://www.w3.org/2011/gld/wiki/Data_Cube_Implementations [accessed 2014-08-04] [WebCite Cache]
- Semple H, Qin H, Sasson C. Development of a Web GIS application for visualizing and analyzing community out of hospital cardiac arrest patterns. Online J Public Health Inform 2013;5(2):212 [FREE Full text] [CrossRef] [Medline]
- World Bank Linked Data. 2013. Observations in World Bank URL: http://worldbank.270a.info/view [accessed 2014-08-04] [WebCite Cache]
- Samwald M, Jentzsch A, Bouton C, Kallesøe CS, Willighagen E, Hajagos J, et al. Linked open drug data for pharmaceutical research and development. J Cheminform 2011 May 16;3(1):19 [FREE Full text] [CrossRef] [Medline]
- Bukhari AC, Baker CJO. The Canadian health census as Linked Open Data: towards policy making in public health. 2013 Presented at: 9th International Conference on Data Integration in the Life Sciences; July 11-12, 2013; Montreal, PQ URL: http://www2.unb.ca/csas/data/ws/dils2013/papers/DILS-SYS-EC-paper3.pdf
- Pathak J, Kiefer RC, Chute CG. The linked clinical data project: applying Semantic Web technologies for clinical and translational research using electronic medical records. In: Proceedings of the 4th International Workshop on Semantic Web Applications and Tools for the Life Sciences. New York, NY, USA: ACM; 2012 Presented at: 4th International SWAT4LS Workshop; December 7-9, 2011; London, UK p. 94-95 URL: http://www.jbiomedsem.com/content/3/1/10 [CrossRef]
- Tao C, Jiang G, Oniki TA, Freimuth RR, Zhu Q, Sharma D, et al. A Semantic-Web oriented representation of the clinical element model for secondary use of electronic health records data. J Am Med Inform Assoc 2013 May 1;20(3):554-562 [FREE Full text] [CrossRef] [Medline]
|API: application programming interface|
|ART: antiretroviral therapy|
|CDC: Centers for Disease Control and Prevention|
|FOAF: friend of a friend|
|GDP: gross domestic product|
|GIS: geographic information system|
|LOD: Linked Open Data|
|OWL: Web Ontology Language|
|RDF: Resource Description Framework|
|RDFS: Resource Description Framework Schema|
|REST: representational state transfer|
|SPARQL: SPARQL Protocol and RDF Query Language|
|SUS: System Usability Scale|
|UMLS: Unified Medical Language System|
|URI: uniform resource identifier|
|W3C: World Wide Web Consortium|
|WHO: World Health Organization|
Edited by I Buchan; submitted 10.05.14; peer-reviewed by N Peek; comments to author 08.07.14; revised version received 04.08.14; accepted 23.08.14; published 25.10.14
©Binyam Tilahun, Tomi Kauppinen, Carsten Keßler, Fleur Fritz. Originally published in JMIR Medical Informatics (http://medinform.jmir.org), 25.10.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.