This article has Open Peer Review reports available.
RMS: a platform for managing cross-disciplinary and multi-institutional research project collaboration
© Luo et al.; licensee BioMed Central Ltd. 2014
Received: 19 May 2014
Accepted: 3 November 2014
Published: 30 November 2014
Cross-institutional cross-disciplinary collaboration has become a trend as researchers move toward building more productive and innovative teams for scientific research. Research collaboration is significantly changing the organizational structure and strategies used in the clinical and translational science domain. However, due to the obstacles of diverse administrative structures, differences in area of expertise, and communication barriers, establishing and managing a cross-institutional research project is still a challenging task. We address these challenges by creating an integrated informatics platform to reduce the barriers to biomedical research collaboration.
The Request Management System (RMS) is an informatics infrastructure designed to transform a patchwork of expertise and resources into an integrated support network. The RMS facilitates investigators’ initiation of new collaborative projects and supports the management of the collaboration process. In RMS, experts and their knowledge areas are categorized and managed structurally to provide consistent service. A role-based collaborative workflow is tightly integrated with domain experts and services to streamline and monitor the life-cycle of a research project. The RMS has so far tracked over 1,500 investigators with over 4,800 tasks. The research network based on the data collected in RMS illustrated that the investigators’ collaborative projects increased close to 3 times from 2009 to 2012. Our experience with RMS indicates that the platform reduces barriers for cross-institutional collaboration of biomedical research projects.
Building a new generation of infrastructure to enhance cross-disciplinary and multi-institutional collaboration has become an important yet challenging task. In this paper, we share the experience of developing and utilizing a collaborative project management system. The results of this study demonstrate that a web-based integrated informatics platform can facilitate and increase research interactions among investigators.
KeywordsBiomedical research Organization & administration Research collaboration System design and development Collaborative research Communication networks Systems integration Data-driven analysis
A recent study on 19.9 million scientific publications shows that team science is dominating knowledge production compared to solo authors . Hall et al. compared trans-disciplinary center grants with investigator-initiated grants and discovered that trans-disciplinary grants have a higher publication rate and more coauthors . Cross-disciplinary collaboration is one of the key components of team science –. A longitudinal study revealed that research collaboration not only effectively promoted more research output, but also significantly correlated to the quality of papers . Another study also discovered that lack of cross-disciplinary collaboration was a significant barrier to clinical outcome research . Several emerging areas in the biomedical science domain, including Clinical Research Informatics , and Medicine 2.0 , have identified collaboration as one of the key driving factors of successful research.
Having realized the importance of research collaboration, research agencies have gradually begun supporting more and more projects that are capable of bringing together experts from multiple disciplines and of exerting broader impact to multiple domains ,. The National Institutes of Health (NIH) Roadmap  established new aims to improve Biomedical Research, in which the Clinical and Translational Science Awards (CTSA)  program is the most important feature. One strategic goal  for creating the CTSA program was to bridge the gaps between different disciplines and remove barriers to communication, which can increase the efficiency of collaboration between the basic science researcher, clinical scientist and practicing physician. Cleveland’s CTSA, the Clinical and Translational Science Collaborative (CTSC), was an early recipient of the NIH funding for the CTSA award. The consortium is actively involved in building infrastructure to support clinical and translational research at the Case Western School of Medicine, the Cleveland Clinic, University Hospitals Case Medical Center, MetroHealth Systems, and the Louis Stokes VA Medical Center and has had a positive impact on many aspects of the affiliated institutions . The CTSC designates Research Concierge Services (RCS) as the entry point for accessing the resources and expertise within the CTSC as well as externally. The goal of the RCS is to assist investigators navigating the cross-disciplinary research process and to provide consultation support at each phase of clinical and translational research. However, like many multi-institutional organizations, the CTSC has a complex five-partner structure and so faces challenges with respect to coordinating the experts and resources located at different sites for collaborative research.
The RCS discussed the challenges with experts of the CTSC Biomedical Research Information Management (BRIM) Core which has a special focus on providing informatics infrastructure and developing computerized tools and systems to support the multi-faceted clinical and translational research. The BRIM and the RCS found that there was a strong need for an informatics platform that can systematically tackle the management challenges of collaborative projects. Four major requirements were identified as desirable for reducing the barriers to collaborative research projects.
The first requirement is integrating institutional resources and expertise to support research project development and enable collaboration. For example, the BERD core (Biostatistics, Epidemiology, and Research Design Core), comprising experts in epidemiology and biostatistics across partner institutions, provides support for the development of research protocols and statistical analysis plans. It is not always easy to access these resources due to the diverse expertise, constant changes, disparate locations and various administration structures. Furthermore, many investigators may not be aware of the range of services provided by the CTSC cores. Hence there is a strong need to aggregate the services in an informatics system so that investigators can search and acquire collaborative expertise easily.
The second requirement is to streamline the process of obtaining expert support and technological consultations. When investigators are conducting new research projects, they often need help from other experts; for example, they may need to consult the Bioethics Offices about on ethical regulations and before designing a statistics plan with the BERD core. Coordinating the efforts of different experts and following up on the progress of several threads is time-consuming and often requires sophisticated project management skills. Our goal is to reduce such barriers by implementing a streamlined workflow to allow the creation, monitoring, and discussion of collaborative projects even when the collaborators come from different cores or are located at different CTSC sites.
Third, as the “front door” to accessing the resources and expertise, the RCS requires an informatics system that can manage the roles of CTSC members and monitor the status of research projects. The RCS is responsible for many administrative tasks, such as helping investigators initialize collaboration with experts, describing the projects to collaborators, assigning participant roles, and tracking the status of ongoing projects. This infrastructure required a system designed with sophisticated project administration functionalities, such as authorizing experts according to their expertise and responsibilities and monitoring the progresses of projects.
Last, the ability to analyze project performance and report core activities located at many different sites to the CTSC leaders is a challenging task. Senior leaders of the institutions need evidence-based evaluation based on accurately documented project data. It is important to maintain a research project repository that can be used to summarize the activities, analyze resource usage, and predict trends. These types of information would greatly improve the evaluation process and provide a more global view of research activities for the CTSC leadership in important decision making, such as resource allocation.
The system infrastructure of the RMS platform is illustrated in Figure 1. We chose open-source technologies to support platform development and Ruby on Rails  was chosen as the programming language for the project.
Users access all the RMS functionalities through a one-stop web portal (See Figure 1-A). The portal provides an interactive interface , using Ajax  technology for both project management and system administration. The rich internet application (RIA) techniques are capable of providing services through the web browser without the user having to download and install software packages. To support new investigators who are not familiar with the system, two instruction manuals (see Notes section) are provided at the portal entrance. Two user manuals are provided: 1) a User Instruction Manual to describe the functions of RMS, and 2) a Quick Start Guide to illustrate the process of submitting the first request to registered domain experts.
Through a layer of RESTful web services , the interface calls the RMS core functionalities to support user requests (See Figure 1-B). The RMS business logic can be classified into two categories based on the role of users. The User Module handles tasks sent by an investigator who is seeking to initialize or monitor a project. The Admin Module provides convenient functions for administrators to manage the RMS system. The modules are linked as a collaborative workflow to support streamlined user operations. Another important responsibility of the business logic layer is to keep track of the business entities. The business entities are stored in a database through the data access layers (See Figure 1-C).
The RMS database can store thirty-five business entities. In Figure 1-D, we show the eight most important entities. The User entity represents an RMS user who has been assigned user properties, including affiliation, contacts, account credentials, and most importantly, a role. The role restricts the privileges of a user and defines authorized actions on RMS, such as viewing, editing, and deleting information. The Institution entity represents institutional partners. A Core includes a group of experts who share similar research interests and devote their time to serve the community with professional skills. A Project is created by an investigator to seek consultation and establish collaboration with core experts. If a project is accepted, the investigator can create multiple Tasks with different core services and keep track of task progress. For administrators, the Report entity and the History Log entity help provide an overview of the system conditions. All the business entities are individually customizable and adaptive to change. Hence, we can deploy the system to a new institution by adding organizational structure and defining local services using the system management tools.
The security of the RMS system is managed on three layers. On the system level, it is protected by a firewall that prevents access from unauthorized parties. On the network communication level, the connections between users and server are encrypted by a Secured Socket Layer (SSL) that prevents man-in-the middle attacks. For user credentials, user passwords are also hashed by a 256 bit Secure Hash Algorithm (SHA) to encrypt password. To maintain service integrity and content provenance, a history log is also used to keep track of user activities.
Several studies have identified a lack of tools to manage and keep track of project targets and trajectories is the primary technology barrier impeding research collaboration ,. RMS provides a solution to managing research collaboration by using a workflow engine. The workflow offers investigators an integrated informatics tool to manage the processes, contents, discussion and administration across institutions.
On the system administration side (See Figure 2-C), the RMS platform integrates comprehensive tools to support the daily administration tasks. Core administration can create, change, and archive their services and assign domain experts to support consultation services. RMS also implements tools to support the daily operation of the RCS in a way that maximizes operational efficiency. For example, the user management tool provides methods for assigning roles, updating information, deactivating a user, or designating a person as a proxy. Another important tool is the report system, which sends reports to all the business entities, including reports related to overdue tasks, total requests, and active services. We developed an advanced Ad-hoc report system that allows administrators to organize information on any combination of business entities to generate a report. RMS has been keeping track of a large amount of CTSC resources and activities; hence it also serves as an analysis tool for CTSC leaders to enhance decision making. The reports generated by RMS have been used to support the evaluation of the program in an objective and measurable way.
RMS users’ institutional affiliation
Number of RMS members
Case Western Reserve University
University Hospitals/Case Medical Center
Metro Health Medical Center
Louis Strokes VA Medical Center
Total Institutions: 36
Total Members: 1520
RMS service summaries
Summary of RMS services
Administration and Governance
Behavioral Science Measurement Resource
Bioethics and Regulatory Knowledge
Biomedical Research Informatics Management
Biostatistics, Epidemiology, and Research Design
Clinical Research Unit Services
Community Research Partnership
Pilot Grant Program
Population Health and Outcomes Research
Practice-Based Research Network Shared Resource
Program Evaluation and Reporting
Translational Technologies Resources
Growth of users and projects
Growth of research collaboration
The total connection (collaborative work) increased 400% from 2009 to 2012. The results show a significant increase of collaborative work. As shown in Table 2, the collaboration service can be categorized in 176 different types within 12 research cores, and the collaborative task within each category is summarized. Future efforts will focus on evaluating the quality of collaboration facilitated through RMS.
Word cloud of project discussion notes
Many studies in the past two decades have discovered that a high level of research collaboration positively correlates with the quality and quantity of research outcomes ,,,,,,–. For instance, a Swedish study focused on industrial research collaboration  found that compared to in-house research and publishing alone, research performed in collaboration with scientists from other institutions achieved higher impacts. A study from Germany  summarized three major barriers to research collaboration, including lack of management interface, incompatible work routines, and resource and budget constraints. The lack of a management interface is a significant barrier to researchers’ finding collaborators. Without a shared management interface, researchers often feel it is difficult to identify suitable collaborators and challenging to follow up on collaboration activities. RMS addresses this problem by providing a consistent, easy-to-access web-based interface for project management and a team of core administrators to coordinate the request process to ensure quality of service. To address the problem of heterogeneous work routines between different institutions, RMS provides a streamlined workflow which integrates the collaboration work routines of the affiliated institutions. Additionally, the key elements of a collaborative project, such as project goal, starting time, task due date, and expected results, are explicitly required to reduce potential ambiguity. Hence, the investigators can expect consistent consultation services supported by the system. The CTSC also provides rich expertise and administration resources to alleviate the resource and budget constraints of individual investigators. Domain experts on the RMS network are well aware of the responsibility of providing help to other investigators, while they also realize they can receive support from other investigators when there is a need. The mutually supported ecosystem encourages collaboration.
Although researchers have pointed out the important role of collaboration for fostering new scientific discovery, currently there are still few real systems that have been developed to support the development of research collaboration. Weng and Gennari  proposed a collaborative writing system to support cross-role annotation, such as that which takes place during collaborative clinical trial protocol writing. In the domain of engineering informatics, Singh et al.  designed the BIM framework to support 3D model based multidisciplinary collaboration. Zhang et al.  developed a model driven approach to support collaborative simulation for virtual project development. To address the issues of research data sharing, The National Sleep Research Resource (NSRR ) and the Center for SUDEP Research (CSR ) was recently built to provide a set of tools for researchers to conduct multisite studies and share research data. These approaches show that collaborative tools can effectively improve the specific collaborative task in the fields of clinical writing, data sharing and engineering. However, these approaches were not designed to address the challenging problem of managing diverse collaboration projects, especially coordinating experts across institution boundaries. We tackle this challenge of managing cross-institutional collaboration by creating an informatics platform that integrates expert resources and administration procedures to enable collaborative project management in a streamlined workflow. Specifically, RMS was designed to address the need for effective management of project collaboration and sharing of resources. It brings together experts from disparate fields and resources across institutions to enable users from different organizations to share services in a distributed environment.
RMS is a novel project management platform that supports and enhances collaborative clinical and translational research. Currently, most biomedical research institutions use web directories to list the expertise of researchers and describe the services of facilities. RMS improves the exiting approach by providing interactive services. The system transforms static expert profiles into collaborative procedures that allow investigators both to acquire support and to share expertise. Institutional resources, such as expert profiles, facility services, project management, and procedure administration, often scattered around different places at different divisions. RMS brings together these separate resources and creates a one-stop solution. The integrated solution bridges the gap between institutional resources, therefore facilitating research collaboration. Table 2 shows that within RMS, 176 different types of collaborative services have been created by domain experts and over 4800 tasks were finished. Diagram 4 shows that an average RMS user collaborated with 1.34 experts in 2009; while in 2012 an average user collaborated with 3.82 experts. The collaboration increased nearly 300%. Figure 5 shows that RMS supported 201 research divisions and established over 606 unique cross institutional collaborations. Compared to commercial collaboration products, such as Microsoft SharePoint and IBM Lotus Notes, RMS has several key differences and advantages. First, RMS was developed with functions that put biomedical investigators in priority. Many convenient modules were directly designed to facilitate biomedical research collaboration, such as the integrated NIH specialties, categorized facility services, embedded research outcome options, and the integrated workflow for biomedical research consultation. Second, RMS was designed with a service structure that fits to multi-institutional organizations that are common in the biomedical research field. A service can be easily shared and administrated by several partner institutions. Third, RMS is agile and cost effective. In the CTSC, only one developer is required for the technical maintenance of RMS. MS SharePoint and IBM Lotus require significantly more resources to maintain the system services . Customizing these commercial products for biomedical research will require more time and development effort .
Another characteristic of RMS worth noting is that the system itself is a cross-disciplinary collaboration project. The RMS project team not only consists of skillful computer science developers, but also actively involves experts from the RCS, IT management, and biomedical informatics. Engaging key stakeholders from different disciplines in all steps of design and development showed itself to be an important and effective project management practice. We discussed crucial design and developed options at each stage of the process. User feedback and requested changes were captured effectively and were quickly applied to the next round of implementation. The collaborative activity involved in the development of this system helped clarify users’ needs, deepened the mutual understanding of the partners, and reduced the possibility of running into development pitfalls.
The RMS team is continuously improving the platform to provide better services and experiences for investigators and domain experts. At the early stage of implementation, some projects were set up with the assistance of the RCS, which were also considered as requests. Requests placed through RMS have been changing over time. This study focuses on analyzing the trend of RMS usage and providing descriptive analysis to the nature of collaboration in the system. We have started to develop sections of hands-on demos for investigators to help them understand more about the services provided by RMS. Recently, the CTSC BRIM has started to disseminate the RMS platform to other CTSA institutions. We have also provided consultation services and shared our experience with several institutions. Finally, the University of Rochester has started to customize and deploy a new version of RMS to serve investigators in its Medical Center.
RMS is a novel system for integrating expertise and resources to support multidisciplinary and cross-institutional collaboration. In this paper, we share our experience with designing and developing the platform to support collaborative research project management and the insights we gained in the process. RMS has attracted over 1,500 users and the user base is continually growing. Our results show that the system supports rich collaboration across CTSC institutions over a very diverse range of research projects. Our empirical results indicate that RMS can foster and enhance research collaboration.
Availability and requirements
Project name: Request Management System
Project home page: http://casemed.case.edu/ctsc/tools/rms.cfm
User instruction manual: http://casemed.case.edu/ctsc/researchers/documents/rms_manual.pdf
Quick start guide: http://casemed.case.edu/ctsc/researchers/documents/quick_start_guide.pdf
Required platform: Platform independent
Required programming language: Ruby on Rails
Academics license available: Source codes and deployment support available based on request. For details of license agreement, please contact the corresponding author: firstname.lastname@example.org
This work was supported by the Clinical and Translational Science Collaborative (CTSC) under grant number UL1TR000439. CTSC was supported by the National Center for Advancing Translational Sciences (NCATS) component of the National Institutes of Health and NIH roadmap for Medical Research. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the NIH.
We thank Ginny Petrie, David Pilasky and Jeno Mozes for their input and support.
This work was supported by the Clinical and Translational Science Collaborative (CTSC) under grant number UL1TR000439. CTSC was supported by the National Center for Advancing Translational Sciences (NCATS) component of the National Institutes of Health and NIH roadmap for Medical Research.
- Wuchty S, Jones BF, Uzzi B: The increasing dominance of teams in production of knowledge. Science. 2007, 316 (5827): 1036-1039. 10.1126/science.1136099.View ArticlePubMedGoogle Scholar
- Hall KL, Stokols D, Stipelman BA, Vogel AL, Feng A, Masimore B, Morgan G, Moser RP, Marcus SE, Berrigan D: Assessing the value of team science: a study comparing center-and investigator-initiated grants. Am J Prev Med. 2012, 42 (2): 157-163. 10.1016/j.amepre.2011.10.011.View ArticlePubMedPubMed CentralGoogle Scholar
- Sonnenwald DH: Scientific collaboration. Annu Rev Inform Sci Tech. 2007, 41 (1): 643-681. 10.1002/aris.2007.1440410121.View ArticleGoogle Scholar
- Stokols D, Hall KL, Taylor BK, Moser RP: The science of team science: overview of the field and introduction to the supplement. Am J Prev Med. 2008, 35 (2): S77-S89. 10.1016/j.amepre.2008.05.002.View ArticlePubMedGoogle Scholar
- Hall KL, Feng AX, Moser RP, Stokols D, Taylor BK: Moving the science of team science forward: collaboration and creativity. Am J Prev Med. 2008, 35 (2): S243-S249. 10.1016/j.amepre.2008.05.007.View ArticlePubMedPubMed CentralGoogle Scholar
- He Z-L, Geng X-S, Campbell-Hunt C: Research collaboration and research output: a longitudinal study of 65 biomedical scientists in a New Zealand university. Res Policy. 2009, 38 (2): 306-317. 10.1016/j.respol.2008.11.011.View ArticleGoogle Scholar
- Gardner JK, RALL LC, PETERSON CA: Lack of multidisciplinary collaboration is a barrier to outcomes research. J Am Diet Assoc. 2002, 102 (1): 65-71. 10.1016/S0002-8223(02)90019-2.View ArticlePubMedGoogle Scholar
- Embi PJ, Payne PR: Clinical research informatics: challenges, opportunities and definition for an emerging domain. J Am Med Inform Assoc. 2009, 16 (3): 316-327. 10.1197/jamia.M3005.View ArticlePubMedPubMed CentralGoogle Scholar
- Kahn MG, Weng C: Clinical research informatics: a conceptual perspective. J Am Med Inform Assoc. 2012, 19: e36-e42. 10.1136/amiajnl-2012-000968.View ArticlePubMedPubMed CentralGoogle Scholar
- Eysenbach G: Medicine 2.0: social networking, collaboration, participation, apomediation, and openness. J Med Internet Res. 2008, 10 (3): e22-10.2196/jmir.1030.View ArticlePubMedPubMed CentralGoogle Scholar
- NSF Interdisciplinary Research: NSF interdisciplinary research. ., [http://www.nsf.gov/od/iia/additional_resources/interdisciplinary_research/index.jsp]
- Huerta MF, Farber GK, Wilder EL, Kleinman DV, Grady PA, Schwartz DA, Tabak LA: NIH roadmap interdisciplinary research initiatives.PLoS Comput Biol 2005, 1(6).,Google Scholar
- Zerhouni EA: Clinical research at a crossroads: the NIH roadmap. J Investig Med. 2006, 54 (4): 171-173. 10.2310/6650.2006.X0016.View ArticlePubMedGoogle Scholar
- Zerhouni EA: Translational and clinical science—time for a new vision. N Engl J Med. 2005, 353 (15): 1621-1623. 10.1056/NEJMsb053723.View ArticlePubMedGoogle Scholar
- Woolf SH: The meaning of translational research and why it matters. JAMA. 2008, 299 (2): 211-213. 10.1001/jama.2007.26.View ArticlePubMedGoogle Scholar
- Luo J, Pelfrey C, Zhang GQ: Visualizing and evaluating the growth of multi-institutional collaboration based on research network analysis. In Proceedings of AMIA Clinical Research Informatics Summit. San Francisco: 2014:112–117.Google Scholar
- Falk–Krzesinski HJ, Börner K, Contractor N, Fiore SM, Hall KL, Keyton J, Spring B, Stokols D, Trochim W, Uzzi B: Advancing the science of team science. Clin Transl Sci. 2010, 3 (5): 263-266. 10.1111/j.1752-8062.2010.00223.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Croyle RT: The national cancer institute’s transdisciplinary centers initiatives and the need for building a science of team science. Am J Prev Med. 2008, 35 (2): S90-S93. 10.1016/j.amepre.2008.05.012.View ArticlePubMedGoogle Scholar
- Vardell E, Feddern-Bekcan T, Moore M: SciVal experts: a collaborative tool. Med Ref Serv Q. 2011, 30 (3): 283-294. 10.1080/02763869.2011.603592.View ArticlePubMedGoogle Scholar
- VIVO: 2014. ., [http://www.vivoweb.org/]
- Szymanski J, Wilson DL, Zhang GQ: MIMI: multimodality, multiresource, information integration environment for biomedical core facilities. J Digit Imaging. 2009, 22 (5): 535-547. 10.1007/s10278-007-9083-y.View ArticlePubMedGoogle Scholar
- Mueller R, Zhang GQ: A Scalable Parametric-rbac Architecture for the Propagation of a Multi-modality, Multi-resource Informatics System. In: Enterprise Information Systems. Springer; 2009:114–124.Google Scholar
- Bachle M, Kirchberg P: Ruby on rails. Software, IEEE. 2007, 24 (6): 105-108. 10.1109/MS.2007.176.View ArticleGoogle Scholar
- Garrett JJ: Ajax: A new Approach to Web Applications. 2005Google Scholar
- Richardson L, Ruby S: RESTful web services. 2008, O’Reilly Media, 1005 Gravenstein Highway North, Sebastopol, CA 95472, USAGoogle Scholar
- Cummings JN, Kiesler S: Collaborative research across disciplinary and organizational boundaries. Soc Stud Sci. 2005, 35 (5): 703-722. 10.1177/0306312705055535.View ArticleGoogle Scholar
- Lee S, Bozeman B: The impact of research collaboration on scientific productivity. Soc Stud Sci. 2005, 35 (5): 673-702. 10.1177/0306312705052359.View ArticleGoogle Scholar
- Bastian M, Heymann S, Jacomy M: Gephi: An Open Source Software for Exploring and Manipulating Networks. Proceedings of the Third International ICWSM Conference, ICWSM; 2009: 361-362.Google Scholar
- Weber GM, Barnett W, Conlon M, Eichmann D, Kibbe W, Falk-Krzesinski H, Halaas M, Johnson L, Meeks E, Mitchell D, Schleyer T, Stallings S, Warden M, Kahlon M: Direct2Experts: a pilot national network to demonstrate interoperability among research-networking platforms. J Am Med Inform Assoc. 2011, 18: i157-i160. 10.1136/amiajnl-2011-000200.View ArticlePubMedPubMed CentralGoogle Scholar
- Abramo G, D’Angelo C, Di Costa F: Research collaboration and productivity: is there correlation?. High Educ. 2009, 57 (2): 155-171. 10.1007/s10734-008-9139-z.View ArticleGoogle Scholar
- Katz JS, Martin BR: What is research collaboration?. Res Policy. 1997, 26 (1): 1-18. 10.1016/S0048-7333(96)00917-1.View ArticleGoogle Scholar
- Okubo Y, Sjöberg C: The changing pattern of industrial scientific research collaboration in Sweden. Res Policy. 2000, 29 (1): 81-98. 10.1016/S0048-7333(99)00036-0.View ArticleGoogle Scholar
- Heinze T, Kuhlmann S: Across institutional boundaries?: Research collaboration in German public sector nanoscience. Res Policy. 2008, 37 (5): 888-899. 10.1016/j.respol.2008.01.009.View ArticleGoogle Scholar
- Weng C, Gennari JH: Asynchronous Collaborative Writing through Annotations. Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work. 2004, ACM, Chicago, Illinois, USA, 578-581. 10.1145/1031607.1031705.View ArticleGoogle Scholar
- Singh V, Gu N, Wang X: A theoretical framework of a BIM-based multi-disciplinary collaboration platform. Autom Constr. 2011, 20 (2): 134-144. 10.1016/j.autcon.2010.09.011.View ArticleGoogle Scholar
- Zhang H, Wang H, Chen D, Zacharewicz G: A model-driven approach to multidisciplinary collaborative simulation for virtual product development. Adv Eng Inform. 2010, 24 (2): 167-179. 10.1016/j.aei.2009.07.005.View ArticleGoogle Scholar
- The National Sleep Research Resource (NSRR). ., [https://sleepdata.org]
- The Center for SUDEP Research (CSR). ., [http://sudepresearch.org]
- Lotus Notes 8.5 - Detailed System Requirements. ., [http://www-01.ibm.com/support/docview.wss?uid=swg27013074]
- SharePoint Requirement - the Good, the Bad, and the Ugly. ., [http://www.huddle.com/blog/sharepoint-requirements/]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.