Provo, Utah (October 13, 2015) – Adaptive Computing, which powers many of the world’s largest private cloud and HPC environments with its Moab optimization and scheduling software, today announced that they have fully deployed Moab 8.1 at the High Performance Computing for Health Sciences, also known as HPC4Health, which today consists of The Hospital for Sick Children (SickKids) and University Health Network’s (UHN) Princess Margaret Cancer Center. HPC4Health is part of a larger vision, which also includes Compute Canada and Compute Ontario, to bring multiple organizations together to share resources dynamically, securely and equitably. Moab HPC Suite, Enterprise Edition, version 8.1 (Moab) has been deployed for its elastic computing, advanced policies and accounting capabilities to deliver on this vision.
“In the beginning, our vision was not possible because technology did not exist,” comments Jorge Gonzalez-Outeirino, Ph.D., Facility Manager at the Centre for Computational Medicine at SickKids. “The folks at Adaptive Computing helped us create the technology to build a converged data center that dynamically shares resources securely and allows us to account for the workloads used by each organization involved in the HPC4Health venture.”
SickKids is recognized as one of the world’s foremost pediatric health-care institutions and is Canada’s leading center dedicated to advancing children’s health through the integration of patient care, research and education. The Princess Margaret Cancer Centre has achieved an international reputation as a global leader in the fight against cancer and delivering personalized cancer medicine. It is a member of UHN, the largest hospital-based research program in Canada, with major research in cardiology, transplantation, neurosciences, oncology, surgical innovation, infectious diseases, genomic medicine and rehabilitation medicine. Today’s research discovery and innovation is made possible by not only experiments in the laboratory, but also through computational simulation. With the power of High Performance Computing (HPC) and Big Data Sciences, analyzing and interpreting the terabytes of data generated every day contributes to scientific discovery. Without access to such computational resources, it is impossible to deliver a high-level of individualized patient care, make scientific discoveries and save lives.
Canadian healthcare organizations have lacked the HPC infrastructure needed to push research and personalized clinical care into the future. To address this problem, SickKids and UHN’s Princess Margaret Cancer Centre have partnered to build a pilot IT infrastructure that will provide researchers and clinicians with secure cloud-computing services, while satisfying personal health information privacy requirements. The infrastructure currently resides on 340 SGI compute nodes, 13,024 compute threads, 52.7 terabytes of RAM, 306 terabytes of total local disk space and 4 PB of storage. Part of this infrastructure is Adaptive Computing’s Moab. Moab was selected for its elastic computing features; advanced policies such as: auto enforcement of Service Level Agreements (SLAs), dynamic provision of virtual resources and job arrays; as well as accounting capabilities.
“We had many requirements going into this project but the big features were to maintain the perception of managing our own environments and have the ability to handle burst workload requirements,” says Carl Virtanen, Bioinformatics Manager at the Princess Margaret Cancer Center and Associate Director of the HPC4Health. “With Moab it feels like we have infinite resources to handle all of our peak workloads. We manage our own environments as if we were simply a node on the network and with Moab’s heterogeneous capabilities, we can maintain all of our systems we’ve come to rely on to cure cancer and save lives.”
The HPC4Health IT Infrastructure is configured as a single pool of resources with each organization having dedicated resources plus a common communal pool of resources. Each organization and their Admins manage their dedicated resources just as if it were a private data center. As workloads increase, Moab automates each organization’s growth requirements and dynamically obtains additional resources from the communal pool to handle the peak loads and then relinquish those resources back to the communal pool for the next peak workload requirement from any organization. All workloads are tracked per user/organization and accounted for with extensive reporting capabilities. This is made possible through Moab’s elastic computing, advanced policies and accounting features.
Administrators from both SickKids and UHN’s Princess Margaret Cancer Centre must ensure that regularly scheduled workloads are completed, particularly during peak times. Each organization manages many users with countless needs and the requirement to be responsive to those needs is imperative; therefore, the ability to burst workloads to other resources is extremely important.
Moab tackles these challenges with elastic computing, which allows Admins to efficiently manage resource expansion by bursting to private clouds or other data center resources utilizing OpenStack. Elastic computing is triggered when a threshold set in Moab is exceeded. To determine this threshold, Moab surveys the system workload and calculates the combined completion time of these burstable workloads if no other workloads are running. Elastic computing bursts workloads, on an as-needed basis, into a communal pool of data center resources and then relinquishing these resources back to the shared pool. Using Openstack, Moab completely wipes each resource after use to help comply with Canadian privacy regulations. This added flexibility enables Admins to expand their own cluster while taking advantage of the elasticity of resources and scalability of the cloud.
Some of Moab’s advanced policies, such as auto enforcement of Service Level Agreements (SLAs), dynamic provision of virtual resources and job arrays, are key to the success of HPC4Health’s converged infrastructure.
- Auto SLA enforcementschedules and adjusts workloads to consistently meet service guarantees and business priorities so the right workloads are completed at the optimal times. Including:
- Resource sharing and usage policiesschedule resources across users, groups and projects in line with resource sharing agreements such as usage limits, usage access controls, and dynamic fairshare policies
- SLA and priority policesensure the highest priority workloads are processed first, such as quality of service and hierarchical priority weighting
- Continuous plus future schedulingensures priorities and guarantees are proactively met as conditions and workload levels change (Future reservations, priorities, and pre-emption)
- Dynamic Provisioningdiscovers that the current level of resources will not meet a given SLA, then reaches out to a provisioning tool that has access to the communal pool of virtual resources. The resources are allocated and then provisioned to match the needed environment. When the workload is complete the added resources are returned to the communal pool (de-provisioned and removed from the workload manager)
- Job Arrayssupport the submission of many sub-jobs that perform the same work using the same script, but operate on different sets of data.
Usage accounting and budget enforcement enables tracking of resource usage as well as the setting and enforcement of usage budgets by user, group, project or any custom organizational hierarchy. Resources are scheduled against that budget for a given period of time including dynamic usage reports and a flexible conditional usage cost/charge structure. This allows HPC4Health to track usage for each organization and then each organization can further track internal usage by user, department or group.
“HPC4Health has been an amazing project to work on pushing us to expand the bounds of cloud technology,” says Marty Smuin, CEO of Adaptive Computing. “HPC is the future for IT organizations to analyze big data requirements and extract the necessary data to make game changing decisions. By creating a converged infrastructure of Cloud, HPC and Big Data with Moab, SickKids and UHN’s Princess Margaret Cancer Center have the resources necessary to save lives!”
HPC4Health is made possible from financial contributions by Canadian Foundation for Innovation, Compute Canada, Compute Ontario, The Hospital for Sick Children, SickKids Foundation, The Princess Margaret Cancer Foundation, and University Health Network. HPC4Health is currently in conversations with other Canadian hospitals and health institutions to expand this venture and to take advantage of the HPC cloud resources to further scientific discovery.
About The Hospital for Sick Children
The Hospital for Sick Children (SickKids) is recognized as one of the world’s foremost pediatric health-care institutions and is Canada’s leading centre dedicated to advancing children’s health through the integration of patient care, research and education. Founded in 1875 and affiliated with the University of Toronto, SickKids is one of Canada’s most research-intensive hospitals and has generated discoveries that have helped children globally. Its mission is to provide the best in complex and specialized family-centred care; pioneer scientific and clinical advancements; share expertise; foster an academic environment that nurtures health-care professionals; and champion an accessible, comprehensive and sustainable child health system. SickKids is proud of its vision for Healthier Children. A Better World. For more information, please visit www.sickkids.ca.
About University Health Network
University Health Network consists of Toronto General and Toronto Western Hospitals, The Princess Margaret Cancer Centre, and Toronto Rehabilitation Institute. The scope of research and complexity of cases at University Health Network has made it a national and international source for discovery, education and patient care. It has the largest hospital-based research program in Canada, with major research in cardiology, transplantation, neurosciences, oncology, surgical innovation, infectious diseases, genomic medicine and rehabilitation medicine. University Health Network is a research hospital affiliated with the University of Toronto. www.uhn.ca