Xenon Systems & Versity Deploy 150 PB Mass Storage System at Pawsey

2022-10-15 07:25:20 By : Mr. Jeffrey Liang

Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them

Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them

HOOD RIVER, Ore., Oct. 14, 2022 — Versity Software, the leading global provider of mass storage and large archive solutions, announced today that the 150 PB mass storage solution for Pawsey Supercomputing Research Centre in Perth, Australia, has been fully customized and deployed. This project is part of a five-year contract to implement a modernized data management system for Pawsey from the Australian HPC specialist, XENON.

This new storage system, called “Banksia” by Pawsey, is driven by Versity’s next generation Scale Out Archive Manager (ScoutAM) platform. The system provides researchers with seamless access to archival data using the S3 protocol and automates complex workflows while enabling responsive metadata searches and queries.

Leveraging Versity’s advanced technologies, the new system enables Pawsey to maintain production access to its entire historical data collection, even after its legacy storage system has been decommissioned. ScoutAM presents a global view of all metadata and access to all data without traditional time-consuming data migration.

“This system enables Pawsey to expand and modernize our essential data services for our astronomy research communities, while seamlessly transitioning to a new modular open-standard platform that can grow as our needs continue to evolve” said Mark Gray, Head of Scientific Platforms at Pawsey. “This provides an easy offramp from older proprietary systems and creates a foundation for more efficient data management in support of our scientific missions.”

The Versity ScoutAM platform is deployed in a scale-out architecture to enable petabyte scale production workflows between a three-tier system comprised of existing HPC storage, a 60 PB object storage data lake, and the Banksia long-term mass storage infrastructure. In Banksia, ScoutAM manages a 5 PB high performance data cache, and two large tape libraries. All tape IO is parallelized across 68 tape drives with 74 PB in each library, with headroom for more storage over time.

“Versity’s mission is to provide customers like Pawsey with a world-class hardware vendor-neutral data management platform to seamlessly orchestrate extremely resource intensive high speed data movement across any range of storage types at very large scale,” said Bruce Gilpin, CEO and Co-Founder of Versity.

The planning, design, and overall project management of Banksia has been delivered by XENON who has supplied all components including racks with rear door heat exchangers, servers, network fabric and switches for fibre channel connections, and physical storage hardware. XENON Services set-up, pre-staged and thoroughly load tested the system in the XENON production facility in Melbourne, ensuring that when Banksia was delivered to Pawsey, everything was working and easily integrated into the Center’s environment.

XENON has also provided documentation and training on Versity, and all aspects of managing the system. During commissioning and initial data in-place data migrations, XENON Services have managed the day-to-day operation of Banksia. These services continue after the handover of Banksia, with XENON providing ongoing support to ensure Banksia continues to operate at optimal efficiency for Pawsey.

“XENON has been integral to the successful delivery of Banksia, with the XENON team working closely with us and Versity to deliver a great storage system” said Stacy Tyson, Project Manager of the Technology Refresh at Pawsey.

About the Pawsey Supercomputing Research Centre

The Pawsey Supercomputing Research Centre is a world-class high-performance computing facility accelerating scientific discoveries for Australia’s researchers. Named after Australian scientist Joseph Pawsey, known as one of the pioneers of Australian radio astronomy for his work in the field of interferometry, Pawsey serves over 1600 researchers achieving unprecedented results, in domains such as radio astronomy, energy and resources, engineering, bioinformatics and health sciences. Pawsey is an unincorporated joint venture of CSIRO – Australia’s national science agency – Curtin University, Edith Cowan University, Murdoch University and The University of Western Australia and it is supported by the Western Australia and the Australian government. The Pawsey Technology Refresh project is supported by the Australian Government through a $70 million grant. Pawsey is also supported by the Australian Government under the National Collaborative Research Infrastructure Strategy (NCRIS) through the Department of Education.

XENON Systems is a technical high-performance computing and complex data storage specialist headquartered in Melbourne Australia and delivering solutions across Australia, New Zealand, and South East Asia. XENON builds solutions to solve complex parallel compute problems and large-scale data management workflows, across both on-premises and cloud infrastructure. XENON Systems has expertise deploying solutions for a range of industries with a focus on: Research, Defence, Government, Higher Education, Media and Entertainment, and the Cloud. For more information visit www.xenon.com.au.

Versity is the leading global independent provider of scalable, modular, and efficient mass storage and large archive systems. Organizations leverage Versity’s Scale Out Archive Manager (ScoutAM) to implement data preservation strategies for long-term storage, and retrieval of massive data stores, both on-premises and in the cloud. Versity currently manages over 1 Exabyte of archival storage across a global customer base including leading public and private entities in defense, financial services, education, research, aerospace, energy, entertainment, telecommunications, consumer technology, and publishing. Versity is a privately held company founded in 2011 and headquartered in Hood River, Oregon. For more information visit www.versity.com.

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Two years have passed since the debut of Fugaku, Japan's top supercomputer, and it is already known for its numerous achievements in simulations for Covid-19 measures. Meanwhile, the Ministry of Education, Culture, Sports, Science and Technology (MEXT) has already started to consider... Read more…

The University of Bath has launched a new, cloud-based supercomputer, Nimbus, which the university is calling the “central pillar” of its new portfolio of cloud research computing environments. The university says th Read more…

Dell may have inadvertently revealed that it has high-performance computing services on its roadmap for its Apex multicloud services. "If I was looking downstream I'd look for Apex versions of HPC," said Jeff Clarke, vice chairman and co-chief operating officer at Dell, in a press conference... Read more…

Most talk about quantum computing today, at least in HPC circles, focuses on advancing technology and the hurdles that remain. There are plenty of the latter. Financial services giant JPMorgan Chase (JPMC) takes a differ Read more…

The launch of ESnet6 was announced at an event at Berkeley Lab this morning. ESnet – short for “energy sciences network” – is managed by Berkeley Lab, funded by the DOE’s Office of Science and provides high-spe Read more…

Climate technology leader BlocPower wanted to build a powerful, cost-effective data processing pipeline so that it could process over 100 million energy profiles of buildings and better understand how it can optimize energy efficiency across the United States. Read more…

Insurance is a highly regulated industry that is evolving as the industry faces changing customer expectations, massive amounts of data, and increased regulations. A major issue facing the industry is tracking insurance fraud. Read more…

Quantum computers are being tested at some of the world’s top high-performance computing centers, which are wading through different systems and approaches to find the best fit for their infrastructure. A battle for Read more…

Dell may have inadvertently revealed that it has high-performance computing services on its roadmap for its Apex multicloud services. "If I was looking downstream I'd look for Apex versions of HPC," said Jeff Clarke, vice chairman and co-chief operating officer at Dell, in a press conference... Read more…

Most talk about quantum computing today, at least in HPC circles, focuses on advancing technology and the hurdles that remain. There are plenty of the latter. F Read more…

The launch of ESnet6 was announced at an event at Berkeley Lab this morning. ESnet – short for “energy sciences network” – is managed by Berkeley Lab, f Read more…

Quantum computers are being tested at some of the world’s top high-performance computing centers, which are wading through different systems and approaches to Read more…

The AGH University of Science and Technology has inaugurated its Athena supercomputer. Athena, installed last year, delivers nearly 8 peak petaflops of computin Read more…

Intel is opening up its fabs for academic institutions so researchers can get their hands on physical versions of its chips, with the end goal of boosting semic Read more…

For the better part of a century, General Motors (GM) was the biggest automaker in the world. Now, amid a paradigm shift toward smarter, electrified vehicles, t Read more…

Last week the Quantum Economic Development Consortium (QED-C) released a new report – Public-Private Partnerships in Quantum Computing – that calls for incr Read more…

Nvidia is not interested in bringing software support to its GPUs for the RISC-V architecture despite being an early adopter of the open-source technology in its GPU controllers. Nvidia has no plans to add RISC-V support for CUDA, which is the proprietary GPU software platform, a company representative... Read more…

It is perhaps not surprising that the big cloud providers – a poor term really – have jumped into quantum computing. Amazon, Microsoft Azure, Google, and th Read more…

The U.S. Senate on Tuesday passed a major hurdle that will open up close to $52 billion in grants for the semiconductor industry to boost manufacturing, supply chain and research and development. U.S. senators voted 64-34 in favor of advancing the CHIPS Act, which sets the stage for the final consideration... Read more…

Amid the high-performance GPU turf tussle between AMD and Nvidia (and soon, Intel), a new, China-based player is emerging: Biren Technology, founded in 2019 and headquartered in Shanghai. At Hot Chips 34, Biren co-founder and president Lingjie Xu and Biren CTO Mike Hong took the (virtual) stage to detail the company’s inaugural product: the Biren BR100 general-purpose GPU (GPGPU). “It is my honor to present... Read more…

Tesla has revealed that its biggest in-house AI supercomputer – which we wrote about last year – now has a total of 7,360 A100 GPUs, a nearly 28 percent uplift from its previous total of 5,760 GPUs. That’s enough GPU oomph for a top seven spot on the Top500, although the tech company best known for its electric vehicles has not publicly benchmarked the system. If it had, it would... Read more…

Additional details of the architecture of the exascale El Capitan supercomputer were disclosed today by Lawrence Livermore National Laboratory’s (LLNL) Terri Read more…

HPCwire takes you inside the Frontier datacenter at DOE's Oak Ridge National Laboratory (ORNL) in Oak Ridge, Tenn., for an interview with Frontier Project Direc Read more…

The Universal Chiplet Interconnect Express (UCIe) consortium is moving ahead with its effort to standardize a universal interconnect at the package level. The c Read more…

Fusion, the nuclear reaction that powers the Sun and the stars, has incredible potential as a source of safe, carbon-free and essentially limitless energy. But Read more…

You may recall that efforts proposed in 2020 to remake the National Science Foundation (Endless Frontier Act) have since expanded and morphed into two gigantic bills, the America COMPETES Act in the U.S. House of Representatives and the U.S. Innovation and Competition Act in the U.S. Senate. So far, efforts to reconcile the two pieces of legislation have snagged and recent reports... Read more…

The steady maturation of MLCommons/MLPerf as an AI benchmarking tool was apparent in today’s release of MLPerf v2.1 Inference results. Twenty-one organization Read more…

After two-plus years of contentious debate, several different names, and final passage by the House (243-187) and Senate (64-33) last week, the Chips and Science Act will soon become law. Besides the $54.2 billion provided to boost US-based chip manufacturing, the act reshapes US science policy in meaningful ways. NSF’s proposed budget... Read more…

There’s a growing interest among silicon providers backing RISC-V to introduce 48-bit computing in custom chips to meet their specific requirements. The 48-bit long instructions focus is more as a middle ground between 32-bit and 64-bit, which has largely been the focus of chips and instruction sets until now. Read more…

The long-troubled, hotly anticipated MareNostrum 5 supercomputer finally has a vendor: Atos, which will be supplying a system that includes both Nvidia and Inte Read more…

Courtesy of the schedule for the SC22 conference, we now have our first glimpse at the finalists for this year’s coveted Gordon Bell Prize. The Gordon Bell Pr Read more…

Intel is opening up its fabs for academic institutions so researchers can get their hands on physical versions of its chips, with the end goal of boosting semic Read more…

© 2022 HPCwire. All Rights Reserved. A Tabor Communications Publication

HPCwire is a registered trademark of Tabor Communications, Inc. Use of this site is governed by our Terms of Use and Privacy Policy.

Reproduction in whole or in part in any form or medium without express written permission of Tabor Communications, Inc. is prohibited.