Authors
David A Dillow, Galen M Shipman, Sarp Oral, Zhe Zhang, Youngjae Kim
Publication date
2011/11/17
Conference
30th IEEE International Performance Computing and Communications Conference
Pages
1-9
Publisher
IEEE
Description
As storage systems get larger to meet the demands of petascale systems, careful planning must be applied to avoid congestion points and extract the maximum performance. In addition, the large data sets generated by such systems makes it desirable for all compute resources to have common access to this data without needing to copy it to each machine. This paper describes a method of placing I/O close to the storage nodes to minimize contention on Cray's SeaStar2+ network, and extends it to a routed Lustre configuration to gain the same benefits when running against a center-wide file system. Our experiments using half of the resources of Spider - the center-wide file system at the Oak Ridge Leadership Computing Facility - show that I/O write bandwidth can be improved by up to 45% (from 71.9 to 104 GB/s) for a direct-attached configuration and by 137% (47.6 GB/s to 115 GB/s) for a routed configuration. We …
Total citations
201220132014201520162017201820192020233222212
Scholar articles
DA Dillow, GM Shipman, S Oral, Z Zhang, Y Kim - 30th IEEE International Performance Computing and …, 2011