The Argonne Leadership Computing Facility (ALCF) installed and accepted a Cray XC40 named Theta at the end of 2016. Along with Theta, ALCF also installed a Cray Sonexion 3000 system that consists of 28 Scalable Storage Units (SSU) in 4 cabinets with an aggregate capacity of 10.8 PB and a peak bandwidth of 240 GB/s as measured via IOR. The Sonexion is connected to the Theta LNET routers via Infiniband FDR using a Mellanox SX6536 switch. The Sonexion was deployed with the Cray/Seagate variant of Lustre version 2.5.1. In April 2017, we will upgrade our Sonexion storage to Intel Lustre Enterprise Edition 3.0. In this presentation, we will describe the process to upgrade from the Cray/Seagate Lustre to the Intel Lustre version. We will describe any issues that arose and steps that were taken to correct problems. Intel Enterprise Edition 3.0 is based on Lustre 2.7 with OpenZFS, but our deployment will continue to use ldiskfs on top of GridRAID. We will compare and contrast the performance between the different version using several different workloads using IOR, mdtest and HACC-IO. The features that are new or have been changed will be examined. Any relevant differences in the support model will also be reviewed.
