Last Wednesday CSCS finished the migration of 600 TB of data from the old HSM file system, an Oracle SAM-FS/QFS, to the new HSM based on a IBM solution. This was done through the support of HMK , a company that is specialized on migration services.
The migration has been started in September 2011 with the recreation of the old SAM-FS structure on a GPFS filesystem followed by reading all data from tapes with a daily rate of roughly 10TB per day. The final cleanup and consistency check took another week.
At the same time we opened the new /store file system (EUREKA) with 2 PB of usable space. The file system design is based on 14 IBM I/O nodes connected to 3 DDN SFA10K (600 disks) and 1 TMS RamSan 630 (SSD to manage GPFS metadata).
This cluster is connected to a dedicated IBM TSM/HSM infrastructure made by:
- 1 TSM Library Manger
- 1 TSM Server
- 2 Storage Agents/GPFS Clients
- 1 IBM TS3500 Library (24 LTO5 Drives, ~5700 tapes, ~ 8 PB uncompressed)
This new HSM solution allows us to scale in space and performance and gives us more flexibility on backups for all file systems at CSCS, /home, /apps, /project, and /store