Storage Statistics

Statistics about NERSC's storage systems are collected in order to plan for future needs and to monitor utilization. The statistics come from HPSS collected statistics, HPSS accounting records and log files provided by the hsi and ftp servers.

Bandwidth and Transfer ActivityData Rate vs. File Size
The graph below shows the bandwidth for individual file transfers for one day. The graph also gives a quick overview of the traffic and maximum bandwidth and file size for a given day. Historical yearly peak days.
Aggregate Transfer Bandwidth
This graph shows the aggregate transfer rate to the storage systems as a function of time of day. The red line is the peak bandwidth observed within each one minute interval. The green line is the average over ten minute…

Storage Trends and SummariesTotal Bytes Utilized
The growth in NERSC's storage systems amounts to roughly 1.7x per year.
Number of Files Stored
The growth in the number of files stored is less than the growth in the number of bytes stored as the average file size has increased over time. The average file size as of August 2003 is about 30 MB. The median file size is closer to 1 MB.
Monthly I/O
The growth rate of I/O is roughly the same as the growth rate of the number of bytes stored. As a rough rule of thumb, the…

Storage by Scientific DisciplineThese graphs show the utilization of storage space by scientific disciplines. Space consumed by backups, staff resources and overhead functions is not shown here.
Total Bytes Utilized
Number of Files
Monthly…