Difference between revisions of "Usage policy"

From Storrs HPC Wiki
Jump to: navigation, search
(Summarize storage policy for now.)
 
(Emphasize temporary persistence storage times.)
Line 4: Line 4:
  
 
{| class="wikitable sortable"
 
{| class="wikitable sortable"
! Name          !! Path                  !! Size (GB)                    !! Persistence !! Backed up? !! Purpose
+
! Name          !! Path                  !! Size (GB)                    !! Persistence   !! Backed up? !! Purpose
 
|-
 
|-
| Home          || <code>~</code>        || 2                            || Permanent   || Yes        || Personal storage, available on every node
+
| Home          || <code>~</code>        || 2                            || Permanent     || Yes        || Personal storage, available on every node
 
|-
 
|-
| Group        || <code>/shared</code>  || [[:Category:Help|By request]] || Permanent   || Yes        || Group storage for collaborative work
+
| Group        || <code>/shared</code>  || [[:Category:Help|By request]] || Permanent     || Yes        || Group storage for collaborative work
 
|-
 
|-
| Fast          || <code>/scratch</code> || 220,000 (shared)              || 2 weeks     || No        || Fast RAID-0 storage, generally for result files
+
| Fast          || <code>/scratch</code> || 220,000 (shared)              || '''2 weeks''' || No        || Fast RAID-0 storage, generally for result files
 
|-
 
|-
| Local to node || <code>/work</code>    || 100                          || 5 days     || No        || Useful for large intermediate files
+
| Local to node || <code>/work</code>    || 100                          || '''5 days'''  || No        || Useful for large intermediate files
 
|}
 
|}
  

Revision as of 18:01, 25 August 2015

To be fair to all users of the cluster, please be aware of these resource limits and usage expectations.

Storage

Name Path Size (GB) Persistence Backed up? Purpose
Home ~ 2 Permanent Yes Personal storage, available on every node
Group /shared By request Permanent Yes Group storage for collaborative work
Fast /scratch 220,000 (shared) 2 weeks No Fast RAID-0 storage, generally for result files
Local to node /work 100 5 days No Useful for large intermediate files

If you try to run ls on either the /home or /shared directories, you might not see them. This is because they are mounted on demand by autofs, and therefore invisible until an attempt is made to access them by either reading a file under the directory, or using cd to enter the directory structure.

Appendix: Storage

Check size of home directory

You can check your home directory quota usage with:

/usr/lpp/mmfs/bin/mmlsquota -j $(whoami) gpfs2

Example output:

                         Block Limits                                    |     File Limits
Filesystem type             KB      quota      limit   in_doubt    grace |    files   quota    limit in_doubt    grace  Remarks
gpfs2      FILESET        6272          0    2097152          0     none |      165       0        0        0     none 

Your current usage and allowed limit are highlighted in red.

Recovered deleted files

  • File system snapshots are created every day and kept for 1 week.
  • An additional snapshot is created every second Monday and is saved for 2 weeks.
  • Users can access their home directory snapshots in:
/gpfs/gpfs2/.snapshots/<date>/home/<user>

Shared directories are available in

/gpfs/gpfs2/.snapshots/<date>/shared/<group>