Difference between revisions of "Usage policy"

From Storrs HPC Wiki
Jump to: navigation, search
(Explain trigger for deleting files.)
(Fix bullet point continuation.)
Line 16: Line 16:
  
 
* Data deletion is based on modification time.  You will get 3 warnings before deletion if your files or directories are expired.  
 
* Data deletion is based on modification time.  You will get 3 warnings before deletion if your files or directories are expired.  
* If you try to run <code>ls</code> on either the <code>/home</code>, <code>/shared</code>, or <code>/misc/cnXX</code> directories, you might not see them.
+
* If you try to run <code>ls</code> on either the <code>/home</code>, <code>/shared</code>, or <code>/misc/cnXX</code> directories, you might not see them. <!--
They are invisible because they are mounted on demand by <code>autofs</code>, when an attempt is made to access a file under the directory, or using <code>cd</code> to enter the directory structure.
+
-->They are invisible because they are mounted on demand by <code>autofs</code>, when an attempt is made to access a file under the directory, or using <code>cd</code> to enter the directory structure.
 
<!--
 
<!--
 
= Computation =
 
= Computation =

Revision as of 18:09, 25 August 2015

To be fair to all users of the cluster, please be aware of these resource limits and usage expectations.

Storage

Name Path Size (GB) Persistence Backed up? Purpose
Home ~ 2 Permanent Yes Personal storage, available on every node
Group /shared By request Permanent Yes Group storage for collaborative work
Fast /scratch 220,000 (shared) 2 weeks No Fast RAID-0 storage, generally for result files
Local to node /work 100 5 days No Useful for large intermediate files, globally accessible from /misc/cnXX
  • Data deletion is based on modification time. You will get 3 warnings before deletion if your files or directories are expired.
  • If you try to run ls on either the /home, /shared, or /misc/cnXX directories, you might not see them. They are invisible because they are mounted on demand by autofs, when an attempt is made to access a file under the directory, or using cd to enter the directory structure.

Appendix: Storage

Check size of home directory

You can check your home directory quota usage with:

/usr/lpp/mmfs/bin/mmlsquota -j $(whoami) gpfs2

Example output:

                         Block Limits                                    |     File Limits
Filesystem type             KB      quota      limit   in_doubt    grace |    files   quota    limit in_doubt    grace  Remarks
gpfs2      FILESET        6272          0    2097152          0     none |      165       0        0        0     none 

Your current usage and allowed limit are highlighted in red.

Recovered deleted files

  • File system snapshots are created every day and kept for 1 week.
  • An additional snapshot is created every second Monday and is saved for 2 weeks.
  • Users can access their home directory snapshots in:
/gpfs/gpfs2/.snapshots/<date>/home/<user>

Shared directories are available in

/gpfs/gpfs2/.snapshots/<date>/shared/<group>