{"id":301,"date":"2016-12-09T10:29:51","date_gmt":"2016-12-09T10:29:51","guid":{"rendered":"https:\/\/portal.supercomputing.wales\/?page_id=301"},"modified":"2024-11-11T12:19:48","modified_gmt":"2024-11-11T12:19:48","slug":"storage-quotas","status":"publish","type":"page","link":"https:\/\/portal.supercomputing.wales\/index.php\/index\/storage-quotas\/","title":{"rendered":"Storage"},"content":{"rendered":"<h3>Types of Storage<\/h3>\n<p>Super Computing Wales offers two types of storage: home directories and scratch.<\/p>\n<p>The scratch disks are large, have large per-user quotas, are on fast storage but only intended for short term storage of temporary data. Please don&#8217;t leave data on the scratch disk once you are finished with it. If the disk fills up it will negatively impact on other users ability to run jobs.<\/p>\n<p>Home directories have a default quota of 50GB per user, they are slower to access and are intended for longer term storage of data. However, please note that you should backup important data elsewhere as we do not formally offer an SCW backup service.<\/p>\n<h3>Checking Storage Quotas<\/h3>\n<p>Quotas are enabled on Supercomputing Wales home directories.<\/p>\n<p>These limit the amount of storage space and number of files that a user or group can store in their respective home directory location.<\/p>\n<p>To view your allocation, use the &#8216;myquota&#8217; command, like this:<\/p>\n<p><pre class=\"preserve-code-formatting\">[a.n.other@cl1 ~]$ myquota\nDisk quotas for group a.n.other (gid 1693): \n\u00a0\u00a0\u00a0\u00a0 Filesystem\u00a0 blocks\u00a0\u00a0 quota\u00a0\u00a0 limit\u00a0\u00a0 grace\u00a0\u00a0 files\u00a0\u00a0 quota\u00a0\u00a0 limit\u00a0\u00a0 grace\ncfsfs001-s05:\/nfsshare\/exports\/space05\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 402G\u00a0\u00a0\u00a0 500G\u00a0\u00a0\u00a0 525G\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 192k\u00a0\u00a0 1000k\u00a0\u00a0 1050k<\/pre><\/p>\n<p>In this example, we see six items of data:<\/p>\n<ul>\n<li>The first set of three items represent storage space:\n<ul>\n<li>&#8216;blocks&#8217; is the amount of storage space utilised, in this case 402GB<\/li>\n<li>&#8216;quota&#8217; is the &#8216;soft limit&#8217; assigned, in this case 500GB<\/li>\n<li>&#8216;limit&#8217; is the &#8216;hard limit&#8217; assigned, in this case 525GB<\/li>\n<\/ul>\n<\/li>\n<li>The second set of three items represent file count:\n<ul>\n<li>&#8216;files&#8217; is the number of files present, in this case 192000<\/li>\n<li>&#8216;quota&#8217; is the &#8216;soft limit&#8217; assigned, in this case 1000000<\/li>\n<li>&#8216;limit&#8217; is the &#8216;hard limit&#8217; assigned, in this case 1050000<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>A &#8216;soft limit&#8217; can be exceeded for a period of maximum 7 days, after which utilisation must be reduced below the threshold or error will result. In this case, the &#8216;grace&#8217; item in the &#8216;myquota&#8217; output will display the number of days remaining in this state.<\/p>\n<p>A &#8216;hard limit&#8217; cannot be exceeded and attempts to do so will result in error.<\/p>\n<p>Increases in quota allocations are possible on a case-by-case basis, please <a href=\"https:\/\/portal.supercomputing.wales\/index.php\/index\/submit-support-ticket\/\">contact the Support Desk<\/a> to request. However, it is worth noting that quotas are implemented to reduce the unfair use of the system by a few users and thus provide capacity for new users.<\/p>\n<h3><em>Shared Areas<\/em><\/h3>\n<p>We are able to create two types of shared area for multiple users to access:<\/p>\n<p><em>Project Shared Areas<\/em> are a way for the users of a particular project to share data. They are separate from user home directories and quotas as such.<\/p>\n<p><em>Collaboration Shared\u00a0Areas<\/em>\u00a0are also possible that cross project and institutional boundaries as separate areas from home directories for data sharing among multiple users.<\/p>\n<p>Please contact Support to discuss either of these if this would be useful.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Types of Storage Super Computing Wales offers two types of storage: home directories and scratch. The scratch disks are large, have large per-user quotas, are on fast storage but only intended for short term storage of temporary data. Please don&#8217;t leave data on the scratch disk once you are finished with it. If the disk [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":5,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-nosidebar.php","meta":{"_lmt_disableupdate":"no","_lmt_disable":"","footnotes":""},"class_list":["post-301","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/301","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/comments?post=301"}],"version-history":[{"count":11,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/301\/revisions"}],"predecessor-version":[{"id":1454,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/301\/revisions\/1454"}],"up":[{"embeddable":true,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/5"}],"wp:attachment":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/media?parent=301"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}