{"id":485,"date":"2018-06-29T16:49:57","date_gmt":"2018-06-29T15:49:57","guid":{"rendered":"https:\/\/portal.supercomputing.wales\/?page_id=485"},"modified":"2018-09-18T14:26:55","modified_gmt":"2018-09-18T13:26:55","slug":"quick-start-for-hpc-wales-users-migrating-to-scw","status":"publish","type":"page","link":"https:\/\/portal.supercomputing.wales\/index.php\/quick-start-for-hpc-wales-users-migrating-to-scw\/","title":{"rendered":"Rapid Start for HPC Wales Users Migrating to SCW"},"content":{"rendered":"<p>For users of the HPC Wales services who are migrating to the SCW service, please be aware of these important notes in order to get up-and-running as quickly &amp; effectively as possible.<\/p>\n<p>&nbsp;<\/p>\n<p><em>Hawk is the new supercomputer at Cardiff and is for the use of Cardiff &amp; Bangor led projects.<\/em><\/p>\n<p><em>Sunbird is the new supercomputer at Swansea and is for the use of Swansea &amp; Aberystwyth led projects.<\/em><\/p>\n<p>&nbsp;<\/p>\n<h4>User Credentials<\/h4>\n<ul>\n<li>These have changed to be linked to your institutional accounts.<\/li>\n<li>The method to access your new credentials and get started with Hawk and Sunbird is covered on the <a href=\"https:\/\/portal.supercomputing.wales\/index.php\/getting-access\/\" target=\"_blank\" rel=\"noopener\">Getting Access<\/a> page &#8211; please follow it closely.\n<ul>\n<li>Contact Support if you have any issues.<\/li>\n<\/ul>\n<\/li>\n<li>Existing project memberships have also been migrated.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h4>Data<\/h4>\n<ul>\n<li>Old home directories from the three HPCW sites have been cloned to a read-only area on the new systems for quick access.\n<ul>\n<li>These will remain for approximately 6 months only and then be removed.<\/li>\n<li>These cloned home directories are available on the Hawk &amp; Sunbird login nodes at:\n<ul>\n<li>Cardiff home directories\n<ul>\n<li><em><strong>\/migrate\/hpcw<\/strong><\/em><em><strong>-cf\/HPCW_USERID<\/strong><\/em><\/li>\n<\/ul>\n<\/li>\n<li>Swansea home directories\n<ul>\n<li><em><strong>\/migrate\/hpcw-sw\/<\/strong><\/em><em><strong>HPCW_USERID<\/strong><\/em><\/li>\n<\/ul>\n<\/li>\n<li>Bangor home directories\n<ul>\n<li><em><strong>\/migrate\/hpcw-<\/strong><\/em><em><strong>ba\/HPCW_USERID<\/strong><\/em><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>New home directory quotas for all are as follows:\n<ul>\n<li>50GB per user and 100GB per project share on Hawk<\/li>\n<li>100GB per user and 200GB per project share on Sunbird<\/li>\n<li><em>extensions are quickly available on justified request.<\/em><\/li>\n<\/ul>\n<\/li>\n<li><em>Project Shared Areas<\/em> are a way for users of a particular project to share data. They are separate from user home directories.\n<ul>\n<li>If a Project Shared area does not exist for your project and one would be useful, please request from Support.<\/li>\n<\/ul>\n<\/li>\n<li>We can also create <em>Collaboration Shared\u00a0Areas<\/em> that cross project and institutional boundaries as separate areas from home directories for data sharing among multiple users.\n<ul>\n<li>Please contact Support to discuss if this would be useful.<\/li>\n<\/ul>\n<\/li>\n<li>As with HPC Wales, no backup of data in home directories is taken, please keep necessary data backed up elsewhere.<\/li>\n<li>The scratch file system will see automatic cleanup of data that is not accessed for 60 days.\n<ul>\n<li>Exceptions available by justified request to Support.<\/li>\n<\/ul>\n<\/li>\n<li>Access to HPC Wales login nodes is still available for a short time to allow you to access the HPCW scratch directories.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h4>Jobs &amp; Applications<\/h4>\n<ul>\n<li>Once successfully migrated, we request that you no longer submit jobs on the HPC Wales systems as they are increasingly contended whilst we complete migration to the new systems.<\/li>\n<li>At this stage, a slowly-increasing number of the most utilised application codes have been re-built in an optimized form on the new systems.\n<ul>\n<li>These can be seen and accessed from the default output of <strong><em>module avail<\/em><\/strong>.<\/li>\n<\/ul>\n<\/li>\n<li>For other codes that have _not_ been re-built in optimal form at launch, the HPCW software stack is made available by first performing <em><strong>module load hpcw<\/strong><\/em>.\n<ul>\n<li>Once the\u00a0<em><strong>hpcw<\/strong><\/em> module is loaded, the HPCW software stack is displayed by <em><strong>module avail<\/strong><\/em> and modules are loaded in the usual way using <em><strong>module load &lt;modulename&gt;<\/strong><\/em>.<\/li>\n<li>The large majority of the old HPCW software stack will function on Hawk &amp; Sunbird just fine.\n<ul>\n<li>A few things won&#8217;t. If you find one, please highlight to Support and a new solution will be prioritised.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>We will monitor usage of old codes in order to prioritise those to be re-built in optimal form for the new system, and also those which will at some point be decommissioned due to zero usage.<\/li>\n<li>Old job submission scripts should be modified to make the most of the new system&#8217;s greater processor per node count and also target the right partition (queue).\n<ul>\n<li>Where previous systems had 12 or 16 processor cores per node, Hawk &amp; Sunbird have <em><strong>40<\/strong><\/em>.\n<ul>\n<li>It is therefore more important to use the nodes efficiently as proportionally more resource can be easily wasted.<\/li>\n<li>Be aware to update the Slurm directive <em><strong>#SBATCH &#8211;tasks-per-node<\/strong><\/em> in migrated submission scripts.<\/li>\n<\/ul>\n<\/li>\n<li>To better reflect the wide diversity of jobs and improve the user experience, partition naming and use has been re-worked. Please see the hardware descriptions for <a href=\"https:\/\/portal.supercomputing.wales\/index.php\/about-hawk\/\">Hawk<\/a> &amp; <a href=\"https:\/\/portal.supercomputing.wales\/index.php\/about-sunbird\/\">Sunbird<\/a>, output of\u00a0<em><strong>sinfo<\/strong><\/em> and the below.\n<ul>\n<li>Standard parallel jobs to the default <em><strong>compute<\/strong><\/em> partition (Hawk &amp; Sunbird).<\/li>\n<li>GPU accelerated tasks to the <em><strong>gpu<\/strong><\/em> partition (Hawk &amp; Sunbird).<\/li>\n<li>High-memory tasks to the <em><strong>highmem<\/strong><\/em> partition (Hawk only).<\/li>\n<li>Serial \/ high-throughput tasks to the\u00a0<em><strong>htc<\/strong><\/em> partition (Hawk only).<\/li>\n<li>Small and short development tasks (up to 40 processor cores, 30 minutes runtime) to the\u00a0<em><strong>dev<\/strong><\/em> partition (Hawk only).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>A newly refreshed training tarball, full of example jobs across a variety of applications is available. Please see <a href=\"https:\/\/portal.supercomputing.wales\/index.php\/use-of-software-examples\/\">here<\/a>.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>For users of the HPC Wales services who are migrating to the SCW service, please be aware of these important notes in order to get up-and-running as quickly &amp; effectively as possible. &nbsp; Hawk is the new supercomputer at Cardiff and is for the use of Cardiff &amp; Bangor led projects. Sunbird is the new [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-nosidebar.php","meta":{"_lmt_disableupdate":"","_lmt_disable":"","footnotes":""},"class_list":["post-485","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/485","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/comments?post=485"}],"version-history":[{"count":12,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/485\/revisions"}],"predecessor-version":[{"id":848,"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/pages\/485\/revisions\/848"}],"wp:attachment":[{"href":"https:\/\/portal.supercomputing.wales\/index.php\/wp-json\/wp\/v2\/media?parent=485"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}