diff --git a/Jet-Cluster.md b/Jet-Cluster.md index 8bfa3a67a6a56a883b503186da3d5e0f46183ecd..ee8cc28798ad029c6498db364f6aacaea899a232 100644 --- a/Jet-Cluster.md +++ b/Jet-Cluster.md @@ -3,11 +3,15 @@ [[_TOC_]] -## Getting Started +# Getting Started Welcome to the HPC @IMG @UNIVIE and please follow these steps to become a productive member of our department and make good use of the computer resources. Efficiency is keen. +1. Connect to Jet +2. Load environment (libraries, compilers, interpreter, tools) +3. Checkout Code, Program, Compile, Test +4. Submit to compute Nodes -### SSH +## SSH - [x] Terminal, Putty, ... - [x] Network access @UNIVIE @@ -17,7 +21,7 @@ ssh [user]@jet01.img.univie.ac.at ``` Please replace `[user]` with the username given by the [sysadmin](mailto:michael.blaschek@univie.ac.at) and supply your password when asked for. This should give you access to the login node. If you are outside of the university network, then please goto [VPN](#VPN) below. -### VPN +## VPN - [x] `u:account` The jet cluster is only accessible from within the virtual network of the university of Vienna. Therefore access from outside has to be granted via the [VPN-Service](https://vpn.univie.ac.at). Go there and login with your `u:account` and download the *Big-IP Edge* client for you system. @@ -39,12 +43,12 @@ f5fpc -s -t vpn.univie.ac.at -u [user] ``` The status can be checked with `f5fpc --info`. -### VNC +## VNC The login nodes (`jet01` and `jet02`) allow to run a `VNC`-Server :construction: -### Jupyterhub +## Jupyterhub <img src="https://jupyter.org/assets/hublogo.svg" width="300px"> The Jet-cluster serves a [jupyterhub](https://jupyterhub.readthedocs.io/en/stable/) with a [jupyterlab](https://jupyterlab.readthedocs.io/en/stable/) that launches on the jet-cluster compute nodes and allows users to work directly on the cluster as well as submit jobs. @@ -52,20 +56,22 @@ The Jet-cluster serves a [jupyterhub](https://jupyterhub.readthedocs.io/en/stabl Goto: [](https://jet01.img.univie.ac.at) from within the VPN or UNI-Network. Login with your jet-Credentials, choose a job and the jupyterlab will be launched. - - - +<img src="Documentation/jet-login.png" width="500px"> + +<img src="Documentation/jet-job1.png" width="500px"> + +<img src="Documentation/jet-job2.png" width="500px"> :construction: -### User Quotas and Restrictions +## User Quotas and Restrictions Memory limit / slurm requests :construction: -#### Network drives +### Network drives Currently there are two network drives mounted on the jet cluster. These are connected to the [SRVX8](SRVX8.md) and data can be transfered or accessed like this on the jet cluster. Be aware that the data needs to be transfered via the network before and latencies are higher. ``` 131.130.157.8:/raid61 400T 378T 22T 95% /raid61 @@ -73,7 +79,7 @@ Currently there are two network drives mounted on the jet cluster. These are con jetfs 1.1P 81T 975T 8% /jetfs ``` -## System Information +# System Information Last Update: 4.12.2020 Node Setup - 2x Login Nodes @@ -82,7 +88,7 @@ Node Setup  -### Node Information +## Node Information | Name | Value | | --- | --- | @@ -99,7 +105,7 @@ Node Setup Global file system (GPFS) is present on all nodes with about 1 PB (~1000 TB) of storage. -## Software +# Software The typcial installation of a intel-cluster has the INTEL Compiler suite (`intel-parallel-studio`) and the open source GNU Compilers installed. Based on these two different compilers (`intel`, `gnu`), there are usually two version of each scientific software. Major Libraries: @@ -115,7 +121,7 @@ These software libraries are usually handled by environment modules. <img src="http://modules.sourceforge.net/modules_red.svg" width="300px"> -### Currently installed modules +## Currently installed modules ```bash >>> module av ---------------------------------- /jetfs/spack/share/spack/modules/linux-rhel8-skylake_avx512 ----------------------------------- @@ -152,7 +158,7 @@ Currently Loaded Modulefiles: ``` `module list` shows the currently loaded modules and reports that 6 libraries need to be loaded as dependencies for `ECCODES`. Thus, it is not necessary to load the other libraries manually as they are dependencies of `ECCODES`. -## Best Practice +# Best Practice 1. Example on jet 2. Example job diff --git a/SRVX1.md b/SRVX1.md index 299011304f2b08e42982acef422b2a2147ac940c..9f02d89a8a14e8d72b364715953c2cfcf031f67a 100644 --- a/SRVX1.md +++ b/SRVX1.md @@ -6,10 +6,53 @@ ## Getting Started ### SSH +- [x] Terminal, Putty, ... +- [x] Network access @UNIVIE + +Use a terminal or [Putty](https://www.putty.org/) to connect with SSH to the server +```bash +ssh [user]@srvx1.img.univie.ac.at +``` +Please replace `[user]` with the username given by the [sysadmin](mailto:michael.blaschek@univie.ac.at) and supply your password when asked for. This should give you access to the login node. If you are outside of the university network, then please goto [VPN](#VPN) below. ### VPN +- [x] `u:account` + +The jet cluster is only accessible from within the virtual network of the university of Vienna. Therefore access from outside has to be granted via the [VPN-Service](https://vpn.univie.ac.at). Go there and login with your `u:account` and download the *Big-IP Edge* client for you system. + + + +Links: + * [ZID-VPN](https://vpn.univie.ac.at/f5-w-68747470733a2f2f7a69642e756e697669652e61632e6174$$/vpn/) + * Linux (Ubuntu, Generic), Windows, Mac: [VPN user guides](https://vpn.univie.ac.at/f5-w-68747470733a2f2f7a69642e756e697669652e61632e6174$$/vpn/anleitungen/) + * Arch based AUR package [AUR f5fpc](https://aur.archlinux.org/packages/f5fpc/) + +Follow the install instructions for Windows, Mac and Linux and make sure the software works. + + + +On Windows and MAc you get a nice gui that requires you to fill in the VPN server: `vpn.univie.ac.at` and username and password from the `u:account`. On Linux execute the following: +``` +f5fpc -s -t vpn.univie.ac.at -u [user] +``` +The status can be checked with `f5fpc --info`. ### Jupyterhub +<img src="https://jupyter.org/assets/hublogo.svg" width="300px"> + +SRVX1 serves a teaching [jupyterhub](https://jupyterhub.readthedocs.io/en/stable/) with a [jupyterlab](https://jupyterlab.readthedocs.io/en/stable/). It allows easy access for students and teachers. + +Goto: [](https://srvx1.img.univie.ac.at) +Signup is only granted by teachers and requires a srvx1 user account. A new password is needed and a TOTP (time base one-time password) will be created. + +Download/Use any of these required Authenticator Apps: + - [Authy (Mobile, Desktop)](https://authy.com/download/) + - [FreeOTP (Mobile)](https://freeotp.github.io/) + - [Google Auth (Mobile)](https://play.google.com/store/apps/details?id=com.google.android.apps.authenticator2) + +After registering the teacher/admin has to grant you access and you can login. + +:construction: ## System Information | Name | Value |