Skip to content
Snippets Groups Projects
Commit 385da649 authored by Michael Blaschek's avatar Michael Blaschek :bicyclist:
Browse files

Update SRVX1.md, Jet-Cluster.md files

parent e32ccff3
No related branches found
No related tags found
No related merge requests found
......@@ -3,11 +3,15 @@
[[_TOC_]]
## Getting Started
# Getting Started
Welcome to the HPC @IMG @UNIVIE and please follow these steps to become a productive member of our department and make good use of the computer resources. Efficiency is keen.
1. Connect to Jet
2. Load environment (libraries, compilers, interpreter, tools)
3. Checkout Code, Program, Compile, Test
4. Submit to compute Nodes
### SSH
## SSH
- [x] Terminal, Putty, ...
- [x] Network access @UNIVIE
......@@ -17,7 +21,7 @@ ssh [user]@jet01.img.univie.ac.at
```
Please replace `[user]` with the username given by the [sysadmin](mailto:michael.blaschek@univie.ac.at) and supply your password when asked for. This should give you access to the login node. If you are outside of the university network, then please goto [VPN](#VPN) below.
### VPN
## VPN
- [x] `u:account`
The jet cluster is only accessible from within the virtual network of the university of Vienna. Therefore access from outside has to be granted via the [VPN-Service](https://vpn.univie.ac.at). Go there and login with your `u:account` and download the *Big-IP Edge* client for you system.
......@@ -39,12 +43,12 @@ f5fpc -s -t vpn.univie.ac.at -u [user]
```
The status can be checked with `f5fpc --info`.
### VNC
## VNC
The login nodes (`jet01` and `jet02`) allow to run a `VNC`-Server
:construction:
### Jupyterhub
## Jupyterhub
<img src="https://jupyter.org/assets/hublogo.svg" width="300px">
The Jet-cluster serves a [jupyterhub](https://jupyterhub.readthedocs.io/en/stable/) with a [jupyterlab](https://jupyterlab.readthedocs.io/en/stable/) that launches on the jet-cluster compute nodes and allows users to work directly on the cluster as well as submit jobs.
......@@ -52,20 +56,22 @@ The Jet-cluster serves a [jupyterhub](https://jupyterhub.readthedocs.io/en/stabl
Goto: [](https://jet01.img.univie.ac.at) from within the VPN or UNI-Network.
Login with your jet-Credentials, choose a job and the jupyterlab will be launched.
![Login](Documentation/jet-login.png)
![Job](Documentation/jet-job1.png)
![Jobs](Documentation/jet-job2.png)
<img src="Documentation/jet-login.png" width="500px">
<img src="Documentation/jet-job1.png" width="500px">
<img src="Documentation/jet-job2.png" width="500px">
:construction:
### User Quotas and Restrictions
## User Quotas and Restrictions
Memory limit / slurm requests
:construction:
#### Network drives
### Network drives
Currently there are two network drives mounted on the jet cluster. These are connected to the [SRVX8](SRVX8.md) and data can be transfered or accessed like this on the jet cluster. Be aware that the data needs to be transfered via the network before and latencies are higher.
```
131.130.157.8:/raid61 400T 378T 22T 95% /raid61
......@@ -73,7 +79,7 @@ Currently there are two network drives mounted on the jet cluster. These are con
jetfs 1.1P 81T 975T 8% /jetfs
```
## System Information
# System Information
Last Update: 4.12.2020
Node Setup
- 2x Login Nodes
......@@ -82,7 +88,7 @@ Node Setup
![GPFS](Documentation/GPFS-jet.png)
### Node Information
## Node Information
| Name | Value |
| --- | --- |
......@@ -99,7 +105,7 @@ Node Setup
Global file system (GPFS) is present on all nodes with about 1 PB (~1000 TB) of storage.
## Software
# Software
The typcial installation of a intel-cluster has the INTEL Compiler suite (`intel-parallel-studio`) and the open source GNU Compilers installed. Based on these two different compilers (`intel`, `gnu`), there are usually two version of each scientific software.
Major Libraries:
......@@ -115,7 +121,7 @@ These software libraries are usually handled by environment modules.
<img src="http://modules.sourceforge.net/modules_red.svg" width="300px">
### Currently installed modules
## Currently installed modules
```bash
>>> module av
---------------------------------- /jetfs/spack/share/spack/modules/linux-rhel8-skylake_avx512 -----------------------------------
......@@ -152,7 +158,7 @@ Currently Loaded Modulefiles:
```
`module list` shows the currently loaded modules and reports that 6 libraries need to be loaded as dependencies for `ECCODES`. Thus, it is not necessary to load the other libraries manually as they are dependencies of `ECCODES`.
## Best Practice
# Best Practice
1. Example on jet
2. Example job
......
......@@ -6,10 +6,53 @@
## Getting Started
### SSH
- [x] Terminal, Putty, ...
- [x] Network access @UNIVIE
Use a terminal or [Putty](https://www.putty.org/) to connect with SSH to the server
```bash
ssh [user]@srvx1.img.univie.ac.at
```
Please replace `[user]` with the username given by the [sysadmin](mailto:michael.blaschek@univie.ac.at) and supply your password when asked for. This should give you access to the login node. If you are outside of the university network, then please goto [VPN](#VPN) below.
### VPN
- [x] `u:account`
The jet cluster is only accessible from within the virtual network of the university of Vienna. Therefore access from outside has to be granted via the [VPN-Service](https://vpn.univie.ac.at). Go there and login with your `u:account` and download the *Big-IP Edge* client for you system.
![](https://zid.univie.ac.at/fileadmin/user_upload/d_zid/zid-open/daten/datennetz/vpn/Windows/01_download_neu.png)
Links:
* [ZID-VPN](https://vpn.univie.ac.at/f5-w-68747470733a2f2f7a69642e756e697669652e61632e6174$$/vpn/)
* Linux (Ubuntu, Generic), Windows, Mac: [VPN user guides](https://vpn.univie.ac.at/f5-w-68747470733a2f2f7a69642e756e697669652e61632e6174$$/vpn/anleitungen/)
* Arch based AUR package [AUR f5fpc](https://aur.archlinux.org/packages/f5fpc/)
Follow the install instructions for Windows, Mac and Linux and make sure the software works.
![](https://zid.univie.ac.at/fileadmin/user_upload/d_zid/zid-open/daten/datennetz/vpn/Windows/08_verbinden.png)
On Windows and MAc you get a nice gui that requires you to fill in the VPN server: `vpn.univie.ac.at` and username and password from the `u:account`. On Linux execute the following:
```
f5fpc -s -t vpn.univie.ac.at -u [user]
```
The status can be checked with `f5fpc --info`.
### Jupyterhub
<img src="https://jupyter.org/assets/hublogo.svg" width="300px">
SRVX1 serves a teaching [jupyterhub](https://jupyterhub.readthedocs.io/en/stable/) with a [jupyterlab](https://jupyterlab.readthedocs.io/en/stable/). It allows easy access for students and teachers.
Goto: [](https://srvx1.img.univie.ac.at)
Signup is only granted by teachers and requires a srvx1 user account. A new password is needed and a TOTP (time base one-time password) will be created.
Download/Use any of these required Authenticator Apps:
- [Authy (Mobile, Desktop)](https://authy.com/download/)
- [FreeOTP (Mobile)](https://freeotp.github.io/)
- [Google Auth (Mobile)](https://play.google.com/store/apps/details?id=com.google.android.apps.authenticator2)
After registering the teacher/admin has to grant you access and you can login.
:construction:
## System Information
| Name | Value |
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment