...
Working on the servers of the ESCER Centre
Our computer infrastructure
Have a look at our computer infrastructure: Computer infrastructure of the ESCER Centre
Firewall
To protect our servers and data we have a firewall installed around all of them. To get inside this firewall you need to either:
- beconnected via cable on the internet on the 6st or 7th floor of the PK
- use UQAM's VPN
- connect to one of our hoppies - see "External servers" below.
External servers
The so called "external" servers are outside our firewall and are only used to connect to our internal servers when connecting from outside the firewall. You can find their names here : external servers
...
To change your password, follow the instructions on our wiki page: Change password
Your home
On all of our internal servers you have the same home called: /HOME/username
For your home you have a quota of 500 MByte.
Everything under the home directories is backed up. You can find more information about our backup policies and how to retrieve the backups on the following wiki: Home backup
Since the homes are backed up it is highly recommended to keep everything that is small and important under your home, like all your scripts and programs! You can work with symbolic links if you like to have your scripts and programs accessible from other directories or on other file systems. You can find a short info about the links command here : Link files
Your data
To store your data you have disk space available on a filesystem on one of our internal servers. You find the names in the email you got about your account creation.
Data backup
Available disk space, memory and CPU power
Have a look at the following wiki page to find out where to put your data and how much memory and CPU power you can use:
Disk space, memory and CPU powerAs said above, everything under the home is backed up. But by default, non of the data under the "data space" are backed up. However, you can get up to 1 TB of your data automatically backed up once a week by following the instructions on the following page: Data backup
Data transfer
If ever you need to transfer data from/to one of the internal servers to/from the outside, follow the instructions on the following page: Transfert de données de/vers l'extérieur
Available disk space, memory and CPU power
home:
Volet | ||||
---|---|---|---|---|
| ||||
You can put up to 500 MB of data under your home. There is no limit for the number of files. You can check your current quota with the command: quota For more information about the command see: quota |
data space:
...
The
...
memory:
Volet | ||
---|---|---|
| ||
The memory is shared by all users using the same server. This is why we ask you not to use more than 64 GB in total at any given time. You can check the available memory with the command: free You can check and monitor the usage of your own processes with the command 'top'. For example: top -u ${USER} # You can use the command as is. The variable 'USER' is defined by default and set to your username. Once 'top' opened press the key 'M' (capital) to sort the processes according to memory usage instead of CPU usage. Look the the column 'RES'. |
CPU power:
Volet | ||
---|---|---|
| ||
The CPU power is shared by all users using the same server. To see how many cores are available on a given server execute the command: lscpu Look at the line "Core(s) per socket". To see how many CPUs are currently in use you can also use the command 'top': top Look the the column '%CPU'. |
The software
On our UQAM servers, as well as on clusters of The Alliance, 'modules' are used to give access to different software packages. Learn more about modules on the following page: Modules
...
Full description of the tools below and other tools can also be found on the following page: RPN standard filesformat
Having a first glance at the GEM model output
...
For more information about 'voir' check here: voir - documentation
xrec → visualize fields
To visualize the fields you can use 'xrec':
...
But you need to have connected with 'ssh -YC ...' to open windows.
For more information about 'xrec' check here as well: xrec - documentation
Manipulate RPN files
To extract fields you can use either 'r.diag select ...' or 'editfst'. You can find information about both here: Manipulating RPN files
But both these tools can be a little tricky to use. So don't hesitate to contact me when you get there!
...
In general it would be better to keep GEM output in RPN format to avoid "doubling" the output data. However, in some cases it can be useful to convert files in RPN format to NetCDF format or vice versa.
The tool with which one can do this is called cdf2rpn. You can find information about cdf2rpn under the following link: cdf2rpn - documentation
Running GEM
CRCM/GEM is installed on certain clusters of The Digital Research Alliance of Canada.
...