HPCE/gitea-pages
0
0
Fork 0
Code Issues 2 Pull Requests Actions Packages Projects Activity

add a tools page for merlin7

Browse Source
This commit is contained in:
viessm_h
2025-01-09 14:50:27 +01:00
parent 8ba2b715cd
commit 8cf6db43f3
3 changed files with 127 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

35
pages/merlin7/02-How-To-Use-Merlin/storage.md
View File

@ -28,31 +28,30 @@ Some of the Merlin7 directories have quotas applied. A way for checking the quot
This command is useful to show all quotas for the different user storage directories and partitions (including AFS). To check your quotas, please run:
```console
$ merlin_quotas
$ merlin_quotas
Path SpaceUsed SpaceQuota Space % FilesUsed FilesQuota Files %
-------------- --------- ---------- ------- --------- ---------- -------
/data/user 29.85G 1T 0% 366671 2097152 0%
/data/user 30.26G 1T 03% 367296 2097152 18%
└─ <USERNAME>
/afs/psi.ch 3.4G 9.5G 36% 0 0 0%
└─ user/v/<USERNAME>
/data/scratch 680.1M 512G 0% 366897 0 0%
└─ shared
/data/project 1.115T 10T 0% 50 2097152 0%
└─ bio/shared
/afs/psi.ch 3.4G 9.5G 36% 0 0 0%
└─ user/<USERDIR>
/data/project 2.457T 10T 25% 58 2097152 00%
└─ bio/shared
/data/project 338.3G 10T 03% 199391 2097152 10%
└─ bio/hpce
```
{{site.data.alerts.note}}On first use you will see a message about some configuration being generated, this is expected. Don't be
surprised that it takes some time. After this using <code>merlin_quotas</code> should be faster.
{{site.data.alerts.end}}
The output shows the quotas set and how much you are using of the quota, for each filesystem that has this set. Notice that some users will have
one or more `/data/project/...` directories showing, depending on whether you are part of a specific PSI research group or project.
{{site.data.alerts.tip}}If you're using <code>merlin_quotas</code> for the first time, your project quotas might not appear. You can fix this by
running <code>merlin_quotes --gen-project-config --use-groups</code> which will generate in your home directory a <code>~/.merlin_quotas</code> file
with all the projects you have access to. This file can also be hand modified, keep in mind though that security restrictions are in place, so you
won't be able to looking into project data directories that you are not a member of.
{{site.data.alerts.end}}
The general quota constraints for the different directories are shown in the [table below](#dir_classes). Further details on how to use `merlin_quotas`
can be found on the [Tools page](/merlin7/tools.html).
The general quota constraints for the different directories are shown in the table below.
{{site.data.alerts.note}}If you're interesting, you can retrieve the Lustre-based quota information directly by calling
{{site.data.alerts.tip}}If you're interesting, you can retrieve the Lustre-based quota information directly by calling
<code>lfs quota -h -p $(( 100000000 + $(id -u $USER) )) /data</code> directly. Using the <code>merlin_quotas</code> command is more
convenient and shows all your relevant filesystem quotas.
{{site.data.alerts.end}}
@ -75,7 +74,7 @@ Once the <b>grace time</b> or hard limit are reached, users will be unable to wr
when this is possible, see below table).
{{site.data.alerts.end}}
Properties of the directory classes:
<a name="dir_classes"></a>Properties of the directory classes:
| Directory | Block Quota [Soft:Hard] | Inode Quota [Soft:Hard] | GraceTime | Quota Change Policy: Block | Quota Change Policy: Inodes | Backup |
| ---------------------------------- | ----------------------- | ----------------------- | :-------: | :--------------------------------- |:-------------------------------- | ------ |
@ -113,7 +112,7 @@ Home directory quotas are defined in a per Lustre project basis. The quota can b
### Project data directory
This storage is intended for keeping large amounts of a project's data, where the data also can be
shared by all members of the project (the project's corresponding unix group). We recommend to keep most data in
shared by all members of the project (the project's corresponding UNIX group). We recommend to keep most data in
project related storage spaces, since it allows users to coordinate. Also, project spaces have more flexible policies
regarding extending the available storage space.