Add MeG migration instructions
All checks were successful
Build and Deploy Documentation / build-and-deploy (push) Successful in 6s

This commit is contained in:
2025-08-05 17:13:11 +02:00
parent e85ef5c776
commit 95ad196154

View File

@@ -45,16 +45,16 @@ A `experiment_migration.setup` migration script must be executed from **any MeG
#### When using the local `root` account #### When using the local `root` account
- The script **must be executed after every reboot** of the destination nodes. - The script **must be executed after every reboot** of the destination nodes.
- **Reason:** On Merlin7, the home directory for the `root` user resides on ephemeral storage (no physical disk). - **Reason:** On Merlin7, the home directory for the `root` user resides on ephemeral storage (no physical disk).
After a reboot, this directory is cleaned, so **SSH keys need to be redeployed** before running the migration again. After a reboot, this directory is cleaned, so **SSH keys need to be redeployed** before running the migration again.
#### When using a PSI Active Directory (AD) account #### When using a PSI Active Directory (AD) account
- Applicable accounts include, for example: - Applicable accounts include, for example:
- `gac-meg2_data` - `gac-meg2_data`
- `gac-meg2` - `gac-meg2`
- The script only needs to be executed **once**, provided that: - The script only needs to be executed **once**, provided that:
- The home directory for the AD account is located on a shared storage area. - The home directory for the AD account is located on a shared storage area.
- This shared storage is accessible from the node executing the transfer. - This shared storage is accessible from the node executing the transfer.
- **Reason:** On Merlin7, these accounts have their home directories on persistent shared storage, so the SSH keys remain available across reboots. - **Reason:** On Merlin7, these accounts have their home directories on persistent shared storage, so the SSH keys remain available across reboots.
To run it: To run it:
@@ -76,7 +76,7 @@ If you are stuck, email: [merlin-admins@lists.psi.ch](mailto:merlin-admins@lists
### Migration Procedure ### Migration Procedure
1. **Run an initial sync** 1. **Run an initial sync**, ideally within a `tmux` session
* This copies the bulk of the data from MeG to Merlin7. * This copies the bulk of the data from MeG to Merlin7.
* **IMPORTANT: Do not modify the destination directories** * **IMPORTANT: Do not modify the destination directories**
* Please, before starting the transfer ensure that: * Please, before starting the transfer ensure that:
@@ -142,9 +142,16 @@ Options:
> Defaults can be updated if necessary. > Defaults can be updated if necessary.
#### Migration example #### Migration examples
The following example migrates the entire online data ##### Example: Migrating the Entire `online` Directory
The following example demonstrates how to migrate the **entire `online`** directory.
{{site.data.alerts.tip}}
You may also choose to migrate only specific subdirectories if needed.
However, migrating full directories is generally <b>simpler</b> and <b>less error-prone</b> compared to handling multiple subdirectory migrations.
{{site.data.alerts.end}}
```bash ```bash
[root@meg-s-001 bin]# experiment_migration.bash -b /meg -S /data/project/meg -S data1 -D data1 -p "online" [root@meg-s-001 bin]# experiment_migration.bash -b /meg -S /data/project/meg -S data1 -D data1 -p "online"
@@ -158,7 +165,13 @@ Please confirm to start (y/N): N
❌ Transfer cancelled by user. ❌ Transfer cancelled by user.
``` ```
The following example migrates a subdirectory: ##### Example: Migrating a Specific Subdirectory
The following example demonstrates how to migrate **only a subdirectory**.
⚠️ **Important:**
- When migrating a subdirectory, **do not** run concurrent migrations on its parent directories.
- For example, avoid running migrations with `-p "shared"` while simultaneously migrating `-p "shared/subprojects"`.
```bash ```bash
[root@meg-s-001 bin]# experiment_migration.bash -b /meg -B /data/project/meg -S data1 -D data1 -p "shared/subprojects/meg1" [root@meg-s-001 bin]# experiment_migration.bash -b /meg -B /data/project/meg -S data1 -D data1 -p "shared/subprojects/meg1"
@@ -170,3 +183,5 @@ The following example migrates a subdirectory:
Please confirm to start (y/N): N Please confirm to start (y/N): N
``` ```
This command initiates the migration of the directory: `/meg/data1/shared/subprojects/meg1``login002.merlin7.psi.ch:/data/project/meg/data1/shared/subprojects/meg1`