View source for NEMO2/Migrate NEMO1 workspaces to NEMO2 workspaces

You can migrate your NEMO1 workspace to NEMO2 using <code>rsync</code> or the <code>migratenemo1ws</code> script.

Login to NEMO2 (after registration):
<pre>
ssh -l <username> nemo2-login.nemo.uni-freiburg.de
</pre>

__TOC__

== Using migratenemo1ws to migrate workspaces ==

You can migrate your NEMO1 workspace to NEMO2 using the <code>migratenemo1ws</code> script.
It will migrate your NEMO1 workspace to NEMO2 using <code>rsync</code> with predefined options<code>-a -h -x -z -P --progress</code>:

<pre>
-a: archive mode; equals -rlptgoD (no -H, -A, -X)
-h: output numbers in a human-readable format
-x: don't cross filesystem boundaries
-z: compress file data during the transfer
-P: keep partially transferred files
--progress: show progress during transfer
</pre>

This leads to the following command:
<pre>
rsync -ahxzP --progress workflow.nemo.uni-freiburg.de:/work/ws/nemo/<username>-<nemo1wsname>-0/ /work/classic/<username>-<nemo2wsname>/
</pre>

The script will also delete files in the target that are not in the source, if you use the <code>-d</code> option.
To test the migration without transferring any files, use the <code>-n</code> option for a dry run.
If you want to clean up the installation files and exit, use the <code>-c</code> option.

The help message is as follows:
<pre>
user@login3 ~> migratenemo1ws -h
Usage:
  /usr/local/bin/migratenemo1ws [-h] [-c] [-d] [-n] [-s <source>] [-t <target>]

  -h            this help
  -c            cleanup installation files and exit
  -d            delete files in target that are not in source
  -n            perform a dry run without transferring any files
  -s <source>   use this NEMO1 workspace name as source
  -t <target>   use this NEMO2 workspace name as target

Example:
  /usr/local/bin/migratenemo1ws -s nemo1ws -t nemo2ws

Migrating workspaces may take a while, depending on the amount of data to be transferred.
We suggest to run this script in a screen/tmux session.
You can detach from the session by pressing Ctrl+A, D (Ctrl+B, D, for tmux).
You can reattach to the session by running <code>screen -r</code> (<code>tmux attach</code>).
You can cancel the migration by pressing Ctrl+C.
</pre>

It is recommended to run this script in a <code>screen</code> or <code>tmux</code> session, as the migration may take a while.
You can detach from the session by pressing Ctrl+A, D (Ctrl+B, D, for tmux).
You can reattach to the session by running <code>screen -r</code> (<code>tmux attach</code>).
You can cancel the migration by pressing Ctrl+C.
<pre>
# For screen users:
# start a screen session
screen -S migratenemo1ws
# start data migration
migratenemo1ws -s nemo1ws -t nemo2ws
# detach from the screen session
Ctrl+A, D
# reattach to the screen session
screen -r migratenemo1ws
# cancel migration, if needed
Ctrl+C
# exit screen session, when done
Ctrl+D

# For tmux users:
# start a tmux session
tmux new -s migratenemo1ws
# start data migration
migratenemo1ws -s nemo1ws -t nemo2ws
# detach from the tmux session
Ctrl+B, D
# reattach to the tmux session
tmux attach -t migratenemo1ws
# cancel migration, if needed
Ctrl+C
# exit tmux session, when done
Ctrl+D
</pre>

== Using rsync manually ==

<code>rsync</code> is a fast and versatile file copying tool. It can be used to migrate your NEMO1 workspace to NEMO2.

You can use the above command to migrate your NEMO1 workspace to NEMO2:
<pre>
rsync -ahxzP --progress login.nemo.uni-freiburg.de:/work/ws/nemo/<username>-<nemo1wsname>-0/ /work/classic/<username>-<nemo2wsname>/
</pre>

To test which files will be transferred without actually transferring them, use the <code>--dry-run</code> option:
<pre>
rsync -ahxzP --progress --dry-run login.nemo.uni-freiburg.de:/work/ws/nemo/<username>-<nemo1wsname>-0/ /work/classic/<username>-<nemo2wsname>/
</pre>
To delete files in the target that are not in the source, use the <code>--delete</code> option:
<pre>
rsync -ahxzP --progress --delete login.nemo.uni-freiburg.de:/work/ws/nemo/<username>-<nemo1wsname>-0/ /work/classic/<username>-<nemo2wsname>/
</pre>

== Migrating directories from old NEMO1 HOME ==

We suggest migrating only files that are needed for your work.
Try not to copy everything from your old NEMO1 home directory, since it may contain a lot of unnecessary files.

You can migrate directories in your old NEMO1 home directory to NEMO2 using <code>rsync</code> with the following command:
<code>rsync -ahxzP --progress login.nemo.uni-freiburg.de:<dirtomigrate>/ $HOME/nemo1homebak/<dirtomigrate>/</code>

Example:
<pre>
# migrate some job directory from old NEMO1 home to NEMO2 (replace <some_job> with the actual directory name)
mkdir -p $HOME/nemo1homebak/<some_job>/
rsync -ahxzP --progress login.nemo.uni-freiburg.de:<some_job>/ $HOME/nemo1homebak/<some_job>/
</pre>

To test which files will be transferred without actually transferring them, use the <code>--dry-run</code> option:
<pre>
rsync -ahxzP --progress --dry-run login.nemo.uni-freiburg.de:<dirtomigrate>/ $HOME/nemo1homebak/<dirtomigrate>/
</pre>
To delete files in the target that are not in the source, use the <code>--delete</code> option:
<pre>
rsync -ahxzP --progress --delete login.nemo.uni-freiburg.de:<dirtomigrate>/ $HOME/nemo1homebak/<dirtomigrate>/
</pre>