Environment Modules: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
 
(55 intermediate revisions by 9 users not shown)
Line 1: Line 1:
{| width=600px class="wikitable"
|-
! Description !! Content
|-
| module load
| category/name | category/name/version (optional)
|-
| Availability
| [[bwUniCluster]] | [[BwForCluster_Chemistry]] | bwGRiD_tu
|-
| Links
| [http://modules.sourceforge.net/ Environment Modules Project] | [http://sourceforge.net/projects/modules/ Environment Modules]
|-
| License
| [http://www.gnu.org/licenses/old-licenses/gpl-2.0.html GNU General Public License]]
|}
<br>
= Introduction =
'''Environment Modules''', or short '''Modules''' are the means by which most of the installed scientific software is provided on the bwHPC clusters.
<br>
The use of different compilers, libraries and software packages requires users to set up a specific session environment suited for the program they want to run. The bwHPC clusters provide users with the possibility to load and unload complete environments for compilers, libraries and software packages by a single command.
<br>
<br>
= Description =
The Environment ''Modules'' package enables dynamic modification of your environment by the
use of so-called ''modulefiles''. A ''modulefile'' contains information to configure the shell
for a program/software . Typically, a modulefile contains instructions that alter or set shell
environment variables, such as PATH and MANPATH, to enable access to various installed
software.
<br>
One of the key features of using the Environment ''Modules'' software is to allow multiple versions of the same software to be used in your environment in a controlled manner.
For example, two different versions of the Intel C compiler can be installed on the system at the same time - the version used is based upon which Intel C compiler modulefile is loaded.
<br>
The software stack of bwHPC clusters provides a number of modulefiles. You can also
create your own modulefiles. ''Modulefiles'' may be shared by many users on a system, and
users may have their own collection of modulefiles to supplement or replace the shared
modulefiles.
<br>
A modulefile does not provide configuration of your environment until it is explicitly loaded,
i.e., the specific modulefile for a software product or application must be loaded in your environment before the configuration information in the modulefile is effective. For instance
loading the default Intel C and Fortran compiler you must execute:
<pre>
$ module load compiler/intel
</pre>
<br>
= Usage =
== Documentation ==
For help on how to use ''Modules'' software, i.e., the command '''module''',
execute:
<pre>
$ module help
</pre>
or
<pre>
$ man module
</pre>
For help on particular version of ''Module'', e.g. Intel compiler version X.Y, execute:
<pre>
$ module help compiler/intel/X.Y
</pre>
=== Online Documentation ===
[https://sourceforge.net/p/modules/wiki/FAQ/ Frequently Asked Questions (FAQ)]


Software on the bwHPC Clusters is provided as '''Software Environment Modules''', or short '''Modules'''.
== Display all available Modules ==

Available ''Module'' are modulefiles that can be loaded by the user. A ''Module'' must be loaded before it provides changes to your environment, as described in the introduction to this
Modules make it possible to have different versions of a software installed at a the same time.
section. You can display all available ''Modules'' on the system by executing:
The complete environments for the software package, compilers and libraries and needed by this specific version is then loaded by a single command. This happens usually in the beginning of the jobscript.

Full documentation: <code>module help</code> and [https://lmod.readthedocs.io/en/latest/ Environment Modules Website]

= Basic Usage =

== Module categories, versions and defaults ==
The bwHPC clusters categorize ''Modules'', each software can exist in different versions:

category/softwarename/version

e.g. if julia is installed, it is in the module <code>math/julia</code>.

You can load it in the default version just specifying math/julia or a specific version <code> math/julia/1.11.0 </code>

Currently all bwHPC software packages are assigned to the following ''Module'' categories:

<code> bio cae chem compiler devel lib math mpi numlib phys system vis </code>

== Display and search available Modules ==
Available ''Modules'' are modulefiles that can be loaded by the user. A ''Module'' must be loaded before it provides changes to your environment. You can display all available ''Modules'' on the system by executing:
<pre>
<pre>
$ module avail
$ module avail
</pre>
</pre>

The short form the command is:
You can selectively list software in one of those categories using, e.g. for the category "compiler", or just all versions of a certain module:
<pre>
<pre>
$ module av
$ module avail compiler/
$ module avail compiler/gnu
</pre>
</pre>
Available ''Modules'' can be also displayed in different modes, such as
* each ''Module'' per one line
<pre>
$ module -t avail
</pre>
* long
<pre>
$ module -l avail
</pre>
== bwHPC CLuster Information System (CIS) ==
A '''GUI-Version of all available and scheduled modules''' is available with our
<br>
'''CIS''' (Cluster Information System).
<br>
Software Admins are able to '''announce new modules''', versions and complete new software, too.
<br>
Academic users and other interested parties can get a '''summay of all installed modules and module-help informations'''.
<br>
<big>
[https://cis-hpc.uni-konstanz.de CIS: Cluster Information System]
</big>
<br><br>
[[File: cis.jpg]]
<br>


== module help ==
== Module categories, versions and defaults ==
A help message for a specific ''Module'' can be displayed with ''''module help category/softwarename/version''''.
The bwHPC clusters (such as [[bwUniCluster]]) traditionally provide a large variety of
software and software versions. Therefore ''Module'' are divided in category folders
containing subfolders of modulefiles again containing modulefile versions, and must be addressed
as follows:
category/softwarename/version
For instance the Intel compiler X.Y belongs to the category of compilers, therefore the
modulefile ''X.Y'' is placed under the category ''compiler'' and ''intel''.
<br>
<br>
The help message usually contains additional information about the software and points to the software website and documentation.
In case of multiple software versions, one version will be always defined as the '''default'''
version. The ''Module'' of the default can be addressed by simply omitting the version number:
category/softwarename
== Finding software Modules ==
Currently all bwHPC software packages are assigned to the following ''Module'' categories:
<!-- add wiki category for each of those, possibly just as a link -->
* [[:Category:Biology_software|bio]]
* [[:Category:Engineering_software|cae]]
* [[:Category:Chemistry_software|chem]]
* [[:Category:Compiler_software|compiler]]
* [[:Category:Debugger_software|devel]]
* [[BwHPC_BPG_for_Mathematics|math]]
* mpi
* [[:Category:Numerical libraries|numlib]]
* [[:Category:Physics software|phys]]
* [[:Category:System software|system]]
* [[:Category:Visualization|vis]]
You can selectively list software in one of those categories using, e.g. for the category "compiler"
<pre>
<pre>
$ module avail compiler/
$ module help system/example/1.0
----------------- Module Specific Help for "system/example/1.0" ---------------------------
"This module provides a bwhpc-examples job that works on every cluster.

[... rest of the output is omitted in the Wiki for clarity ...]
</pre>
</pre>

Searches are looking for a substring starting at the begin of the name, so this would list all software in categories starting with a "c"

== Loading Modules and Check they are loaded ==

{|style="background:#deffee; width:100%;"
|style="padding:5px; background:#cef2e0; text-align:left"|
[[Image:Attention.svg|center|25px]]
|style="padding:5px; background:#cef2e0; text-align:left"|
Don't use module load in .bashrc → see [[.bashrc Do's and Don'ts]]
|}

To load a software ''Module'' and display all loaded modules:
<pre>
<pre>
$ module avail c
$ module list
No Modulefiles Currently Loaded.
$ module load system/example/1.0
$ module list
Currently Loaded Modulefiles:
1) system/example/1.0
</pre>
</pre>

while this would find nothing

Modules make software available only in your current shell. Whenever you login in, you have to load the software again. Please do not auto-load modules in ~/.bashrc, this can lead to problems with system software or other modules you may load later.

== Software job examples ==
bwHPC provides example job scripts for most installed software modules.

For a Software ''Module'' with the sofware called '''SOMESOFTWARE''', you can find the example directory by:
<pre>
<pre>
$ cd $SOMESOFTWARE_EXA_DIR
$ module avail hem
</pre>
</pre>

== Loading Modules ==
Copy the whole example folder to your $HOME directory, so you can edit those job examples:
You can load a ''Module'' software in to your environment to enable easier access to software that

you want to use by executing:
<pre>
<pre>
$ cd
$ module load category/softwarename/version
$ mkdir softwarename_examples
$ echo $SOMESOFTWARE_EXA_DIR
# Please do not proceed if the command above does not provide any text !
# Otherwise you will start to copy all system data (the directory "/").
$ cp -r $SOMESOFTWARE_EXA_DIR/ softwarename_examples/

</pre>
</pre>

or
If your specific software isn't installed, there is a dummy software example module "system/example" present on all clusters. For this module, the process looks like this:

<pre>
<pre>
# Load the example module
$ module add category/softwarename/version
$ module load system/example/1.0

# Run example in a temporary directory
$ mkdir tmp_example_dir
$ cp -r $EXAMPLE_EXA_DIR/ softwarename_examples/
$ cd tmp_example_dir/bwhpc-examples

# Example jobscript for clusters using the SLURM batch system
sbatch examples-1.0.slurm
# Example jobscript for clusters using PBS
qsub examples-1.0.pbs

# Print the results
cat examples_result.txt
</pre>
</pre>
----
Loading a ''Module'' in this manner affects ONLY your environment for the current session.

= Additional Usage Recommendations =

=== Loading conflicts ===
=== Loading conflicts ===
By default you can not load different versions of same software ''Module'' in same session. Loading for example Intel compiler version X while Intel compiler version Y is loaded results in error message as follows:
By default you can not load different versions of same software ''Module'' in same session. Loading for example Intel compiler version X while Intel compiler version Y is loaded results in error message as follows:
Line 174: Line 140:
| URL of software's Wiki article
| URL of software's Wiki article
|-
|-
| and many many more...
| &nbsp;
|}
|}
with SWN being the place holder of the software ''Module'' name.
with SWN being the place holder of the software ''Module'' name.
<br>
<br>
All the changes to the current shell session to be invoked by loading the ''Module'' can be reviewed using
All the changes to the current shell session to be invoked by loading the ''Module'' can be reviewed using ''''module show category/softwarename/version''''.
<br>
<pre>
<pre>
$ module show category/softwarename/version
$ module show system/example/1.0
---------------------------------------------------------------------------------------------------
/opt/bwhpc/common/modulefiles/Core/system/example/1.0.lua:
---------------------------------------------------------------------------------------------------
whatis("A generic module containing a working bwhpc-examples job.")
setenv("EXAMPLE_VERSION","1.0")
setenv("EXAMPLE_HOME","/opt/bwhpc/common/system/example/1.0")
setenv("EXAMPLE_BIN_DIR","/opt/bwhpc/common/system/example/1.0/bin")
setenv("EXAMPLE_EXA_DIR","/opt/bwhpc/common/system/example/1.0/bwhpc-examples")
prepend_path("PATH","/opt/bwhpc/common/system/example/1.0/bin")
help([["This module provides a bwhpc-examples job that works on every cluster.
The module is used as example in the bwHPC-Wiki and therefore should be installed on every cluster,
such that users can try the commands out.

* The executable of this module can be found in the folder
$EXAMPLE_BIN_DIR
Upon loading the module, the binaries are added to PATH.

* Further documentation for using the example can be found in
https://wiki.bwhpc.de/e/Environment_Modules

* Examples are located at:
$EXAMPLE_EXA_DIR
]])

</pre>
</pre>

while it does not load the ''Module''.
=== Modules depending on Modules ===
=== Modules depending on Modules ===
Some program ''Modules'' depend on libraries to be loaded to the user environment. Therefore the
Some program ''Modules'' depend on libraries to be loaded to the user environment. Therefore the
Line 190: Line 183:
is already loaded (cf. [[#Loading conflicts|Loading conflicts]]).
is already loaded (cf. [[#Loading conflicts|Loading conflicts]]).
<br>
<br>

== Unloading Modules ==
== Unloading Modules ==
To unload or to remove a software ''Module'' execute:
To unload or to remove a software ''Module'' execute:
Line 195: Line 189:
$ module unload category/softwarename/version
$ module unload category/softwarename/version
</pre>
</pre>

or
=== Unloading all loaded modules ===
<pre>
In order to remove all previously loaded software modules from your environment issue the command 'module purge'.
$ module remove category/softwarename/version
</pre>
Unloading a ''Module'' that has been loaded by default makes it inactive for the current session only - it will be reloaded the next time you log in.
<br>
<br>
In order to remove all previously loaded software modules from your environment issue the following command:
<pre>
<pre>
$ module list
Currently Loaded Modulefiles:
1) devel/gdb/7.7
2) compiler/intel/14.0
3) mpi/openmpi/1.8-intel-14.0(default)
$
$ module purge
$ module purge
</pre>
== Display your loaded Modules ==
All ''Modules'' that are currently loaded for you can be displayed by the
command:
<pre>
$ module list
$ module list
No Modulefiles Currently Loaded.
$
</pre>
</pre>

Note: you only have to load further ''Modules'', if you want to use additional software
== Other Module commands ==
packages or to change the version of an already loaded software.
=== module whatis ===
<br>
A short description for a specific ''Module'' can be displayed with ''''module whatis category/softwarename/version''''
<br>
= Software job examples =
The ''Modules'' installed on bwHPC systems provide job examples to help you get started using the software or submitting jobs with this software. Examples can be found via a convenient
variable $SWN_EXA_DIR (for a ''Module'' called '''SWN'''). It is advisable to copy the whole example folder to your $HOME directory, so you can edit those job examples.
<br>
For copying the entire job examples folder of software '''swn''' to your working directory, execute:
<pre>
<pre>
$ module load catogory/softwarename
$ module whatis system/example/1.0
system/example/1.0 : A generic module containing a working bwhpc-examples job.
$ cp -R $SWN_EXA_DIR .
</pre>
</pre>
<br>
= How do Modules work? =
The default shell on the bwHPC clusters is bash, so explanations and examples will be shown for bash. In general, programs cannot modify the environment of the shell they are being run from, so how can the module command do exactly that?
<br>
The module command is not a program, but a bash-function.
You can view its content using
<pre>
$ type module
</pre>
and you will get a result like this:
<pre>
$ type module
module is a function
module ()
{
eval `/usr/bin/modulecmd bash $*`
}
</pre>
In this function, modulecmd is called. Its output to stdout is then executed inside your current shell using the bash-internal ''eval'' command. As a consequence, all output that you see from the module is transmitted via stderr (output handle 2) or in some cases even stdin (output handle 0).
<br>
<br>
----
[[Category:System software]][[Category:bwUniCluster|Environment Modules]][[Category:ForHLR Phase I|Environment Modules]]

Latest revision as of 13:20, 5 November 2024

Software on the bwHPC Clusters is provided as Software Environment Modules, or short Modules.

Modules make it possible to have different versions of a software installed at a the same time. The complete environments for the software package, compilers and libraries and needed by this specific version is then loaded by a single command. This happens usually in the beginning of the jobscript.

Full documentation: module help and Environment Modules Website

Basic Usage

Module categories, versions and defaults

The bwHPC clusters categorize Modules, each software can exist in different versions:

category/softwarename/version

e.g. if julia is installed, it is in the module math/julia.

You can load it in the default version just specifying math/julia or a specific version math/julia/1.11.0

Currently all bwHPC software packages are assigned to the following Module categories:

bio cae chem compiler devel lib math mpi numlib phys system vis

Display and search available Modules

Available Modules are modulefiles that can be loaded by the user. A Module must be loaded before it provides changes to your environment. You can display all available Modules on the system by executing:

$ module avail

You can selectively list software in one of those categories using, e.g. for the category "compiler", or just all versions of a certain module:

$ module avail compiler/
$ module avail compiler/gnu

module help

A help message for a specific Module can be displayed with 'module help category/softwarename/version'.
The help message usually contains additional information about the software and points to the software website and documentation.

$ module help system/example/1.0 
----------------- Module Specific Help for "system/example/1.0" ---------------------------
"This module provides a bwhpc-examples job that works on every cluster.

[... rest of the output is omitted in the Wiki for clarity ...]


Loading Modules and Check they are loaded

Attention.svg

Don't use module load in .bashrc → see .bashrc Do's and Don'ts

To load a software Module and display all loaded modules:

$ module list
No Modulefiles Currently Loaded.
$ module load system/example/1.0
$ module list
Currently Loaded Modulefiles:
  1) system/example/1.0


Modules make software available only in your current shell. Whenever you login in, you have to load the software again. Please do not auto-load modules in ~/.bashrc, this can lead to problems with system software or other modules you may load later.

Software job examples

bwHPC provides example job scripts for most installed software modules.

For a Software Module with the sofware called SOMESOFTWARE, you can find the example directory by:

$ cd  $SOMESOFTWARE_EXA_DIR

Copy the whole example folder to your $HOME directory, so you can edit those job examples:

$ cd
$ mkdir softwarename_examples
$ echo $SOMESOFTWARE_EXA_DIR
# Please do not proceed if the command above does not provide any text !
# Otherwise you will start to copy all system data (the directory "/").
$ cp -r $SOMESOFTWARE_EXA_DIR/ softwarename_examples/

If your specific software isn't installed, there is a dummy software example module "system/example" present on all clusters. For this module, the process looks like this:

# Load the example module
$ module load system/example/1.0

# Run example in a temporary directory
$ mkdir tmp_example_dir
$ cp -r $EXAMPLE_EXA_DIR/ softwarename_examples/
$ cd tmp_example_dir/bwhpc-examples

# Example jobscript for clusters using the SLURM batch system
sbatch examples-1.0.slurm
# Example jobscript for clusters using PBS
qsub examples-1.0.pbs

# Print the results
cat examples_result.txt

Additional Usage Recommendations

Loading conflicts

By default you can not load different versions of same software Module in same session. Loading for example Intel compiler version X while Intel compiler version Y is loaded results in error message as follows:

Module 'compiler/intel/X' conflicts with the currently loaded module(s) 'compiler/intel/Y'

The solution is unloading or switching Modules.

Showing the changes introduced by a Module

Loading a Module will change the environment of the current shell session. For instance the $PATH variable will be expanded by the software's binary directory. Other Module variables may even change the behavior of the current shell session or the software program(s) in a more drastic way.
Loaded Modules may also invoke an additional set of environment variables, which e.g. point to directories or destinations of documentation and examples. Their nomenclature is systematic:

Variable Pointing to
$SWN_HOME Root directory of the software package
$SWN_DOC_DIR Documentation
$SWN_EXA_DIR Examples
$SWN_BPR_URL URL of software's Wiki article
and many many more...  

with SWN being the place holder of the software Module name.
All the changes to the current shell session to be invoked by loading the Module can be reviewed using 'module show category/softwarename/version'.

$ module show system/example/1.0
---------------------------------------------------------------------------------------------------
   /opt/bwhpc/common/modulefiles/Core/system/example/1.0.lua:
---------------------------------------------------------------------------------------------------
whatis("A generic module containing a working bwhpc-examples job.")
setenv("EXAMPLE_VERSION","1.0")
setenv("EXAMPLE_HOME","/opt/bwhpc/common/system/example/1.0")
setenv("EXAMPLE_BIN_DIR","/opt/bwhpc/common/system/example/1.0/bin")
setenv("EXAMPLE_EXA_DIR","/opt/bwhpc/common/system/example/1.0/bwhpc-examples")
prepend_path("PATH","/opt/bwhpc/common/system/example/1.0/bin")
help([["This module provides a bwhpc-examples job that works on every cluster.
The module is used as example in the bwHPC-Wiki and therefore should be installed on every cluster,
such that users can try the commands out.

* The executable of this module can be found in the folder
  $EXAMPLE_BIN_DIR
  Upon loading the module, the binaries are added to PATH.

* Further documentation for using the example can be found in
  https://wiki.bwhpc.de/e/Environment_Modules

* Examples are located at:
  $EXAMPLE_EXA_DIR
]])

Modules depending on Modules

Some program Modules depend on libraries to be loaded to the user environment. Therefore the corresponding Modules of the software must be loaded together with the Modules of the libraries.
By default such software Modules try to load required Modules and corresponding versions automatically. However, automatic loading might fail if a different version of that required Module is already loaded (cf. Loading conflicts).

Unloading Modules

To unload or to remove a software Module execute:

$ module unload category/softwarename/version

Unloading all loaded modules

In order to remove all previously loaded software modules from your environment issue the command 'module purge'.

$ module list
Currently Loaded Modulefiles:
  1) devel/gdb/7.7
  2) compiler/intel/14.0
  3) mpi/openmpi/1.8-intel-14.0(default)
$
$ module purge
$ module list
No Modulefiles Currently Loaded.
$ 

Other Module commands

module whatis

A short description for a specific Module can be displayed with 'module whatis category/softwarename/version'

$ module whatis system/example/1.0 
system/example/1.0  : A generic module containing a working bwhpc-examples job.