Environment Modules: Difference between revisions

From bwHPC Wiki
Jump to navigation Jump to search
No edit summary
Line 2: Line 2:
manually the user environment.
manually the user environment.


The bwHPC clusters (such as '''''bwUniCluster''''') provide users the possibility to load and unload '''complete enviroments'''
The bwHPC clusters (such as '''''bwUniCluster''''') provide users the possibility to load and unload '''complete environments'''
for compilers, libraries and software packages by single commands. Because of the
for compilers, libraries and software packages by single commands. Because of the
convenient modularity this software is called ''Environment Modules''.
convenient modularity this software is called ''Environment Modules''.
Line 132: Line 132:
the libraries.
the libraries.


By default such software modulefiles try to load prequired modefile and modulefile versions automatically. However, automatic loading might fail if a different version of that modulefile
By default such software modulefiles try to load required modulefile and modulefile versions automatically. However, automatic loading might fail if a different version of that modulefile
is already loaded (cf. modulefile conflicts)
is already loaded (cf. modulefile conflicts)



Revision as of 18:07, 14 December 2013

The usage of compilers, libraries and software packages requires by default users to set up manually the user environment.

The bwHPC clusters (such as bwUniCluster) provide users the possibility to load and unload complete environments for compilers, libraries and software packages by single commands. Because of the convenient modularity this software is called Environment Modules.

Environment Modules

The Environment Modules software enables dynamic modification of your environment by the use of so-called modulefiles. A modulefile contains information to configure the shell for an application. Typically, a modulefile contains instructions that alter or set shell environment variables, such as PATH and MANPATH, to enable access to various installed software.

One of the key features of using the Environment Modules software is to allow multiple versions of the same software to be used in your environment in a controlled manner. For example, two different versions of the Intel C compiler can be installed on the system at the same time - the version used is based upon which Intel C compiler modulefile is loaded.

The software stack of bwHPC clusters provides a number of modulefiles. You can also create your own modulefiles. Modulefiles may be shared by many users on a system, and users may have their own collection of modulefiles to supplement or replace the shared modulefiles.

A modulefile does not provide configuration of your environment until it is explicitly loaded, i.e., the specific modulefile for a software product or application must be loaded in your environment before the configuration information in the modulefile is effective. For instance loading the default Intel C and Fortran compiler you must execute:

$ module load compiler/intel

All modulefiles that are currently loaded for you can be displayed by the command:

$ module list

You only have to load further modulefiles, if you want to use additional software packages or to change the version of an already loaded software.

Modulefile Help

For help on how to use the Environment Modules software, i.e., the command module, execute:

$ module help

or

$ man module

For help on particular version of modulefiles, e.g. Intel compiler version 12.1, execute:

$ module help compiler/intel/12.1

Display all available modulefiles

Available modulefiles are modulefiles that can be load by the user. A modulefile must be loaded before it provides changes to your environment, as described in the introduction to this section. You can display all available modulefiles on the system by executing:

$ module avail

The short form the command is:

$ module av

Available modulefiles can be also displayed in modes:

  • each modulefile per one line
$ module -t avail
  • long
$ module -l avail

Modulefile categories, versions and defaults

The bwHPC clusters (such as bwUniCluster) traditionally provide a large variety of software and software versions. Therefore modulefiles are divided in category folders containing subfolders of modulefiles containing modulefile versions, and must be addressed as follows:

category/modulefile_name/version

For instance the Intel compiler 12.1 belongs to the category of compilers, therefore the modulefile 12.1 is placed under the category compiler and intel.

In case of multiple software versions, one version will be always defined as the default version. Modulefiles of such default software can be addressed by omitting the version number:

category/modulefile_name

Loading Modulefiles

You can load a modulefile in to your environment to enable easier access to software that you want to use by executing:

$ module load category/modulefile_name/version

or

$ module add category/modulefile_name/version

Loading a modulefile in this manner affects your environment for the current session only.

Automatic Loading

If you frequently use one or more modulefiles that are not loaded when you log in to the system, you can set up your environment to automatically load those modulefiles for you. A method for doing this is to modify your shell startup script to include instructions to load the modulefile automatically.

For example, if you want to automatically load the Intel 12.1 modulefile when you log in, edit your shell startup script to include the following instructions. This example assumes that you use bash as your login shell. Edit the $HOME/.bashrc file as follows:

## if the ’module’ command is defined, $MODULESHOME will be set
if [ -n "$MODULESHOME" ]; then
   module load compiler/intel/12.1
fi

From now on, whenever you log in, the Intel 12.1 compiler modulefile is automatically loaded in your environment.

Modulefile conflicts

Modulefiles depending on Modulefiles

Some software depends on libraries to be loaded to the user environment, therefore the corresponding modulefile of the software must be loaded together with the modulefiles of the libraries.

By default such software modulefiles try to load required modulefile and modulefile versions automatically. However, automatic loading might fail if a different version of that modulefile is already loaded (cf. modulefile conflicts)


Unloading Modulefiles

Searching Modulefiles